Back to Topics Directory
Topic Hub

#attention (27 Repositories)

Ranked open-source repositories tagged with #attention, scored by pull request acceptance likelihood and maintainer engagement velocity.

Topic Avg Merge Rate

27.8%

Avg Review Latency

74.0h

Filter by language

27 repositories tagged #attention

A TierPython 6.3k 5 GFIs

flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

51.1%
Merge Rate
14h
First Review
51%
1st-Timers
203
Maintainers
A TierPython 966

NVIDIA/cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

45.8%
Merge Rate
-
First Review
57%
1st-Timers
43
Maintainers
A TierRust 186

feichai0017/loom-infer

Rust-native GPU operator library for LLM inference, built with cuda-oxide

98.9%
Merge Rate
14h
First Review
100%
1st-Timers
0
Maintainers
A TierPython 305

flagos-ai/FlagAttention

A collection of memory efficient attention operators implemented in the Triton language.

35.3%
Merge Rate
4h
First Review
25%
1st-Timers
5
Maintainers
B TierRust 338

feichai0017/orbitkv

High Performance KV Cache for LLM Inference

55.2%
Merge Rate
-
First Review
100%
1st-Timers
0
Maintainers
B TierPython 3.8k

google-research/scenic

Scenic: A Jax Library for Computer Vision Research and Beyond

100.0%
Merge Rate
3d
First Review
100%
1st-Timers
2
Maintainers
B TierRust 185

feichai0017/oxide-infer

Rust-native GPU operator library for LLM inference, built with cuda-oxide

92.3%
Merge Rate
20d
First Review
100%
1st-Timers
0
Maintainers
B TierPython 188

harleyszhang/lite_llama

A light llama-like llm inference framework based on the triton kernel.

92.3%
Merge Rate
2d
First Review
0%
1st-Timers
0
Maintainers
B TierC++ 1.1k

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

50.0%
Merge Rate
4d
First Review
100%
1st-Timers
1
Maintainers
B TierPython 186

feichai0017/loom-kernels

Rust-first high-performance CUDA operator library for LLM inference

92.3%
Merge Rate
20d
First Review
0%
1st-Timers
0
Maintainers
C TierPython 213

lucidrains/dreamer4

Implementation of Danijar's latest iteration for his Dreamer line of work

38.5%
Merge Rate
31d
First Review
100%
1st-Timers
0
Maintainers
D TierPython 195

harleyszhang/rapid_llm

RapidLLM is an LLM inference framework with continuous batching, tensor and data parallelism, quantized weights, and with pluggable Triton/CUDA kernels.

0.0%
Merge Rate
-
First Review
0%
1st-Timers
1
Maintainers
D TierJUJupyter Notebook 14.9k

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

0.0%
Merge Rate
2d
First Review
0%
1st-Timers
0
Maintainers
D TierPython 338

wushilian/CRNN_Attention_OCR_Chinese

CRNN with attention to do OCR,add Chinese recognition

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 349

DongjunLee/transformer-tensorflow

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 492

kaushalshetty/Structured-Self-Attention

A Structured Self-attentive Sentence Embedding

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 489

AnubhavGupta3377/Text-Classification-Models-Pytorch

Implementation of State-of-the-art Text Classification Models in Pytorch

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 343

Gsunshine/Enjoy-Hamburger

[ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierVUVue 251

cbaziotis/neat-vision

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 490

HadoopIt/rnn-nlu

A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 4.7k

hyunwoongko/transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierJUJulia 573

chengchingwen/Transformers.jl

Julia Implementation of Transformer models

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 9.8k

jadore801120/attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need".

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 952

MorvanZhou/NLP-Tutorials

Simple implementations of NLP models. Tutorials are written in Chinese on my website https://mofanpy.com

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierScala 141

mit-han-lab/spatten

[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierJUJupyter Notebook 1.5k

szagoruyko/attention-transfer

Improving Convolutional Networks via Attention Transfer (ICLR 2017)

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierC++ 4.0k

km1994/nlp_paper_study

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
Best Attention Open Source Repositories & C-Rank™ | GetMerged