Back to Topics Directory
Topic Hub

#attention (20 Repositories)

Ranked open-source repositories tagged with #attention, scored by pull request acceptance likelihood and maintainer engagement velocity.

Topic Avg Merge Rate

15.8%

Avg Review Latency

4.6h

Filter by language

20 repositories tagged #attention

B TierPython 188

harleyszhang/lite_llama

A light llama-like llm inference framework based on the triton kernel.

96.0%
Merge Rate
2d
First Review
100%
1st-Timers
0
Maintainers
B TierRust 186

feichai0017/loom-infer

Rust-native GPU operator library for LLM inference, built with cuda-oxide

98.9%
Merge Rate
14h
First Review
100%
1st-Timers
1
Maintainers
A TierPython 915

NVIDIA/cudnn-frontend

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

63.6%
Merge Rate
11h
First Review
70%
1st-Timers
26
Maintainers
A TierPython 6.2k 5 GFIs

flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

57.3%
Merge Rate
21h
First Review
51%
1st-Timers
137
Maintainers
D TierScala 137

mit-han-lab/spatten

[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierJUJulia 571

chengchingwen/Transformers.jl

Julia Implementation of Transformer models

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 338

wushilian/CRNN_Attention_OCR_Chinese

CRNN with attention to do OCR,add Chinese recognition

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 349

DongjunLee/transformer-tensorflow

TensorFlow implementation of 'Attention Is All You Need (2017. 6)'

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierC++ 1.1k

jmaczan/tiny-vllm

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierJUJupyter Notebook 14.9k

graykode/nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierRust 185

feichai0017/orbitkv

OrbitKV: a Rust attention-state compiler and lifetime-safe KV block manager.

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 492

kaushalshetty/Structured-Self-Attention

A Structured Self-attentive Sentence Embedding

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 491

AnubhavGupta3377/Text-Classification-Models-Pytorch

Implementation of State-of-the-art Text Classification Models in Pytorch

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 343

Gsunshine/Enjoy-Hamburger

[ICLR 2021 top 3%] Is Attention Better Than Matrix Decomposition?

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 213

lucidrains/dreamer4

Implementation of Danijar's latest iteration for his Dreamer line of work

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 305

flagos-ai/FlagAttention

A collection of memory efficient attention operators implemented in the Triton language.

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierVUVue 251

cbaziotis/neat-vision

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 9.8k

jadore801120/attention-is-all-you-need-pytorch

A PyTorch implementation of the Transformer model in "Attention is All You Need".

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 490

HadoopIt/rnn-nlu

A TensorFlow implementation of Recurrent Neural Networks for Sequence Classification and Sequence Labeling

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
D TierPython 4.6k

hyunwoongko/transformer

Transformer: PyTorch Implementation of "Attention Is All You Need"

0.0%
Merge Rate
-
First Review
0%
1st-Timers
0
Maintainers
Best Attention Open Source Repositories & C-Rank™ | GetMerged