FlashInfer: Kernel Library for LLM Serving
-
Updated
Jun 13, 2025 - Cuda
#
attention
Here are 8 public repositories matching this topic...
Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.
cuda triton attention vit quantization video-generation mlsys inference-acceleration efficient-attention llm llm-infra video-generate
-
Updated
Jun 11, 2025 - Cuda
SpargeAttention: A training-free sparse attention that can accelerate any model inference.
attention vit quantization video-generation mlsys inference-acceleration ai-infra vision-transformer sparse-attention llm sageattention
-
Updated
Jun 10, 2025 - Cuda
📚FFPA: Extend FA-2 with Split-D for large headdim, 2x↑ vs SDPA.
cuda attention sdpa mla mlsys tensor-cores flash-attention deepseek deepseek-v3 deepseek-r1 fused-mla flash-mla
-
Updated
May 10, 2025 - Cuda
Code for the paper "Cottention: Linear Transformers With Cosine Attention"
-
Updated
Oct 19, 2024 - Cuda
Patch-Based Stochastic Attention (efficient attention mecanism)
-
Updated
Jan 16, 2023 - Cuda
Improve this page
Add a description, image, and links to the attention topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the attention topic, visit your repo's landing page and select "manage topics."