LLMs
DSPy: The framework for programming—not prompting—language models
🦜🔗 Build context-aware reasoning applications
A language for constraint-guided and efficient LLM programming.
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
🦙 Integrating LLMs into structured NLP pipelines
Exact structure out of any language model completion.
[MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
A high-throughput and memory-efficient inference and serving engine for LLMs
Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)
✨✨Latest Advances on Multimodal Large Language Models
Efficient few-shot learning with Sentence Transformers
Enforce the output format (JSON Schema, Regex etc) of a language model
Official inference library for Mistral models
Chat with your database or your da 8000 talake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
Fine-tune mistral-7B on 3090s, a100s, h100s
Querypls🛠️: WebApp that Simplify SQL with Your Prompts. Transforming questions into SQL commands effortlessly.
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.
A guidance language for controlling large language models.
SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Code AI platform with Code Search & Cody