LLM
Integrate cutting-edge LLM technology quickly and easily into your apps
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
Accessible large language models via k-bit quantization for PyTorch.
QLoRA: Efficient Finetuning of Quantized LLMs
Prompt Engineering, Generative AI, and LLM Guide by Learn Prompting | Join our discord for the largest Prompt Engineering learning community
Large Language Model Text Generation Inference
Let ChatGPT teach your own chatbot in hours with a single GPU!
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website …
Train transformer language models with reinforcement learning.
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
📋 A list of open LLMs available for commercial use.
StableLM: Stability AI Language Models
LLM training code for Databricks foundation models
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
Development repository for the Triton language and compiler
🦜🔗 Build context-aware reasoning applications
ChatPDF-GPT is an innovative chat interface application powered by LangChain and OpenAI, allowing users to upload and chat with PDF documents, stored in Pinecone vector database and Supabase storage.
tiktoken is a fast BPE tokeniser for use with OpenAI's models.
[NeurIPS 2023] Reflexion: Language Agents with Verbal Reinforcement Learning
CLI platform to experiment with codegen. Precursor to: https://lovable.dev
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
LlamaIndex is the leading framework for building LLM-powered agents over your data.
the AI-native open-source embedding database
Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".
🤖 A powerful, open source client-side JavaScript library for ChatGPT
Easily migrate your codebase from one framework or language to another.