LLM
Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
A framework for few-shot evaluation of language models.
LlamaIndex is the leading framework for building LLM-powered agents over your data.
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
New ways of breaking app-integrated LLMs
Awesome-LLM: a curated list of Large Language Model
A natural language interface for computers
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
An Autonomous LLM Agent for Complex Task Solving
Self-hosted version of OpenAI’s new stateful Assistants API
A neural network that transforms a design mock-up into a static website.
Drop in a screenshot and convert it to clean code (HTML/Tailwind/React/Vue)
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf
A blazingly fast multi-language serialization framework powered by JIT and zero-copy.
LLM API 管理 & 分发系统，支持 OpenAI、Azure、Anthropic Claude、Google Gemini、DeepSeek、字节豆包、ChatGLM、文心一言、讯飞星火、通义千问、360 智脑、腾讯混元等主流模型，统一 API 适配，可用于 key 管理与二次分发。单可执行文件，提供 Docker 镜像，一键部署，开箱即用。LLM API management & k…
A modular graph-based Retrieval-Augmented Generation (RAG) system
LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
When it comes to optimizers, it's always better to be safe than sorry
kube-eventer emit kubernetes events to sinks
Warp is a modern, Rust-based terminal with AI built in so you and your team can build great software, faster.
A containerized HTTP server that executes code in many languages
Train transformer language models with reinforcement learning.
Distributed query engine providing simple and reliable data processing for any modality and scale
The official repo for paper, LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods.