Stars
An extremely fast Python type checker and language server, written in Rust.
Dataframes powered by a multithreaded, vectorized query engine, written in Rust
A smarter cd command. Supports all major shells.
A tool for extracting plain text from Wikipedia dumps
Command-line program to download videos from YouTube.com and other video sites
Lightweight coding agent that runs in your terminal
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, Du…
A holistic way of understanding how Llama and its components run in practice, with code and detailed documentation.
Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Empowering everyone to build reliable and efficient software.
SGLang is a fast serving framework for large language models and vision language models.
Production-Grade Container Scheduling and Management
You like pytorch? You like micrograd? You love tinygrad! ❤️
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
Optimized primitives for collective multi-GPU communication
FlashInfer: Kernel Library for LLM Serving
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
An extremely fast Python linter and code formatter, written in Rust.
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Utils for streaming large files (S3, HDFS, gzip, bz2...)
🐶 Kubernetes CLI To Manage Your Clusters In Style!
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.