#
Lists (7)
Starred repositories
llm-d is a Kubernetes-native high-performance distributed LLM inference framework
🚀 The fast, Pythonic way to build MCP servers and clients
Kata Containers is an open source project and community working to build a standard implementation of lightweight Virtual Machines (VMs) that feel and perform like containers, but provide the workl…
GPU environment and cluster management with LLM support
Open, Multi-Cloud, Multi-Cluster Kubernetes Orchestration
Awesome MCP Servers - A curated list of Model Context Protocol servers
Model Context Protocol Servers
An extremely fast Python package and project manager, written in Rust.
LeaderWorkerSet: An API for deploying a group of pods as a unit of replication
Checkmate is an open-source, self-hosted tool designed to track and monitor server hardware, uptime, response times, and incidents in real-time with beautiful visualizations. Don't be shy, join her…
Awesome list of status page open source software, services and public status pages of major internet companies
A Conversational Speech Generation Model
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
Moshi is a speech-text foundation model and full-duplex spoken dialogue framework. It uses Mimi, a state-of-the-art streaming neural audio codec.
Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization
Depth Pro: Sharp Monocular Metric Depth in Less Than a Second.
Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.
Container runtimes on macOS (and Linux) with minimal setup
The original sources of MS-DOS 1.25, 2.0, and 4.0 for reference purposes
A massively parallel, high-level programming language
A Homebridge plugin for controlling/monitoring LG ThinQ device via their ThinQ platform.
A Xiaomi Roborock vaccum plugin (1st, 2nd and 3rd generation) for homebridge.
CSI driver NVMf mainly supports RDMA and TCP for Software Defined Storage by NVMf
LLMPerf is a library for validating and benchmarking LLMs
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
S-LoRA: Serving Thousands of Concurrent LoRA Adapters