Lists (11)
Stars
Finetune Qwen3, Llama 4, TTS, DeepSeek-R1 & Gemma 3 LLMs 2x faster with 70% less memory! 🦥
Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.
Kubernetes Virtualization API and runtime in order to define and manage virtual machines.
Work with remote images registries - retrieving information, images, signing content
End-to-end stack for WebRTC. SFU media server and SDKs.
Hyperlight is a lightweight Virtual Machine Manager (VMM) designed to be embedded within applications. It enables safe execution of untrusted code within micro virtual machines with very low latenc…
很多镜像都在国外。比如 gcr 。国内下载很慢，需要加速。致力于提供连接全世界的稳定可靠安全的容器镜像服务。
📲 WebRTC E2E encrypted file transfer - React + node.js
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
A machine learning compiler for GPUs, CPUs, and ML accelerators
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Development repository for the Triton language and compiler
vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust
[ACL 2024] An Easy-to-use Knowledge Editing Framework for LLMs.
Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.
🌸 Learn Japanese grammar with TypeScript
Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services
Hooked CUDA-related dynamic libraries by using automated code generation tools.
A Datacenter Scale Distributed Inference Serving Framework
Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
F-Stack is an user space network development kit with high performance based on DPDK, FreeBSD TCP/IP stack and coroutine API.
The TypeScript AI agent framework. ⚡ Assistants, RAG, observability. Supports any LLM: GPT-4, Claude, Gemini, Llama.
DeepEP: an efficient expert-parallel communication library