Lists (1)
Stars
A server based on Deno runtime, capable of running JavaScript, TypeScript, and WASM services.
A modern Python package and dependency manager supporting the latest PEP standards
A Datacenter Scale Distributed Inference Serving Framework
Cost-efficient and pluggable Infrastructure components for GenAI inference
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
QuickJS, the Next Generation: a mighty JavaScript engine
RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
This repository compiles code samples and notebooks demonstrating how to use Generative AI on Google Cloud Vertex AI.
Gateway API Inference Extension
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
A blazingly fast JSON serializing & deserializing library
Run Kubernetes on MySQL, Postgres, sqlite, dqlite, not etcd.
Github action to maximize the available disk space on Github runners
WHATWG-compliant and fast URL parser written in modern C++, part of Node.js, Clickhouse, Redpanda, Kong, Telegram, Datadog and Cloudflare Workers.
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
Rust library for concurrent data access, using memory-mapped files, zero-copy deserialization, and wait-free synchronization.
A linter and formatter to help you to improve copywriting, correct spaces, words, and punctuations between CJK (Chinese, Japanese, Korean).
很多镜像都在国外。比如 gcr 。国内下载很慢，需要加速。致力于提供连接全世界的稳定可靠安全的容器镜像服务。