Stars
A high-throughput and memory-efficient inference and serving engine for LLMs
DeepEP: an efficient expert-parallel communication library
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
My learning notes/codes for ML SYS.
A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.
Class of High Performance Computing taken at U.T.P 2017
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA/Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥
校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step
🤖 Assemble, configure, and deploy autonomous AI Agents in your browser.
This project is mainly for collecting open-source projects related to AI Agent infrastructure. In our daily work, we often come across some great and creative open-source projects, but they are eas…
A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
面向开发者的 LLM 入门教程，吴恩达大模型系列课程中文版
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Benchmarking large language models' complex reasoning ability with chain-of-thought prompting
AIInfra（AI 基础设施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。
AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程
A distributed, fast open-source graph database featuring horizontal scalability and high availability
Awesome-LLM: a curated list of Large Language Model
ChatGPT 中文指南🔥，ChatGPT 中文调教指南，指令指南，应用开发指南，精选资源清单，更好的使用 chatGPT 让你的生产力 up up up! 🚀