Stars
llm-d is a Kubernetes-native high-performance distributed LLM inference framework
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.