kagent is a Kubernetes native framework for building AI agents. Kubernetes is the most popular orchestration platform for running workloads, and kagent makes it easy to build, deploy and manage AI agents in Kubernetes. The kagent framework is designed to be easy to understand and use, and to provide a flexible and powerful way to build and manage AI agents.
The kagent documentation is available at kagent.dev/docs.
- Agents: Agents are the main building block of kagent. They are a system prompt, a set of tools and agents, and an LLM configuration represented with a Kubernetes custom resource called "Agent".
- LLM Providers: Kagent supports multiple LLM providers, including OpenAI, Azure OpenAI, Anthropic, Google Vertex AI, Ollama and any other custom providers and models accessible via AI gateways. Providers are represented by the ModelConfig resource.
- MCP Tools: Agents can connect to any MCP server that provides tools. Kagent comes with an MCP server with tools for Kubernetes, Istio, Helm, Argo, Prometheus, Grafana, Cilium and others. All tools are as Kubernetes custom resources (ToolServers) and can be used by multiple agents.
- Memory: Using the memory your agents can always have access to the latest and most up to date information.
- Observability: Kagent supports OpenTelemetry tracing which allows you to monitor what's happening with your agents and tools.
- Kubernetes Native: Kagent is designed to be easy to understand and use, and to provide a flexible and powerful way to build and manage AI agents.
- Extensible: Kagent is designed to be extensible, so you can add your own agents and tools.
- Flexible: Kagent is designed to be flexible, to suit any AI agent use case.
- Observable: Kagent is designed to be observable, so you can monitor the agents and tools using all common monitoring frameworks.
- Declarative: Kagent is designed to be declarative, so you can define the agents and tools in a yaml file.
- Testable: Kagent is designed to be tested and debugged easily. This is especially important for AI agent applications.
The kagent framework is designed to be easy to understand and use, and to provide a flexible and powerful way to build and manage AI agents.
Kagent has 4 core components:
- Controller: The controller is a Kubernetes controller that watches the kagent custom resources and creates the necessary resources to run the agents.
- UI: The UI is a web UI that allows you to manage the agents and tools.
- Engine: The engine is a Python application that runs the agents and tools. The engine is built using Autogen.
- CLI: The CLI is a command line tool that allows you to manage the agents and tools.
kagent
is currently in active development. You can check out the full roadmap in the project Kanban board here.
For instructions on how to run everything locally, see the DEVELOPMENT.md file.
For instructions on how to contribute to the kagent project, see the CONTRIBUTION.md file.
Thanks to all contributors who are helping to make kagent better.