Kubernetes framework for AI agents

kagent is a Kubernetes native framework for building AI agents. Kubernetes is the most popular orchestration platform for running workloads, and kagent makes it easy to build, deploy and manage AI agents in Kubernetes. The kagent framework is designed to be easy to understand and use, and to provide a flexible and powerful way to build and manage AI agents.

Getting Started

• Quick Start
• Installation guide

Technical Details

Core Concepts

• Agents: Agents are the main building block of kagent. They are a system prompt, a set of tools and agents, and an LLM configuration represented with a Kubernetes custom resource called "Agent".
• LLM Providers: Kagent supports multiple LLM providers, including OpenAI, Azure OpenAI, Anthropic, Google Vertex AI, Ollama and any other custom providers and models accessible via AI gateways. Providers are represented by the ModelConfig resource.
• MCP Tools: Agents can connect to any MCP server that provides tools. Kagent comes with an MCP server with tools for Kubernetes, Istio, Helm, Argo, Prometheus, Grafana, Cilium, and others. All tools are Kubernetes custom resources (ToolServers) and can be used by multiple agents.
• Observability: Kagent supports OpenTelemetry tracing, which allows you to monitor what's happening with your agents and tools.

Core Principles

• Kubernetes Native: Agents and tools are managed as Kubernetes custom resources using familiar kubectl workflows.
• Extensible: Kagent is designed to be extensible, so you can add your own agents and tools.
• Flexible: Kagent is designed to be flexible, to suit any AI agent use case.
• Observable: Kagent is designed to be observable, so you can monitor the agents and tools using all common monitoring frameworks.
• Declarative: Kagent is designed to be declarative, so you can define the agents and tools in a YAML file.
• Testable: Kagent is designed to be tested and debugged easily. This is especially important for AI agent applications.

Architecture

Kagent has 4 core components:

• Controller: The controller is a Kubernetes controller that watches the kagent custom resources and creates the necessary resources to run the agents.
• UI: The UI is a web UI that allows you to manage the agents and tools.
• Engine: The engine runs your agents using ADK.
• CLI: The CLI is a command-line tool that allows you to manage the agents and tools.

Get Involved

We welcome contributions! Contributors are expected to respect the kagent Code of Conduct

There are many ways to get involved:

• 🐛 Report bugs and issues
• 💡 Suggest new features
• 📖 Improve documentation
• 🔧 Submit pull requests
• ⭐ Star the repository
• 💬 Help others in Discord
• 💬 Join the kagent community meetings
• 🤝 Share tips in the CNCF #kagent slack channel
• 🔒 Report security concerns

Roadmap

kagent is currently in active development. You can check out the full roadmap in the project Kanban board here.

Local development

For instructions on how to run everything locally, see the DEVELOPMENT.md file.

Contributors

Thanks to all contributors who are helping to make kagent better.

Star History

Reference

License

This project is licensed under the Apache 2.0 License.

kagent is a Cloud Native Computing Foundation project.