zenml-io/
mcp-zenml
zenml-io/mcp-zenmlConnectors
MCP server to connect an MCP client (Cursor, Claude Desktop etc) with your ZenML MLOps and LLMOps pipelines
49
Portkey-AI/gatewayConnectors
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
13k
Abilityai/trinityAgents
Self-hosted AI Agents Platform supporting Claude Code, Codex, Gemini agents. Apache 2.0.
524
maximhq/
bifrost
maximhq/bifrostConnectors
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
8k
hanyeol/
model-compose
hanyeol/model-composeFrameworks & SDKs
Deploy production-ready AI services in minutes. One YAML file for agents, RAG pipelines, and MCP servers — run anywhere. Inspired by docker-compose.
88
aws-samples/
sample-genai-on-eks-starter-kit
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes
94