Sandbox
70 repos for llm · Any agent · DeploymentClear

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.

13k
maximhq/
bifrost
maximhq/bifrostConnectors

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

8k
zenml-io/
mcp-zenml

MCP server to connect an MCP client (Cursor, Claude Desktop etc) with your ZenML MLOps and LLMOps pipelines

49
aws-samples/
sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama) 📊 Vector Databases, 🔍 Embedding Models (TEI) 📈 Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

94
AstrBotDevs/AstrBotFrameworks & SDKs

AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨

40k
shamspias/
reins

A lightweight agent harness you bolt onto your app so an LLM can operate it — safely, and cheaply.

92
tanaikech/
ggsrun

High-performance Google Drive CLI and Model Context Protocol (MCP) Server for LLM/AI agents. Natively execute Google Apps Script (GAS) under a secure whitelisted runtime sandbox, automate transfers, and manage Drive infrastructure.

172
horw/
esp-mcp
horw/esp-mcpConnectors

Centralize ESP32 related commands and simplify getting started with seamless, LLM-driven interaction and help.

157

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

49k
Kong/
kong

🦍 The API and AI Gateway

44k
taichuy/
1flowbase
taichuy/1flowbaseFrameworks & SDKs

1flowbase: self-hosted AI gateway with protocol translation, dispatch, chat logs, built-in backend & React blocks to combine AI with business data. All managed by your Agent via MCP.

261
casdoor/casdoorConnectors

An open-source Agent-first Identity and Access Management (IAM) /LLM MCP & agent gateway and auth server with web UI supporting OpenClaw, MCP, OAuth, OIDC, SAML, CAS, LDAP, SCIM, WebAuthn, TOTP, MFA, Face ID, Google Workspace, Azure AD

14k

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

8.4k
lastmile-ai/mcp-agentFrameworks & SDKs

Build effective agents using Model Context Protocol and simple workflow patterns

8.5k

Self-hosted AI Agents Platform supporting Claude Code, Codex, Gemini agents. Apache 2.0.

524
VoltAgent/voltagentFrameworks & SDKs

AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework

11k

Enterprise-grade, commercial-friendly agentic workflow platform for building next-generation SuperAgents.

9k
conorluddy/ContextPodsFrameworks & SDKs

Model Context Protocol management suite/factory. An MCP that can generate and manage other local MCPs in multiple languages. Uses the official SDKs for code gen.

39
theognis1002/
mcp-gateway

Model Context Protocol (MCP) Gateway & Registry - Central hub for managing tools, resources, and prompts for MCP-compatible LLMs. Translates REST APIs into MCP, builds virtual MCP servers with security and observability, and bridges multiple transports (stdio, SSE, streamable HTTP).

41
strands-agents/
harness-sdk

Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.

7.2k

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.

3.7k