Sandbox
5 repos for β€œvector” Β· DeploymentClear
aws-samples/
sample-genai-on-eks-starter-kit

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: πŸš€ AI Gateway (LiteLLM) πŸ€– LLM Serving (vLLM, SGLang, Ollama) πŸ“Š Vector Databases, πŸ” Embedding Models (TEI) πŸ“ˆ Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes

94

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all from your IDE. Includes VS Code extension, TypeScript/Python SDKs, and Docker deployment.

8.4k
portel-dev/
ncp

Natural Context Provider (NCP). Your MCPs, supercharged. Find any tool instantly, load on demand, run on schedule, ready for any client. Smart loading saves tokens and energy.

98
hanyeol/
model-compose
hanyeol/model-composeFrameworks & SDKs

Deploy production-ready AI services in minutes. One YAML file for agents, RAG pipelines, and MCP servers β€” run anywhere. Inspired by docker-compose.

88