adewale/
skill-eval-harness
adewale/skill-eval-harnessHarnesses
Agent Skill evaluation harness for paired variants, trace artifacts, and runner adapters
73
evalstate/fast-agentFrameworks & SDKs
Code, Build and Evaluate agents - excellent Model and Skills/MCP/ACP/A2A Support
3.9k
UiPath/coder_evalHarnesses
Playwright for coding agents. Benchmark Claude Code, Codex, Gemini, and OpenCode on your own tasks - and test that your skills, MCP servers, and CLIs work when an agent uses them. Sandboxed YAML suites, activation checks, A/B experiments, CI gates.
127
rpamis/cometHarnesses
Comet: agent skill harness for turning ideas into evaluated workflows
3k
MCPJam/
inspector
MCPJam/inspectorTools
Testing and evaluation platform to chat, inspect, and debug MCP servers, MCP apps, and ChatGPT apps.
2.2k
yaojingang/yao-meta-skillHarnesses
YAO = Yielding AI Outcomes. A rigorous engineering, evaluation, governance, and portability system for reusable agent skills.
2.6k
Evol-ai/
SkillCompass
Evol-ai/SkillCompassTools
Evaluate agent skill quality. Find the weakest link. Fix it. Prove it worked.
216
ai-boost/
awesome-harness-engineering
ai-boost/awesome-harness-engineeringCollections
Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.
4.1k
Q00/ouroborosHarnesses
Agent OS: the agent gets smarter on its own. We just hold the line: Interview-gated, staged evaluation, budgeted evolution loop. MCP server, 14 runtimes: Claude Code, Codex CLI, Gemini CLI, OpenCode, Copilot, Kiro and more.
5.8k
The living ecosystem where AI agents complete tasks through workflow loops, improve through iterative execution, are evaluated by mentor agents or humans in the loop, and turn completed work into reusable work experience and data to improve future agents.
1.3k
oxbshw/
LLM-Agents-Ecosystem-Handbook
oxbshw/LLM-Agents-Ecosystem-HandbookTutorials & Guides
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
546
pinecone-io/
cultivar
pinecone-io/cultivarTools
Use cultivar to test your Agent Skills, run them in sandboxes, and across different agents.
37
FrancyJGLisboa/
agent-skills-platform
FrancyJGLisboa/agent-skills-platformHarnesses
Build tested agent skills and govern their lifecycle through a user-defined marketplace: evidence, discovery, updates, rollback, quarantine, and 17-platform distribution.
2.4k
Orchestra-Research/
AI-Research-SKILLs
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.
13k