Sandbox
@MemTensor/skills-vote

Skill routing and evolution for agent workflows

SkillsVote packages a hosted and local-first way to recommend skills before an agent starts work, then use execution feedback to improve the skill library. It centers on `integration/skills`, the Python code in `src/skills_vote`, and scripts for recommendation and benchmark evaluation.

301 starsβ€’17 forksβ€’Pythonβ€’Updated 1mo ago
Who it's for

Builders who want their agent to pick relevant skills at the right time and improve from task outcomes.

What it delivers

You can route tasks to the right skills without loading everything up front, then feed results back into the skill library.

What it does

Hosted skill integration

Provides the `skills-vote` skill for cloud-based recommendation and attribution-grounded feedback.

Local-first skill integration

Provides `skills-vote-local` for recommending skills from a local or private `SKILL.md` library without the hosted index.

Skill collection and profiling

Covers discovery and preprocessing of skills, including runtime requirements, dependencies, quality, and verifiability.

Recommendation and attribution pipeline

Uses task context, trajectories, and verifier signals to recommend skills and attribute whether they helped.

Benchmark scripts

Includes scripts for evaluation on Terminal-Bench Pro, Terminal-Bench 2.0, and SWE-Bench Pro.

How to get it

  1. 1Windows PowerShell
    [Environment]::SetEnvironmentVariable("SKILLS_VOTE_API_KEY", "YOUR_API_KEY", "User")
    npx skills add MemTensor/skills-vote --skill skills-vote
  2. 2MacOS/linux (Bash/Zsh)
    # For zsh, use ~/.zshrc instead
    echo 'export SKILLS_VOTE_API_KEY="YOUR_API_KEY"' >> ~/.bashrc && source ~/.bashrc
    npx skills add MemTensor/skills-vote --skill skills-vote
  3. 3Run
    npx skills add MemTensor/skills-vote --skill skills-vote-local

README

SkillsVote

Lifecycle Governance of Agent Skills: From Collection and Recommendation to Evolution

Route skills just in time, learn from task execution, and evolve reusable skill libraries through attribution-grounded feedback.

Powered by MemTensor

arXiv Website WeChat Blog rednote License Quick Start

🧭 What SkillsVote Governs

Agent skills are becoming a reusable execution layer for coding agents, research agents, and workflow agents. SkillsVote starts from this large-scale setting: we have discovered over πŸ”₯ 1.68M SKILL.md files from open-source GitHub repositories, including over πŸ’Ž 790K format-valid skills verified with the official Anthropic skill validator, making SkillsVote the world's largest open agent skill library 🌍.

At this scale, skill management is no longer about manually maintaining a short curated list. Agents face three linked problems: which skills to load before a task, how to tell whether a skill actually helped during execution, and how to update the library without accumulating noisy or unverified experience.

SkillsVote treats skills as lifecycle-managed artifacts. It connects collection, profiling, just-in-time recommendation, trajectory-based attribution, and feedback-driven evolution into one loop:

  1. Collect and profile skills from open-source or private skill libraries.
  2. Recommend relevant skills before task execution, instead of loading a large static skill list.
  3. Attribute task outcomes after execution using trajectories, skill usage, and verifier signals.
  4. Evolve the skill library by updating or creating reusable skills from grounded, attributed feedback.

πŸ“° Latest News

  • πŸ“„ [2026-05-19] Technical Report. We released the SkillsVote technical report on arXiv: arXiv:2605.18401.
  • 🧭 [2026-05-18] Local Skill Integration. We released the first version of skills-vote-local, enabling local/private skill recommendation with configurable retrieval strategies.
  • πŸŒ… [2026-04-09] Special Share. Core contributor's share on Linux.do.
  • πŸ“£ [2026-04-08] Social Launch. Our launch announcement is now live on WeChat Blog and rednote.
  • πŸš€ [2026-04-03] Launch Day! Published the very first open-source release of our recommendation and evaluation demos.

πŸ—ΊοΈ Roadmap: Towards the Full Skill Lifecycle

SkillsVote is being open-sourced in stages to support transparent research on agent skill collection, recommendation, attribution, and evolution.

  • Skill profiling and preprocessing. Analyze skill runtime requirements, dependencies, quality, and verifiability.
  • Benchmark evaluation scripts. Release scripts and configs for reproducing the main experiments reported in our paper.
  • Hosted SkillsVote skill integration. Release the skills-vote agent skill that connects agents to the hosted SkillsVote service for cloud-based recommendation and attribution-grounded feedback.
  • Local SkillsVote recommendation integration. Release skills-vote-local with configurable local/private skill recommendation strategies, including agentic search and vector search.
  • Local SkillsVote attribution and evolution integration. Extend skills-vote-local with attribution-grounded feedback and local skill library evolution.
  • Main experiment trajectories and results. Release benchmark trajectories and aggregated results to support inspection and reproduction of the reported experiments.

πŸ“Š Evaluation Results

SkillsVote is evaluated on agentic coding and terminal challenge benchmarks, including Terminal-Bench Pro, Terminal-Bench 2.0, and SWE-Bench Pro.

The results show that just-in-time skill recommendation and feedback-driven evolution improve agent performance on long-horizon tasks. Detailed reproduction instructions, benchmark setup configs, and scripts are documented in docs/experiment.md.

πŸš€ Quick Start

IntegrationBest forRequires
skills-voteUsing the hosted SkillsVote service for cloud-based skill recommendation and attribution-grounded feedback.SKILLS_VOTE_API_KEY
skills-vote-localRecommending skills from a local or private SKILL.md library without relying on the hosted index.Local config; no SkillsVote API key for agentic search

Option 1: Install the Hosted Skill

Use this integration when you want agents to retrieve skills from the hosted SkillsVote service and submit post-task feedback for attribution.

πŸ€– Agent Setup Prompt

Supercharge your agents (Codex, Claude Code, OpenClaw) by integrating SkillsVote directly! Just drop this prompt into your agent:

Install the `skills-vote` skill following https://raw.githubusercontent.com/MemTensor/skills-vote/main/integration/skills/INSTALL.md

Use the following values: 
- `SKILLS_VOTE_API_KEY`: "YOUR_API_KEY"
- `GH_TOKEN`: "YOUR_GITHUB_TOKEN"

πŸ”§ Manual Setup Alternative

Are you a CLI warrior? Set it up manually based on your OS:

Windows PowerShell

[Environment]::SetEnvironmentVariable("SKILLS_VOTE_API_KEY", "YOUR_API_KEY", "User")
npx skills add MemTensor/skills-vote --skill skills-vote

MacOS/linux (Bash/Zsh)

# For zsh, use ~/.zshrc instead
echo 'export SKILLS_VOTE_API_KEY="YOUR_API_KEY"' >> ~/.bashrc && source ~/.bashrc
npx skills add MemTensor/skills-vote --skill skills-vote

[!note] Don't forget to replace YOUR_API_KEY with your actual key!

Option 2: Install the Local-first Skill

Use this integration when your skills are stored in a local or private SKILL.md library and you want recommendation without the hosted index.

πŸ€– Agent Setup Prompt

Install the `skills-vote-local` skill following https://raw.githubusercontent.com/MemTensor/skills-vote/main/integration/skills/INSTALL.md

πŸ”§ Manual Setup Alternative

npx skills add MemTensor/skills-vote --skill skills-vote-local

After installation, open the installed skill root and configure configs/config.yaml. See Install SkillsVote Skills for the full configuration flow.

β™₯️ Acknowledgements

SkillsVote builds on the broader agent skill and agentic benchmark ecosystem. We thank the maintainers and contributors of Anthropic Skills, Harbor, and open-source agent skill repositories for making this research possible.

πŸ“š Citation

If you find SkillsVote useful for your research or development, please cite:

@misc{liu2026skillsvotelifecyclegovernanceagent,
  title={SkillsVote: Lifecycle Governance of Agent Skills from Collection, Recommendation to Evolution},
  author={Hongyi Liu and Haoyan Yang and Tao Jiang and Bo Tang and Feiyu Xiong and Zhiyu Li},
  year={2026},
  eprint={2605.18401},
  archivePrefix={arXiv},
  primaryClass={cs.CL},
  url={https://arxiv.org/abs/2605.18401},
}

πŸ“„ License

This repository is licensed under the MIT License. See LICENSE.

Built with ❀️ by MemTensor. Ready to vote for your skills?

Files in the repo

Repository payloadβ€’18 top-level entries
  • .vscode
  • assets
  • docker
  • docs
  • examples
  • integration
  • output
  • scripts
  • src
  • .env.example
  • .gitattributes
  • .gitignore
  • .pre-commit-config.yaml
  • .python-version
  • LICENSE
  • pyproject.toml
  • README.md
  • uv.lock

Discussion (0)

Ask about usage, or say what you built with it

Sign in to join the discussion.

No comments yet. Be the first to say what this is good for.

More skills

obra/
superpowers

An agentic skills framework & software development methodology that works.

285k
1 add

Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local deterministic AST parsing, every edge explained, no vector store.

117k
1 add
Vincentwei1021/
anything2explainer

Topic in, narrated explainer video out. A Claude Code / Codex skill that turns any topic into a black-canvas motion-graphics explainer video with TTS voiceover, subtitles and a chapter progress bar. Chinese or English; every frame drawn in code with Remotion.

666

Open-source AI job search: scan job portals, evaluate listings into a structured A-H report with a global 1-5 score, tailor your CV, track applications β€” runs locally in your AI coding CLI (Claude Code, Codex, OpenCode, Antigravity…)

71k