Sandbox
@fiddlecube/compliant-llm

Security and compliance testing for agents and MCP servers

Compliant LLM is a Python tool for checking AI systems against security and compliance rules. It can test prompts, agents, MCP servers, and GenAI models across multiple providers, then show results in a dashboard and reports. The repo is organized around a CLI, a core test engine, and a UI for reviewing findings.

162 starsโ€ข13 forksโ€ขPythonโ€ขUpdated 1y ago
Who it's for

Builders who want to verify AI agents and MCP servers against security and compliance policies.

What it delivers

You can run security and compliance checks on AI systems before they reach users.

What it does

Attack strategy testing

Runs tests against prompt injection, jailbreaking, context manipulation, and other attack styles.

Compliance analysis

Checks AI systems against frameworks like NIST, ISO, OWASP, GDPR, and HIPAA.

Multi-provider support

Works with providers through LiteLLM, including OpenAI, Anthropic, Gemini, Mistral, Groq, Azure, Ollama, and others.

Interactive dashboard

Provides a UI for viewing test results and analysis.

End-to-end testing

Tests AI systems across the full flow instead of only isolated prompts.

Detailed reporting

Generates reports with findings and actionable insights.

How to get it

  1. 1Run
    # install
    pip install compliant-llm
    
    # run the dashboard
    compliant-llm dashboard

README

Compliant LLM

PyPI Documentation Discord Chat GitHub Stars YC LinkedIn Follow on X Commit Activity Issues Closed License

Compliant LLM is your comprehensive toolkit for ensuring compliance and security of your AI systems.

Infosec, compliance, and gen AI teams use compliant-llm to ensure that their AI agents are secure and compliant with internal policies and frameworks like NIST, ISO, HIPAA, GDPR, etc.

It supports multiple LLM providers, and can be used to test prompts, agents, MCP servers and GenAI models.

Go through our documentation for more details.

Report a Bug

Request a Feature

๐ŸŽฏ Key Features

  • ๐ŸŽฏ Security Testing: Test against 8+ attack strategies including prompt injection, jailbreaking, and context manipulation
  • ๐Ÿ“Š Compliance Analysis: Ensure the compliance of your AI systems against NIST, ISO, OWASP, GDPR, HIPAA and other compliance frameworks
  • ๐Ÿค– Provider Support: Works with multiple LLM providers via LiteLLM
  • ๐Ÿ“ˆ Visual Dashboard: Interactive UI for analyzing test results
  • โšก End to End Testing: Test your AI systems end to end
  • ๐Ÿ“„ Detailed Reporting: Comprehensive reports with actionable insights

โš™๏ธ Install and Run

# install
pip install compliant-llm

# run the dashboard
compliant-llm dashboard

Configure your LLM provider and run attacks

Support

Create Issue

Contact: founders@fiddlecube.ai

Meet: ๐Ÿ”— Find a slot

Community: ๐Ÿ’ฌ Discord, X, LinkedIn

Self-hosted or hosted cloud: Book a demo

๐Ÿ”— Book a slot

Supported Providers

  • OpenAI
  • Anthropic
  • Gemini
  • Mistral
  • Groq
  • Deepseek
  • Azure
  • vLLM Ollama
  • Ollama
  • Nvidia Nim
  • Meta Llama

Roadmap

  • Full Application Pen Testing
  • Compliant and Logged MCP Servers
  • Support different Compliance Frameworks - NIST, HIPAA, GDPR, EU AI Act, etc.
  • Multimodal Testing
  • CI/CD
  • Access Control checks
  • Control Pane for different controls
  • Internal audits and documentation

โญ๏ธ Star us

๐Ÿค Contributors

DevelopersContributors
Those who build with compliant-llm.Those who make compliant-llm better.
(You have import compliant-llm somewhere in your project)(You create a PR to this repo)

We welcome contributions from the community! Whether it's bug fixes, feature additions, or documentation improvements, your input is valuable.

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Commit your changes (git commit -m 'Add some AmazingFeature')
  4. Push to the branch (git push origin feature/AmazingFeature)
  5. Open a Pull Request

๐Ÿ”’ Security & Privacy

We take data security and privacy seriously. Please refer to our Security and Privacy page for more information.

Telemetry

Compliant LLM tracks anonymized usage statistics to improve the product. No private or personally identifiable information is tracked.

You can opt-out by setting export DISABLE_COMPLIANT_LLM_TELEMETRY=true.

๐Ÿ“ Cite Us

@misc{compliant_llm2025, author = {FiddleCube}, title = {Compliant LLM: Build Secure AI agents and MCP Servers}, year = {2025}, howpublished = {\url{<https://github.com/fiddlecube/compliant-llm}}>, }

Files in the repo

Repository payloadโ€ข26 top-level entries
  • .github
  • .streamlit
  • cli
  • configs
  • core
  • docs
  • examples
  • tests
  • ui
  • __init__.py
  • .dockerignore
  • .env.example
  • .gitignore
  • .pre-commit-config.yaml
  • CHANGELOG.md
  • CONTRIBUTING.md
  • docker-compose.yml
  • Dockerfile
  • LICENSE
  • pyproject.toml
  • README.md
  • RELEASE_CHECKLIST.md
  • requirements-lock.txt
  • requirements.txt
  • setup.py
  • UV_MIGRATION_GUIDE.md

Discussion (0)

Ask about usage, or say what you built with it

Sign in to join the discussion.

No comments yet. Be the first to say what this is good for.

More tools

JuliusBrussee/
caveman

๐Ÿชจ why use many token when few token do trick โ€” Claude Code skill that cuts 65% of tokens by talking like caveman

105k
1 add
stablyai/
orca

Orca is the ADE for working with a fleet of parallel agents. Run any coding agent with your own subscription. Available on desktop, mobile and remote runtime.

66k
anthropics/
claude-code

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.

145k

Fast, efficient, battle-tested at Alibaba's scale. Hybrid architecture code review tool: deterministic pipelines + LLM Agent, precise line-level comments, built-in multi-language ruleset (NPE, thread-safety, XSS, SQL injection), OpenAI & Anthropic compatible.

22k

An open-source AI agent that brings the power of Gemini directly into your terminal.

107k
sickn33/
agentic-awesome-skills

AAS Core is the local, agent-first control plane for complete catalog discovery, agent-owned selection, stack validation, and planning, backed by 2,115+ agentic skills. Includes CLI, local MCP, catalog, plugins, and Workbench.

46k