GV

GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

On this site

  • Sign in
  • promptfoo
  • ActionsCI/CD and automation
  • CodespacesCloud development environments
  • All Features
  • Documentation
  • Training
  • Certifications
  • Build with Copilot
  • Customize Copilot
  • Integrations
  • Trending repos
  • GitHub Sponsors
  • Developer articles

This view

  • Original page
  • New address

GeezerVison is showing github.com — promptfoo

README.md
Promptfoo - AI security testing platform with detective red panda logo

Ship agents, not vulnerabilities

Website • Docs • Blog • Discord

GitHub stars npm downloads License: MIT

AI security testing for LLMs, agents, and RAG systems

Trusted by 25% of the Fortune 500 and 350K+ developers

Important

Promptfoo is now part of OpenAI. Promptfoo remains open source under MIT, community contributions remain welcome, and we will continue supporting multiple providers and models. Read the announcement →

🚀 Quick Start

npx promptfoo@latest init
npx promptfoo@latest eval
npx promptfoo@latest view

Get Started → · Enterprise →

🛠️ What We Do

Security Testing

  • Red Teaming — Automated vulnerability discovery with 100+ attack plugins
  • Code Scanning — Detect LLM security risks in your IDE and CI/CD

Evaluations

  • CLI & Getting Started — Test prompts, models, and RAG pipelines locally
  • Node.js Package — Integrate testing into your codebase
  • Model Evaluation — Compare and benchmark models
  • GitHub Action — Security testing in every pull request

🔒 Security & Privacy

What we detect:

  • Prompt injections and jailbreaks
  • PII and sensitive data leaks
  • Hallucinations and policy violations
  • Tool misuse and adversarial attacks

Compliance: SOC 2 Type II · ISO 27001 · HIPAA

Data model:

  • Evals — 100% local, API keys never leave your machine
  • Red teaming — Your target runs locally; attack generation via our API or bring your own keys

📦 Projects

Repository Description
promptfoo Test prompts, agents, and RAGs. Red teaming and vulnerability scanning for LLMs.
promptfoo-action GitHub Action for CI/CD security testing
evil-mcp-server Red team testing for Model Context Protocol servers
modelaudit Static scanner that detects malicious code, backdoors, and vulnerabilities in ML model files
promptfoo-python Python wrapper for promptfoo
js-rouge JavaScript ROUGE metrics for summarization evaluation

👥 Community

Connect: Discord · X/Twitter · Bluesky · LinkedIn

Contribute: Contributing Guide · Good First Issues · Report Issues

Learn: LLM Vulnerability Database · Security Research Blog

Popular repositories Loading

  1. promptfoo promptfoo Public

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command li…

    TypeScript 27.1k 2.7k

  2. modelaudit modelaudit Public

    Security scanner for AI/ML model files. Detects malicious code, backdoors, and vulnerabilities before deployment

    Python 87 23

  3. promptfoo-action promptfoo-action Public

    The GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. S…

    TypeScript 81 36

  4. evil-mcp-server evil-mcp-server Public

    An evil MCP server used for redteam testing

    TypeScript 34 16

  5. crabcode crabcode Public

    Generic tmux-based workspace manager for multi-repo development. Lightning-fast dev productivity tool.

    Shell 18 5

  6. promptfoo-python promptfoo-python Public

    Python wrapper for the promptfoo CLI - LLM testing, red teaming, and security evaluation

    Python 8 6

Repositories

Loading
Type
Language
Sort
Showing 10 of 20 repositories
  • promptfoo Public

    Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

    promptfoo/promptfoo's past year of commit activity
    TypeScript 27,085 MIT 2,715 165 805 Updated Nov 12, 2026
  • promptfoo-python Public

    Python wrapper for the promptfoo CLI - LLM testing, red teaming, and security evaluation

    promptfoo/promptfoo-python's past year of commit activity
    Python 8 MIT 6 0 4 Updated Nov 12, 2026
  • mcp-agent-provider Public

    A promptfoo custom provider to test MCP servers with our evil mcp server

    promptfoo/mcp-agent-provider's past year of commit activity
    JavaScript 6 MIT 7 0 10 Updated Nov 12, 2026
  • js-rouge Public

    A Javascript implementation of the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) evaluation metric for summaries.

    promptfoo/js-rouge's past year of commit activity
    TypeScript 5 MIT 4 0 4 Updated Nov 11, 2026
  • promptfoo-action Public

    The GitHub Action for Promptfoo. Test your prompts, agents, and RAGs. AI Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

    promptfoo/promptfoo-action's past year of commit activity
    TypeScript 81 MIT 36 1 20 Updated Nov 11, 2026
  • demo-app Public

    Basic ChatGPT wrapper start example

    Uh oh!

    There was an error while loading. Please reload this page.

     promptfoo/demo-app's past year of commit activity
    JavaScript 2 MIT 4 0 4 Updated Nov 11, 2026
  • crabcode Public

    Generic tmux-based workspace manager for multi-repo development. Lightning-fast dev productivity tool.

    Uh oh!

    There was an error while loading. Please reload this page.

     promptfoo/crabcode's past year of commit activity
    Shell 18 5 1 13 Updated Nov 11, 2026
  • example-app Public

    Consolidated example application with options for multiple industries, models, and security levels

    promptfoo/example-app's past year of commit activity
    TypeScript 4 4 0 11 Updated Nov 11, 2026
  • modelaudit Public

    Security scanner for AI/ML model files. Detects malicious code, backdoors, and vulnerabilities before deployment

    promptfoo/modelaudit's past year of commit activity
    Python 87 MIT 23 0 3 Updated Nov 11, 2026
  • evil-mcp-server Public

    An evil MCP server used for redteam testing

    promptfoo/evil-mcp-server's past year of commit activity
    TypeScript 34 MIT 16 0 8 Updated Nov 3, 2026
View all repositories

People
@mldangelo

Top languages

TypeScript JavaScript Python Shell MDX

Most used topics

llm prompt-engineering rag
You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.