📣 News: mini, the 100 line AI agent that still gets 65% on SWE-bench verified! 📣 New benchmark: CodeClash (website, github) evaluates SWE agents on goals, not tasks
Software engineering agents, benchmarks, and models.
Built and maintained by researchers from Princeton University and Stanford University.
More information about the projects
Main projects:
SWE-agent, a system that automatically solves GitHub issues using an LM agent.
mini-SWE-agent, a 100 line AI agent that still gets 65% on SWE-bench verified!
SWE-bench, a benchmark for evaluating AI systems on real world GitHub issues.
SWE-smith, a toolkit for generating SWE training data at scale.
Also check out the supporting infrastructure for working with SWE-* projects
SWE-ReX, infrastructure supporting sandboxed code execution for AI agents
sb-cli, a command line interface for running evaluations on the cloud.
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
SWE-agent/SWE-agent's past year of commit activity
The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!
SWE-agent/mini-swe-agent's past year of commit activity
You are visitor 01402503 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.