GeezerVison

The World Wide Web, restored to 800 pixels of glory.

Home|About|Gaming cabinet|Archives|How it works|Starter sites

GeezerVison is showing github.com — SWE-bench

README.md

📣 New benchmark: CodeClash (website, github) evaluates SWE agents on goals, not tasks
📣 New: Meet mini, the 100 line AI agent that still gets 65% on SWE-bench verified!

SWE-bench

SWE-agent

SWE-smith

mini-SWE-agent

SWE-ReX

sb-cli

Software engineering agents, benchmarks, and models.

Built and maintained by researchers from Stanford University and Princeton University.

This organization contains the source code for several projects in the SWE-* open source ecosystem, including:

SWE-bench, a benchmark for evaluating AI systems on real world GitHub issues.
SWE-agent, a system that automatically solves GitHub issues using an LM agent.
SWE-smith, a toolkit for generating SWE training data at scale.
mini, an AI agent written in just 100 lines of code that scores >70% on SWE-bench verified

Also check out the supporting infrastructure for working with SWE-* projects

SWE-ReX, infrastructure supporting sandboxed code execution for AI agents
sb-cli, a command line interface for running evaluations on the cloud.
Mirror clones for the SWE-bench and SWE-smith repositories are available here and here.

Pinned Loading

SWE-bench SWE-bench Public

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Python 6.2k 1.1k
SWE-smith SWE-smith Public

[NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents

Python 831 139
experiments experiments Public

Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.

Shell 286 346
sb-cli sb-cli Public

Run SWE-bench evaluations remotely

Python 84 12

Repositories

Loading

Type

All Public Sources Forks Archived Mirrors Templates

Language

All Dockerfile JavaScript Jupyter Notebook Python Shell

Sort

Last updated Name Stars

Showing 10 of 14 repositories

SWE-smith Public
[NeurIPS 2025 D&B Spotlight] Scaling Data for SWE-agents

SWE-bench/SWE-smith's past year of commit activity

Python 831 MIT 139 21 (1 issue needs help) 12 Updated Nov 9, 2026
SWE-bench Public
SWE-bench: Can Language Models Resolve Real-world Github Issues?

SWE-bench/SWE-bench's past year of commit activity

Python 6,179 MIT 1,056 34 36 Updated Sep 18, 2026
swe-bench-multimodal-tasks Public

SWE-bench/swe-bench-multimodal-tasks's past year of commit activity

Shell 0 0 2 1 Updated Sep 18, 2026
experiments Public
Open sourced predictions, execution logs, trajectories, and results from model inference + evaluation runs on the SWE-bench task.

SWE-bench/experiments's past year of commit activity

Shell 286 346 33 61 Updated Sep 3, 2026
20260902_mini-v2.4.6_gemini-3-5-flash Public

SWE-bench/20260902_mini-v2.4.6_gemini-3-5-flash's past year of commit activity

0 0 0 0 Updated Sep 2, 2026
20260901_mini-v2.4.2_gemini-3-5-flash Public

SWE-bench/20260901_mini-v2.4.2_gemini-3-5-flash's past year of commit activity

0 0 0 0 Updated Sep 1, 2026
swe-bench.github.io Public
Landing page + leaderboard for SWE-Bench benchmark

SWE-bench/swe-bench.github.io's past year of commit activity

JavaScript 16 18 4 7 Updated Sep 1, 2026
swe-bench-multilingual-tasks Public

SWE-bench/swe-bench-multilingual-tasks's past year of commit activity

Dockerfile 2 2 0 1 Updated Aug 17, 2026
swe-bench-tasks Public

SWE-bench/swe-bench-tasks's past year of commit activity

Dockerfile 4 6 15 2 Updated Aug 16, 2026
SWE-smith-envs Public
Artifacts for building environments (Docker images) for repositories represented in SWE-smith

SWE-bench/SWE-smith-envs's past year of commit activity

Dockerfile 5 4 0 0 Updated Mar 2, 2026

View all repositories

People

Top languages

Python Dockerfile Shell JavaScript Jupyter Notebook

Most used topics

benchmark language-model software-engineering

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.