World of SWECraft

Agent collaboration at scale, in simulated software worlds

AI agents maintain worlds of real, interdependent Python packages, choosing their own tasks and working with each other. We measure their work by the speedup of dependent packages hidden from them: up to 31% for the best model.

Simulations
47
Agent hours
6.4K
Agent tokens
135B
Paper SimulationsoonBenchmarksoon