World-3 · web and tooling · World-3 collaboration. claude-opus-5 on Claude Code, 26 agents, connected: 1,947 sessions, 319 agent hours, 4.54 B tokens, $4,669 at list prices. From data/per-release-v3/41.4 in the paper’s figures repository at 9014a8cc, fetched from self-evolving/experiment-41-4 at ee2a7530 on Hugging Face. The states and releases come from the checkpoint self-evolving/experiment-41-4 @ cec541b4 (branch main). The score is rebuilt from the forge’s history, one state every two hours, each task carried at its last measured value.
Scarry 1.281 +28.1% over the seed at the last reading, after 1,922 sessions +0.9 pp from the previous reading
Sstrict 1.281 a package with a failed check or benchmark scores 1.0
Movers +15 / −0 tasks beyond their noise floor at the last reading
Readings 16 latest Oct 4, 10:35 UTC
Run 1,947 sessions completed work sessions eval set v3.x · speedup over the seed sessions time
+10.0% +20.0% +30.0% seed 0 500 1000 1500 completed sessions Releases: referencing v0.38.0, jsonschema-specifications v2026.9.1 Release: aiosignal v1.4.1 Release: referencing v0.39.0 Release: fastapi 0.141.2 Release: cloudpickle v3.2.0 Release: h11 v0.17.0 Release: rich v15.0.1 Release: attrs 26.2.0 Release: pydantic v2.13.5 Release: jsonschema v4.27.0 Release: referencing v0.40.0 Releases: fastapi 0.141.3, pydantic-settings v2.14.3 Release: pydantic v2.13.6 Release: pyyaml 6.0.4 Release: packaging 26.4 Release: attrs 26.3.0 Release: jsonschema v4.28.0 Release: cloudpickle v3.3.0 Release: referencing v0.41.0 Release: h11 v0.18.0 Releases: referencing v0.42.0, aiosignal v1.4.2 Release: attrs 26.4.0 Releases: pydantic v2.13.7, jsonschema v4.29.0 Releases: pydantic-settings v2.14.4, rich v15.0.2 Release: pyyaml 6.0.5 Release: referencing v0.43.0 Release: cloudpickle v3.4.0 Releases: pydantic-settings v2.14.5, pydantic v2.13.8 Release: aiohttp v3.14.3 Releases: jsonschema v4.30.0, referencing v0.44.0 Release: packaging 26.5 Release: pydantic-settings v2.14.6 Releases: jsonschema v4.31.0, h11 v0.19.0 Release: cloudpickle v3.5.0 Release: fastapi 0.141.4 Release: pydantic-settings v2.14.7 Release: jsonschema v4.32.0 Release: pydantic v2.13.9 Release: fastapi 0.141.5 Releases: referencing v0.45.0, packaging 26.6 Release: cloudpickle v3.6.0 Release: jsonschema v4.33.0 Release: attrs 26.5.0 Releases: h11 v0.20.0, pydantic v2.13.10 Release: referencing v0.46.0 Release: pyyaml 6.0.6 Releases: aiohttp v3.14.4, pydantic-settings v2.14.8 Release: rich v15.0.3 Release: cloudpickle v3.7.0 Releases: packaging 26.7, jsonschema v4.34.0 Release: referencing v0.47.0 Release: h11 v0.21.0 Release: attrs 26.6.0 Release: fastapi 0.141.6 Release: pydantic-settings v2.14.9 Releases: cloudpickle v3.8.0, pyyaml 6.0.7 Release: pydantic core-v2.46.5 Release: jsonschema v4.35.0 Release: packaging 26.8 Releases: pydantic-settings v2.14.10, pydantic v2.13.11 Release: pyyaml 6.0.8 Release: cloudpickle v3.9.0 Release: attrs 26.7.0 Release: rich v15.0.4 Release: jsonschema-specifications v2026.9.2 Release: h11 v0.22.0 Release: pydantic-settings v2.14.11 Release: referencing v0.48.0 Releases: jsonschema v4.36.0, fastapi 0.141.7 Releases: attrs 26.8.0, rich v15.0.5, pyyaml 6.0.9 Release: cloudpickle v3.10.0 Releases: referencing v0.49.0, h11 v0.23.0 Release: aiohttp v3.14.5 Release: jsonschema v4.37.0 Releases: packaging 26.9, pydantic-settings v2.14.12 Release: aiosignal v1.4.3 Release: pyyaml 6.0.10 Release: attrs 26.9.0 Release: pydantic-settings v2.14.13 Releases: h11 v0.24.0, referencing v0.50.0, fastapi 0.141.8 Release: pyyaml 6.0.11 Release: pydantic-settings v2.14.14 Release: aiosignal v1.4.4 Release: jsonschema v4.38.0 Release: rich v15.0.6 Release: cloudpickle v3.11.0 Release: pydantic v2.13.12 Releases: pydantic-settings v2.14.15, packaging 26.10 Release: referencing v0.51.0 Release: pyyaml 6.0.12 Release: attrs 26.10.0 Releases: fastapi 0.141.9, h11 v0.25.0, cloudpickle v3.12.0 Releases: pydantic v2.13.13, pydantic-settings v2.14.16, attrs 26.11.0 Release: jsonschema v4.39.0 Releases: pydantic-settings v2.14.17, fastapi 0.141.10 Release: rich v15.0.7 Release: aiohttp v3.14.6 Release: jsonschema v4.40.0 Release: pyyaml 6.0.13 Release: cloudpickle v3.13.0 Releases: rich v15.0.8, aiosignal v1.4.5 Release: h11 v0.26.0 Release: referencing v0.52.0 Release: pydantic v2.13.14 Release: pydantic-settings v2.14.18 Releases: pyyaml 6.0.14, fastapi 0.141.11 Release: attrs 26.12.0 Releases: packaging 26.11, referencing v0.53.0 Releases: rich v15.0.9, cloudpickle v3.14.0 Release: pyyaml 6.0.15 Release: pydantic v2.13.15 Releases: aiosignal v1.5.0, h11 v0.27.0, pydantic-settings v2.14.19 Release: fastapi 0.141.12 Release: attrs 26.13.0 Release: cloudpickle v3.15.0 Releases: referencing v0.54.0, pyyaml 6.0.16, rich v15.0.10 Release: pydantic v2.13.16 Release: fastapi 0.141.13 Releases: pydantic-settings v2.14.20, packaging 26.12, jsonschema v4.41.0 Release: attrs 26.14.0 Release: cloudpickle v3.16.0 Release: referencing v0.55.0 Releases: h11 v0.28.0, rich v15.0.11 Release: pydantic-settings v2.14.21 Releases: pyyaml 6.0.17, pydantic v2.13.17 Release: referencing v0.56.0 Release: fastapi 0.141.14 Release: cloudpickle v3.17.0 Release: packaging 26.13 Releases: rich v15.0.12, pydantic-settings v2.14.22 Releases: aiohttp v3.14.7, fastapi 0.141.15, attrs 26.15.0, jsonschema v4.42.0 Release: cloudpickle v3.18.0 Releases: pyyaml 6.0.18, pydantic v2.13.18 Release: fastapi 0.141.16 Release: attrs 26.16.0 Release: h11 v0.29.0 Releases: pydantic-settings v2.14.23, jsonschema v4.43.0 Release: aiosignal v1.5.1 Release: packaging 26.14 Release: pydantic v2.13.19 Release: pyyaml 6.0.19 Release: h11 v0.30.0 Releases: referencing v0.57.0, cloudpickle v3.19.0 Release: rich v15.0.13 Release: pydantic-settings v2.14.24 Release: jsonschema v4.44.0 Releases: pyyaml 6.0.20, referencing v0.58.0, pydantic v2.13.20, fastapi 0.141.17 Releases: packaging 26.15, h11 v0.31.0 Release: cloudpickle v3.20.0 Release: attrs 26.17.0 Release: aiohttp v3.14.8 Release: jsonschema v4.45.0 Release: pyyaml 6.0.21 Release: rich v15.0.14 Release: fastapi 0.141.18 Release: referencing v0.59.0 Release: packaging 26.16 Release: h11 v0.32.0 Release: jsonschema v4.46.0 Release: cloudpickle v3.21.0 Release: pydantic v2.13.21 Release: rich v15.0.15 Release: pyyaml 6.0.22 Releases: fastapi 0.141.19, pydantic-settings v2.14.25 Releases: aiohttp v3.14.9, referencing v0.60.0 Release: cloudpickle v3.22.0 Releases: attrs 26.18.0, jsonschema v4.47.0 Releases: rich v15.0.16, h11 v0.33.0, pydantic v2.13.22 Release: packaging 26.17 Releases: aiohttp v3.14.10, pyyaml 6.0.23 Release: pydantic-settings v2.14.26 Release: rich v15.0.17 Release: fastapi 0.141.20 Release: cloudpickle v3.23.0 Releases: packaging 26.18, referencing v0.61.0 Release: attrs 26.19.0 Release: aiohttp v3.14.11 Releases: pyyaml 6.0.24, pydantic v2.13.23 Release: pydantic-settings v2.14.27 Release: referencing v0.61.1 Release: attrs 26.20.0 Releases: fastapi 0.141.21, rich v15.0.18, packaging 26.19 Release: pydantic v2.13.24 Release: cloudpickle v3.24.0 Release: h11 v0.34.0 Releases: attrs 26.21.0, pydantic-settings v2.14.28 Release: aiohttp v3.14.12 Releases: rich v15.0.19, packaging 26.20 Release: referencing v0.62.0 Release: pydantic v2.13.25 Release: pyyaml 6.0.25 Releases: attrs 26.22.0, pydantic-settings v2.14.29 Release: referencing v0.62.1 Release: fastapi 0.141.22 Release: pyyaml 6.0.26 Releases: attrs 26.23.0, pydantic-settings v2.14.30, packaging 26.21 Releases: rich v15.0.20, cloudpickle v3.25.0 Release: pydantic v2.13.26 Releases: aiohttp v3.14.13, referencing v0.63.0 Release: jsonschema v4.48.0 Release: h11 v0.35.0 Release: attrs 26.24.0 Releases: pydantic-settings v2.14.31, fastapi 0.141.23 Release: rich v15.0.21 Release: packaging 26.22 Release: jsonschema v4.49.0 Release: pyyaml 6.0.27 Release: pydantic v2.13.27 Release: aiohttp v3.14.14 Release: rich v15.0.22 Release: referencing v0.64.0 Releases: aiosignal v1.5.2, jsonschema v4.50.0, fastapi 0.141.24 Release: cloudpickle v3.26.0 Release: jsonschema v4.51.0 Releases: aiohttp v3.14.15, h11 v0.36.0 Release: attrs 26.25.0 Release: rich v15.0.23 Release: jsonschema v4.52.0 Release: packaging 26.23 Releases: referencing v0.65.0, pydantic v2.13.28 Release: jsonschema v4.53.0 Release: attrs 26.26.0 Releases: jsonschema v4.54.0, pydantic v2.13.29 Releases: pydantic-settings v2.14.32, jsonschema v4.55.0 Release: referencing v0.66.0 Release: jsonschema v4.56.0 Release: pydantic v2.13.30 Releases: pydantic-settings v2.14.33, attrs 26.27.0 Release: jsonschema v4.57.0 Release: multidict v6.29.0 Releases: aiohttp v3.14.16, jsonschema v4.58.0, pydantic v2.13.31 Releases: pydantic-settings v2.14.34, referencing v0.67.0 Release: attrs 26.28.0 Release: jsonschema v4.59.0 Releases: pydantic-settings v2.14.35, frozenlist v1.8.25 Release: fastapi 0.141.25 Releases: pydantic v2.13.32, jsonschema v4.60.0 Releases: cloudpickle v3.27.0, propcache v0.13.1 Releases: pydantic-settings v2.14.36, jsonschema-specifications v2026.10.1 Release: referencing v0.68.0 Release: fastapi 0.141.26 Release: attrs 26.29.0 Releases: rich v15.0.24, yarl v1.24.29 Release: pydantic-settings v2.14.37 Release: pydantic v2.13.33 Releases: packaging 26.24, cloudpickle v3.28.0 Release: pyyaml 6.0.28 Release: rich v15.0.25 Release: packaging 26.25 Releases: rich v15.0.26, cloudpickle v3.29.0 Release: pyyaml 6.0.29 Release: packaging 26.26 Release: rich v15.0.27 Release: pyyaml 6.0.30 Release: cloudpickle v3.30.0 Releases: rich v15.0.28, packaging 26.27 Release: rich v15.0.29 Release: pyyaml 6.0.31 Release: packaging 26.28 Releases: h11 v0.37.0, cloudpickle v3.31.0 Release: rich v15.0.30 Release: h11 v0.38.0 Release: cloudpickle v3.32.0 Release: rich v15.0.31 Release: packaging 26.29 Releases: rich v15.0.32, h11 v0.39.0 Releases: rich v15.0.33, pyyaml 6.0.32, packaging 26.30 Releases: cloudpickle v3.33.0, rich v15.0.34 Release: h11 v0.40.0 Release: rich v15.0.35 Release: pyyaml 6.0.33 Releases: packaging 26.31, pluggy 1.29.0 Release: rich v15.0.36 Release: h11 v0.41.0 Release: packaging 26.32 Release: pyyaml 6.0.34 Release: cloudpickle v3.34.0 Release: packaging 26.33 Release: uvicorn 0.60.0 Release: packaging 26.34 Releases: rich v15.0.37, h11 v0.42.0, pyyaml 6.0.35 Release: cloudpickle v3.35.0 Releases: packaging 26.35, rich v15.0.38, tibs v0.5.50 Release: pytest 9.1.29 Release: iniconfig v2.32.0 Release: packaging 26.36 Release: pyyaml 6.0.36 Releases: rich v15.0.39, pygments 2.49.0 Scarry at each readingSstrict , where it differs a package failed a check or a benchmark 385 releases measuredBreakdown after 1,922 sessions · Oct 4, 10:35 UTC Scarry 1.281 · Sstrict 1.281 · +28.1% over the tasks with a value · 20/20 tasks measured
openapi-schema-validator · compiled-validation-throughput +193.4% openapi-schema-validator · first-validation +96.0% openapi-schema-validator · schema-compilation +80.2% openapi-spec-validator · validate-synthetic-specs +66.4% openapi-schema-validator · helper-validation-checked-throughput +45.5% openapi-schema-validator · helper-validation-trusted-throughput +43.9% prefect · cold-imports +29.8% kedro · omega-config-loader +29.4% kedro · io-bound-runners +28.1% kedro · data-catalog +27.4% openapi-spec-validator · validate-real-world-specs +20.5% kedro · session-lifecycle +16.8% dascore · io-benchmarks +0.8% navigator-api · base-app-handler-construction +0.6% dascore · spool-benchmarks +0.5% dascore · patch-benchmarks +0.1% tqdm · alternative-progress-libraries 0.0% tqdm · tqdm-loop-overhead 0.0% navigator-api · singleton-construction 0.0% mitmproxy · proxy-layer-roundtrips −0.1%