Stockfish development builds on fixed hardware

Stockfish strength by build date

One point per tested development build.

Definition

Stockfish is an open-source chess engine whose every development build is played by a third party, nextchessmove.com, against one frozen opponent. In the measurer's own description, "NCM plays each Stockfish dev build 20,000 times against Stockfish 15", on "Dell R7515 128-thread EPYC 7702 dedicated servers", each playing "16 games concurrently with 30+0.3 time controls" with hash at 128MB and threads at 8 [@nextchessmove2026devbuilds]. The opponent, the hardware, the time control, the engine settings, and the number of games are all held fixed, so what the series measures is software.

A "discovery" here is not a discrete record. The series measures every build, so progress appears as a rise in the standing level, and the unit is Elo per year rather than records per year. Each build is dated by its test.

Facts

The collection-wide cumulative index redraws this series as the measured strength of every tested build:

Measured Elo vs Stockfish 15 for every tested build over time.

Method

The series was extracted by hand from a JavaScript data array on the dev-builds page, with the release tags matched to builds afterwards, so fetch.py is a staleness probe rather than a fetcher: it reports if the page carries a build later than the last vendored one. check.py recomputes the fact lines above from the CSV.

The CSV keeps upstream's test order, and the headline figures use the last row as the newest build. 8 builds share the final date; taking the day's maximum instead of the last test would report whichever run drew the easiest games and move the span figure by a couple of Elo. Every calendar-year gain above uses one convention: the last tested build of the year against the last tested build of the year before.

figure.py reads stockfish-ncm-elo.csv and draws elo_vs_sf15 against the year fraction of date as one thin line through all 2,542 builds. Rows with a non-empty release column are additionally drawn as points, so the twenty tagged releases from Stockfish 3 to Stockfish 18 are visible against the development noise. The LLM-credited commit is drawn as one open red marker placed at the year fraction of 2026-07-26 and at the last measured Elo value, annotated "first LLM-credited master commit: 0.6% speed patch, not an Elo record"; the open style marks a point that is not a record on the plotted axis. The elo_err column is carried in the CSV but is not drawn. The axis is linear, and January 2026 onward is shaded, as in every figure here.

Limitations

AI attribution

One master commit. Commit db98633b of 2026-07-26 states the division of labour in its own message:

"The first version of this patch was coded up by gpt-5.5-high. I made many changes, but probably most of the lines of code are LLM-written" — official-stockfish/Stockfish, commit db98633b, 2026-07-26 [@stockfish2026llmcommit]

A human maintainer substantially rewrote it before it was merged. It is a non-functional speed patch, measured at "speedup % = +0.60 +/- 0.08" in the same commit message, and it passed the project's standard statistical gate. A search of the repository's commit messages found no other commit crediting a language model as of 2026-07-26, and no Elo gain in the thirteen years of this series is AI-attributed in the vendored data.

Sources