Add chess.chesstb: pure-Python prober for chesstb endgame tablebases - #1194
Open
noobpwnftw wants to merge 1 commit into
Open
Add chess.chesstb: pure-Python prober for chesstb endgame tablebases#1194noobpwnftw wants to merge 1 commit into
noobpwnftw wants to merge 1 commit into
Conversation
noobpwnftw
force-pushed
the
add-chesstb-tablebases
branch
7 times, most recently
from
July 1, 2026 01:08
a252d4c to
228bac6
Compare
noobpwnftw
force-pushed
the
add-chesstb-tablebases
branch
22 times, most recently
from
August 15, 2026 02:34
836a63f to
838e047
Compare
noobpwnftw
force-pushed
the
add-chesstb-tablebases
branch
from
August 16, 2026 16:17
838e047 to
661cc2e
Compare
chesstb tables store WDL, DTC, DTM and DTM50 for endgame material
configurations. This adds a pure-Python reader for the format, shaped like
chess.syzygy and chess.gaviota: open_tablebase() on a directory tree, then
probe() a board for all four values at once, or probe_wdl / probe_dtc /
probe_dtm / probe_dtm50 for one at a time. Conversion is probe_dtc rather
than syzygy's probe_dtz: syzygy bases its cursed band off 100, so a DTZ
magnitude carries the WDL class along with the count, while a DTC is a
plain distance in every class.
The format, as read here: one table per material configuration, split by
side to move and compressed in blocks (LZMA, or LZ4 with an optional
dictionary prefix). Positions are addressed by a combinatorial index over
king symmetry classes and groups of identical pieces. Configurations of
equal strength share a single table, read through a rank-mirrored,
colour-swapped view of the position; one holding an opposing pawn pair may
also ship a smaller frozen-pair ('p') table, which is preferred when
present, and whose index counts only the free pieces. A table may omit one
side to move altogether, in which case its values are recovered by
minimaxing over legal children. En passant is not indexed and is applied as
a virtual-capture overlay at probe time. DTM50 layers its values by halfmove
clock and marks a drawn layer with a hint bit rather than a distance, so the
prober builds both the 256-position prefix index and the hint bitmap the
layout leaves out; its flat layer is also where DTM comes from, so the
standalone DTM table -- a DTC table but for the value decode -- is read only
for material shipping no pack.
Tables are memory-mapped and decoded a block at a time, with a shared LRU
holding decoded blocks across every open table against one budget.
_TableFile._open_source is the single seam where the transport is decided,
and the four table classes are named as class attributes, so serving
tables from something other than a mapping is four subclasses and a _find.
A Tablebase is safe to share between threads: probes register as readers so
close() can wait for them before unmapping, and table opens are
double-checked under a per-kind lock.
Positions with castling rights are rejected with MissingTableError, as
chess.syzygy and chess.gaviota do for the same input; the tables are built
without them. Positions are assumed legal, as they are on the C++ side.
Includes docs, tests, and seven small table sets (KBK..KRKR) as test data.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
noobpwnftw
force-pushed
the
add-chesstb-tablebases
branch
from
August 16, 2026 16:28
661cc2e to
ae81f3b
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Add
chess.chesstb: pure-Python prober for chesstb endgame tablebasesWhat this adds
A new module,
chess.chesstb, that probes the chesstb endgametablebase format directly from
chess.Boardpositions — in the same spirit asthe existing
chess.syzygyandchess.gaviotamodules.chesstb ships four table types per material:
.lzw.lzdtc.lzdtm.lzdtm50The DTM50 pack carries the unbounded DTM in its flat layer, which makes the
standalone DTM table redundant wherever a pack ships. Both are read, with the
pack preferred: material shipping only
.lzdtmstill answersprobe_dtm.Files are looked up in the
wdl/,dtc/,dtm/anddtm50/subdirectories ofeach search directory, and in the directory itself, so a flat dump of table
files is also probeable.
API
get_wdl/get_dtc/get_dtmare non-raising variants returning a default(
None) when no table is available.probe(board, rule50=0)returns the fullstructured result — every metric at once, off a single walk.
The conversion metric is
probe_dtc, notprobe_dtz. Syzygy bases its cursedband off 100 —
n > 100is a cursed win whose zeroing move isnorn - 100plies away — so a DTZ magnitude carries the WDL class along with the count. A
chesstb DTC is a plain distance in every class, the class being WDL's alone.
Borrowing the
dtzname for familiarity would invite callers to substitute onefor the other.
Why pure Python
chess.syzygyis pure Python; this follows suit. The module depends only onpython-chessand the standard library:lzmawithFORMAT_RAW(theC++ side uses the LZMA SDK with props appended at each block tail).
(~40 lines) supporting the optional LZ4 dictionary. No new dependency.
The position index (symmetry canonicalization, king/pawn slice managers, the
binomial piece-group ranking, the radix-composed board index and the
index-permutation layout) and the probe orchestration (dropped-frame one-ply
minimax reconstruction for shrunk files, the en-passant overlay, and the DTM50
halfmove-clock layer selection) are faithful re-implementations of the C++
src/probelibrary. Square numbering already matches python-chess exactly(a1=0 … h8=63), so boards are consumed directly.
DTC and DTM are byte-for-byte twins on disk — as
src/probe/dtm_file.cppsaysof its own traits — so they share one reader here, with the magic and the value
decode as the whole of what separates them.
Design notes
with one shared LRU holding decoded blocks across every open table against a
single budget (
open_tablebase(..., block_cache_bytes=...))._TableFile._open_sourceis the only place thetransport is decided, and the four file classes are named as class attributes
on
Tablebase, so serving tables from something other than a mapping is foursubclasses and a
_find. Nothing above that seam asks for a span wider thanone block.
close()can wait for thembefore unmapping; table opens are double-checked under a per-kind lock, and
block decoding is guarded per
(color, block)rather than per table.Validation
Every value is validated bit-for-bit against the reference C++ prober
(
tests/probe_fen) by enumerating positions and comparing WDL, DTC, DTM andDTM50 in lockstep:
0 mismatches.
materials (exercising the CONST/SINGLE/DOUBLE/MULTI changepoint state machine,
the draw-end hint, and
recover_mate_at_hmc) — 0 mismatches.and the asymmetric one-ply-minimax derive (109 of 145 materials ship a dropped
frame) — 0 mismatches.
Black) — verified against the oracle.
reference
lz4C library on every shipped WDL table.The standalone DTM reader was validated the same way, over random positions and
short playouts across the seven fixture materials (which reach en-passant
squares, mates, stalemates and every capture/promotion sub-material), against
probe_fenpointed at the same directories — 0 mismatches in each shape thetable can take on disk:
chesstb --builddtmshrinktranscribe --loss-onlywdl/+dtc/Tests
ChesstbTestCaseintest.py, against table sets for seven materials(KBK … KRKR) committed under
data/chesstb/,shrink-processed as they wouldship.
The logic is proven on the C++ side and by the sweeps above, so these tests
target what is specific to this port rather than re-proving the format: the
four-kind wiring and directory search, the shared DTC/DTM reader and its value
decodes, rejection of malformed files (and release of the mapping a failed open
had taken), the changepoint decoder at a live clock, the block-cache budget,
the mmap lifecycle, the transport seam, and probing concurrently from several
threads.