Cross-driver conformance summary — 99.5% across 7,186 tests on one page
Summary: Cross-driver conformance summary — 99.5% across 7,186 tests on one page (v0.5.1b4).
Until this release, comparing SecantusDB's conformance across the five driver gauges (pymongo / mongo-java-driver / mongo-go-driver / mongo-node-driver / mongo-ruby-driver) required opening five different reports and squinting at five different per-category breakdowns whose denominators came from incompatible units of count — JUnit <testcase> versus Mocha test versus RSpec example versus go test event versus pytest item. Each report's pass-rate column was technically accurate but not directly comparable to the others.
v0.5.1b4 ships docs/validation-summary.md — a single table that normalises on test count, one row per gauge, the same five columns across the board: tests run, passed, failed, skipped, pass rate. A new validation_summary Python module reads each gauge's raw artifact under .validation/ directly and renders the table; a new invoke validate-summary task refreshes it. Each per-gauge detailed report stays as it was; the summary links out to them.
Current numbers: 7,186 tests, 6,232 passed, 33 failed, 921 skipped — 99.5% pass rate across all five drivers. Java is biggest by raw count (4,710 tests, 4,242 passed); Node smallest (364). The version-bump skips b3 because v0.5.1b3 made it to PyPI but its RTD docs build failed on a missing toctree entry for the new summary file — b4 fixes the toctree and is the first release where the docs match what's on PyPI.
This release also rolls up two driver-gauge fixes from the Ruby/Java side that landed since v0.5.1b1: a Java widening that took the gauge from 18 of 112 driver-sync functional classes to 21 of 112 (~19% coverage, +34 passes) by adding the ChangeStreamsTest, UnifiedWriteConcernTest, and VersionedApiTest unified spec runners, and a snapshot-read-concern rejection that turned three SessionsTest snapshot-error scenarios from "expected error, got success" into "expected error, got SnapshotUnavailable (code 246)" — the correct mongod-on-standalone shape.