Home Developers CVP Evidence Reproduce

CVP reproduce

engineering.measurement.accuracy

Independent re-run pack: fixed input vectors, O3 expected values, oracle version, commands, and the last result summary. This is how a reader moves from “CalculatorX says it passed” to “I can reproduce why it passed.”

Reproduce JSON CVP Manifest O3 table Generator REST checker Calculator

Identity

Calculation version, protocol version, and evidence revision are distinct.

Calculation version
1.0.1
CVP protocol
1.0.0-proposed · proposed
Evidence revision
2026-09-25.o2-o3
Oracle
O3 · mpmath 1.4.1 · 80 dps
Generator
measurement-accuracy-mpmath-o3 · seed 20260925.measurement-accuracy-o3
Table SHA-256
c1b8d10220e320e37a33829a7b05b2eff31935a0ef996f7a648bcdbc0e0353ee

Numerical claim

O3 PASS is a tabulated-vector claim, not a whole-domain proof.

O2: signed bias vs a separate-module sample identity (≤2 ULP). Not Type A u_A and not a single-shot error. ≤2 ULP vs O3 applies only to the published tabulated bias vectors. Not Type A uncertainty.

  • Last O3 run 8 / 8
  • Max error observed 2 ULP
  • Threshold ≤ 2 ULP

Commands

Regenerate the table from the public generator. Independent REST check needs only this page's reproduce.json plus stdlib Python — no repo clone and no mpmath. The CVP runner remains a maintainer command.

Regenerate O3 table
python3 generate-measurement-accuracy-o3.py after downloading the public generator next to the table
Repo maintainer path
python3 scripts/lib/cvp/oracles/generate-measurement-accuracy-o3.py
Independent REST check
Compare POST /api/v1/calc/accuracy against /developers/cvp/reproduce/measurement-accuracy-o3-tables.json after downloading check-math-o3-rest.py next to measurement-accuracy-o3-tables.json (or pass --reproduce reproduce.json)
Re-run CVP
npm run cvp:run -- --capability engineering.measurement.accuracy
REST check
POST https://www.calculatorx.com/api/v1/calc/accuracy with a tabulated input from the table below

Re-running the generator without changing seed or inputs should reproduce table SHA-256 c1b8d10220e320e37a33829a7b05b2eff31935a0ef996f7a648bcdbc0e0353ee. Compare each expected_f64 to the production result within the declared ULP threshold.

Tabulated vectors

Every O3 vector used for the ≤2 ULP claim. Expected values come from the published mpmath table, not from the implementation under test.

IDKindInputsExpected (f64)ActualULPStatus
o3-lowlow{"values":[6,7,8],"xm":8}{"oracle_layer":"analytic","bias":-1,"abs_bias":1,"xbar":7,"s":1,"xm":8,"n":3,"ddof":1}{"bias":-1,"abs_bias":1,"xbar":7,"s":1,"xm":8,"n":3,"ddof":1,"values":[6,7,8]}0PASS
o3-zerozero{"values":[7,8,9],"xm":8}{"oracle_layer":"analytic","bias":0,"abs_bias":0,"xbar":8,"s":1,"xm":8,"n":3,"ddof":1}{"bias":0,"abs_bias":0,"xbar":8,"s":1,"xm":8,"n":3,"ddof":1,"values":[7,8,9]}0PASS
o3-highhigh{"values":[8,9,10],"xm":8}{"oracle_layer":"analytic","bias":1,"abs_bias":1,"xbar":9,"s":1,"xm":8,"n":3,"ddof":1}{"bias":1,"abs_bias":1,"xbar":9,"s":1,"xm":8,"n":3,"ddof":1,"values":[8,9,10]}0PASS
o3-aliasalias{"sample":"6,7,8","X":8}{"oracle_layer":"analytic","bias":-1,"abs_bias":1,"xbar":7,"s":1,"xm":8,"n":3,"ddof":1}{"bias":-1,"abs_bias":1,"xbar":7,"s":1,"xm":8,"n":3,"ddof":1,"values":[6,7,8]}0PASS
o3-flatflat{"values":[8,8,8],"xm":8}{"oracle_layer":"analytic","bias":0,"abs_bias":0,"xbar":8,"s":0,"xm":8,"n":3,"ddof":1}{"bias":0,"abs_bias":0,"xbar":8,"s":0,"xm":8,"n":3,"ddof":1,"values":[8,8,8]}0PASS
o3-ddof0ddof0{"values":[6,7,8],"xm":8,"ddof":0}{"oracle_layer":"analytic","bias":-1,"abs_bias":1,"xbar":7,"s":0.816496580927726,"xm":8,"n":3,"ddof":0}{"bias":-1,"abs_bias":1,"xbar":7,"s":0.816496580927726,"xm":8,"n":3,"ddof":0,"values":[6,7,8]}0PASS
o3-awkwardawkward{"values":["0.9","1.15","1.4"],"xm":"1.4"}{"oracle_layer":"analytic","bias":-0.25,"abs_bias":0.25,"xbar":1.15,"s":0.25,"xm":1.4,"n":3,"ddof":1}{"bias":-0.25,"abs_bias":0.25,"xbar":1.15,"s":0.24999999999999994,"xm":1.4,"n":3,"ddof":1,"values":[0.9,1.15,1.4]}2PASS
o3-widewide{"values":[2,6,10],"xm":4}{"oracle_layer":"analytic","bias":2,"abs_bias":2,"xbar":6,"s":4,"xm":4,"n":3,"ddof":1}{"bias":2,"abs_bias":2,"xbar":6,"s":4,"xm":4,"n":3,"ddof":1,"values":[2,6,10]}0PASS