Skip to content
VERASPEC
Repository
Reference setsstable

Reproducing this directory

The generator is `scripts/make_refset_manifests.py`. The committed bytes are the reference set; the generator is subordinate to them.

bash
# verify images, content/pixel digests and the set_manifest_sha256 values above.
# Torch-free. This is the stronger of the two torch-free checks: it *regenerates*
# the images and byte-compares, which the CI suite does not do.
PYTHONPATH=services/verd/src .venv/bin/python scripts/make_refset_manifests.py --check
# ... and recompute all thirty vector digests too. Needs torch, transformers and
# the three checkpoints; MODEL_DEVICE=cpu, HF_HOME pointing at a warm cache.
MODEL_DEVICE=cpu PYTHONPATH=services/verd/src python scripts/make_refset_manifests.py --check --vectors
# every digest here except the vectors, recomputed from the committed bytes.
# This is what the standards CI tier runs; it installs no torch, so the three
# vector cases skip.
PYTHONPATH=services/verd/src:packages/ver-validator/src \
.venv/bin/python -m pytest tests/test_record_refset_manifests.py -q

A --check failure is never repaired by regenerating this directory in place. Implementations will by then have been evaluated against the published digests, and moving them quietly retracts a conformance claim without saying so: corrections ship as standards/reference-sets/ version 2, with reference_set_version incremented and both versions served.