B3 Reproduction machinery (tracking) #57

Take published results and try to get them back. The verdict vocabulary is fixed in advance so that a result cannot be softened later by choosing gentler words.

This is the tracking issue for the milestone. Every box below is one issue and one pull request. Boxes get ticked when the pull request is merged and CI is green on main, not when the branch looks finished.

Checklist

• The reproduce command and the verdict vocabulary #22 The reproduce command and the verdict vocabulary
• Reproduce the ALP result within 2% #23 Reproduce the ALP result within 2%
• Reproduce the headline compression figures on linux-x86_64 #24 Reproduce the headline compression figures on linux-x86_64
• Reproduce the same figures on linux-aarch64 #25 Reproduce the same figures on linux-aarch64
• Record unavailable artifacts as NOT-ATTEMPTABLE with citations #26 Record unavailable artifacts as NOT-ATTEMPTABLE with citations
• Generate the claim ledger rather than maintaining it #27 Generate the claim ledger rather than maintaining it
• Record the AVX-512 comparisons as NOT-ATTEMPTABLE #28 Record the AVX-512 comparisons as NOT-ATTEMPTABLE

Exit

The milestone is done when every box above is ticked and a v0.x.0 tag has been cut for it. Progress comments go on this issue as pull requests land, so the history of the milestone is readable from one page.