Pranav Bhave

Evidence and its limits

What checks and receipts establish

A passing check establishes only the property it actually tests. Read the check's scope before using its result.

What a passing check can establish

A render receipt binds named input files to output bytes and records sampled determinism, text-overflow checks, and the rendering environment. Hashes help identify the saved versions. Reproduction can establish that stated inputs produce stated outputs. Contract checks can establish internal consistency among declared choices.

Each result is conditional on the implementation and coverage of its check. The conformance record names coverage and blind spots. The correction record preserves what required revision.

What it does not establish

A receipt does not establish that an input claim is true, the measurement design is valid, execution followed every scientific requirement, or an inference is warranted. Reproducing arithmetic can reproduce an error. A digest also depends on parsing and canonicalization: different original bytes may map to one canonical representation.

Verifier acceptance does not establish the safety, authorization, or correctness of a governed action. Those require evidence and checks directed at those questions.

Four limits to carry with the films

  1. Constructed examples. Illustrated items and arrangements show possible outcomes under stated assumptions. They measure no deployed system and do not certify safety. An independence point is an assumption's selection, not recovered dependence.
  2. Released-file reanalysis. Counts describe the selected released subset and its stated configuration. They do not become population rates, vendor rankings, causal contributions, or evidence about unreleased prompts. A static OR needs common full exposure, parallel evaluation, and fixed thresholds before it can represent a stack.
  3. Reporting census. A missing field is a reporting observation within a bounded examined set. It establishes neither poor performance nor universal absence. Sensitivities remain labeled alternatives to the corrected counts.
  4. Receipts and automated checks. Provenance and consistency are conditional on the pipeline. A verified seal or successful replay does not establish truth, scientific validity, safety, authorization, or correctness beyond the property checked.

Every watch page states its own concise limits, correction condition, sources, and full original manifest wording. Those film-specific boundaries still apply.