BenchmarkBEN-2026-0001v0.1
PACC micro-lab protocol v0.1 (frozen gates)
The preregistered decision rule reused unchanged from v0.1 to v0.13: E0 purity, held-out representation distance D_R = E[JS(Φ(S_N), S_P)] ≤ 0.05, update commutation D_U ≤ 0.05, off-manifold intervention D_I ≤ 0.08, action agreement ≥ 0.85, a shuffled-target negative control the real map must beat, a design-independence rule (agreement ≥ 0.999 and R² ≥ 0.995 collapse two designs into one family), verdict levels 0–3, and a strong PACC-A gate of at least three independent convergent families.
Purpose
purpose- Make 'similar' and 'probability-like' non-negotiable after the data are seen.
Tasks
tasks- Sequential evidence integration over 4 hidden hypotheses × 6 binary prototypes (uniform reliability 0.80; heterogeneous 0.60–0.95 with only ordinal strengths 1–3 given to non-probabilistic systems; adversarial geometry from v0.2).
- Learned source reliability without an oracle (v0.3).
- Correlated source clusters with latent shared inversion, q swept 0.06–0.42 (v0.4–v0.13).
- Dynamic-world regime switches (E4, descriptive only).
Metrics
metrics- action agreement
- held-out JS D_R
- update-commutation JS D_U
- intervention JS D_I
- shuffled/constant/broken-composition control JS
- cross-family R²
- basin coverage, transition JS, cocycle path JS, reverse fidelity
Evaluation protocol
evaluation_protocol- Mapper fit on training episodes/worlds only; every gate frozen before the run; secondary multi-seed stresses are labelled post-hoc and never modify the primary decision rule.
Baselines
baseline_models- Exact Bayesian posterior
- Beta-Bernoulli source-quality reference
- joint-likelihood common-cause reference
- Bayesian HMM (dynamic world)
What it does not measure
limitations- Does not measure LLM equivalence, resource efficiency, hidden-cluster learning, or whether probability is an observer projection; E4 dynamic-world numbers make no superiority claim.
- Synthetic data and theoretical reasoning throughout: theoretically possible is not actually possible.
Relations
| Source | Relation | Target | Status | ID |
|---|---|---|---|---|
BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | evaluates | THY-2026-0005 PACC conjecture — the four-level convergence ladder | ACTIVE | REL-2026-0088 |
EXP-2026-0008 PACC-Lab v0.1 — E0–E4: first micro-witness | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0157 |
EXP-2026-0009 PACC-Lab v0.2 — third family (N3) and adversarial evidence geometry | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0170 |
EXP-2026-0010 PACC-Lab v0.3 — learned source reliability without an oracle | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0183 |
EXP-2026-0011 PACC-Lab v0.4 — correlated sources and dependence geometry | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0194 |
EXP-2026-0012 PACC-Lab v0.5 — does a richer relation state rescue the latent coordinate? | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0207 |
EXP-2026-0013 PACC-Lab v0.6 — hierarchical composed coordinate | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0218 |
EXP-2026-0014 PACC-Lab v0.7 — cross-geometry coordinate transfer without refitting | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0231 |
EXP-2026-0015 PACC-Lab v0.8 — frozen-coordinate transfer basins over a correlation sweep | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0242 |
EXP-2026-0016 PACC-Lab v0.9 — a three-anchor probability-coordinate atlas | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0255 |
EXP-2026-0017 PACC-Lab v0.10 — oriented cocycle coherence on frozen triple overlap | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0266 |
EXP-2026-0018 PACC-Lab v0.11 — bidirectional cocycle and inverse consistency | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0279 |
EXP-2026-0019 PACC-Lab v0.12 — bounded quadratic transition | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0292 |
EXP-2026-0020 PACC-Lab v0.13 — reverse residual field / base-point dependence | uses_benchmark | BEN-2026-0001 PACC micro-lab protocol v0.1 (frozen gates) | ACTIVE | REL-2026-0303 |
History and provenance
- Canonical URL
- https://evemisslab.com/ai/benchmarks/BEN-2026-0001/
- Machine-readable
/ai/benchmarks/BEN-2026-0001/index.json- Snapshot
AI-SNAPSHOT-v0.1-fe85b9694a45- Provenance
source- EveMissLab research collection: Adaptive Epistemic Systems (真本體論13)
extracted_by- Splice (Claude Code), reading the canonical UTF-8 sources and each lab's own result reports
extracted_at- 2026-09-11
generator- tools/extract_aes/extract.py
claim_boundary- status, evidence level and result type follow the source artifact's own stated claim boundary; nothing is upgraded beyond what the report supports