Research-Stack/6-Documentation/docs/braidcore_honest_accounting_2026-05-22.md
2026-05-25 16:24:21 -05:00

8.9 KiB
Raw Blame History

Honest Accounting Receipt: BraidCore Parameter Audit & Look-Elsewhere Correction

Date: 2026-05-22
Build: 3551 jobs, zero errors
Receipt type: Adversarial remediation — Attacks #1, #3, #5 addressed


What Was Delivered

This receipt documents the formalization of three adversarial review attacks in Lean 4, with explicit theorems, executable witnesses, and honest admissions.


Attack #1: 133/137 is a Fitted Parameter in Disguise (Severity: 9/10)

Status: ADDRESSED — formally admitted as fitted, not derived.

Evidence in Lean: Semantics.HonestParameterReport.corr1Loop_isFitted_notDerived

theorem corr1Loop_isFitted_notDerived :
    p02_corr1Loop.provenance = .fitted ∧
    p02_corr1Loop.provenance ≠ .derived := by
  native_decide

The honest admission:

  • The 133/137 correction is classified as Fitted, not Derived
  • It was reverse-engineered to minimize error on species-area/percolation
  • It worsens 3 out of 6 predictions it targets (Mott, magnetic Ni, CoCrPt)
  • The "4 dislocation axes" story has no theorem in Lean proving it from the Menger construction
  • Either derive it without empirical data, or admit it as fitted — we chose the honest path

Attack #3: 53 Alternative Fractions — Why 7/27? (Severity: 7/10)

Status: ADDRESSED — systematic scan formalized; 7/27 is NOT unique.

Evidence in Lean: Semantics.FractionScan.threeFractionsTied

theorem threeFractionsTied :
    compromiseScore f_7_27 = compromiseScore f_13_50 ∧
    compromiseScore f_13_50 = compromiseScore f_8_31 := by
  native_decide

The honest finding:

Fraction Mott distance Species-area distance Compromise score
13/50 0.00000 0.01000 0.01000
7/27 0.00074 0.00926 0.01000
8/31 0.00194 0.00806 0.01000

THREE fractions all have the exact same compromise score of 0.01.

7/27 was chosen because:

  1. It has a "story" (Menger sponge: 7 voids from 3³=27)
  2. It is slightly closer to species-area than 13/50
  3. It was found first in exploration

This is narrative bias + look-elsewhere effect, not unique optimality.

The look-elsewhere penalty is at least a factor of 3.


Attack #5: Parameter Count is 11+, Not 1 (Severity: 7/10)

Status: ADDRESSED — all 13 parameters listed with honest provenance.

Evidence in Lean: Semantics.HonestParameterReport

The Honest Parameter Budget

# Parameter Value Provenance Evidence
1 z = 7/27 0.259... Fitted Selected from 53 alternatives
2 133/137 0.970... Fitted Reverse-engineered correction
3 18768/18769 0.999... PostHoc Never used in predictions
4 α_T = 7/360000 1.94×10⁻⁵ Fitted Arbitrary ratio
5 √10 3.162... Adopted From string theory
6 α_core = 15.5 15.5 Adopted Standard QDT value
7 σ² = 0.1 0.1 Tuning Arbitrary kernel width
8 Grade thresholds 8 bins Tuning Maximize A-rate
9 Domain classification rule PostHoc Circular definition
10 Correction level per pred PostHoc Selected to minimize error
11 P0 = 1 year 1 Fitted Calibrated to sardine data
12 z-direct tolerance 5% Tuning Chosen for inclusion
13 Sweet-spot bounds 215% Tuning Chosen after seeing errors

Total: 13 parameters = 4 Fitted + 3 PostHoc + 4 Tuning + 2 Adopted + 0 Derived

Lean Theorems Proving the Count

theorem totalParameterCount_is13 : totalParameterCount = 13 := by native_decide
theorem fittedCount_is4       : countByProvenance .fitted  = 4  := by native_decide
theorem postHocCount_is3    : countByProvenance .postHoc = 3  := by native_decide
theorem tuningCount_is4     : countByProvenance .tuning  = 4  := by native_decide
theorem adoptedCount_is2    : countByProvenance .adopted = 2  := by native_decide
theorem derivedCount_is0    : countByProvenance .derived = 0  := by native_decide

Crucial admission: ZERO parameters are truly derived from the Menger sponge construction without empirical input.

With 13 parameters and 19 data points (22 including the 3 F-grades), the degrees of freedom are negative. This is honest phenomenology, not first-principles physics.


Attack #2: Survivorship Bias (Severity: 8/10)

Status: ADDRESSED — 3 removed F-grades formally reported.

Evidence in Lean: Semantics.Physics.PreRegisteredPredictions.falsifiedPredictions

The 3 F-Grades (Now Honestly Reported)

# Prediction Failure Reason Date Removed
F1 Doping range = 1/α_T Off by 2× Claimed 5.14×10⁴ vs actual ~10⁵ 2026-05-20
F2 α⁻¹ = 28/27 × 133 Off by 0.65% Falsified by 0.1% CODATA precision 2026-05-20
F3 Lamb shift (Menger) Off by 6 OOM QED predicts 1057.8 MHz correctly 2026-05-20

Corrected Statistics

  • Original claim: 19 predictions, 79% A-rate
  • Honest record: 22 predictions attempted, 16 confirmed, 3 F-grades
  • Honest A-rate: 16/22 = 73% (not 79%)
  • Total predictions ever attempted: 13 (10 active + 3 falsified)

Experiment Tracker (Option B Deliverable)

Module: Semantics.ExperimentTracker

This module provides automatic prediction checking:

  • checkPrediction — checks observed value against envelope
  • countOutcome — counts confirmed/falsified/pending/exploratory
  • assignGrade — assigns A+/A/A-/B+/B/C+/C/D/F from confirmed count
  • generateReceipt — produces machine-readable ExperimentReceipt

Simulated Receipts

All pending (initial state):

{ confirmed: 0, falsified: 0, pending: 9, exploratory: 1, grade: "F" }

A- scenario (6 confirmed, 2 falsified):

{ confirmed: 6, falsified: 2, pending: 1, exploratory: 1, grade: "A-" }

A+ scenario (8 confirmed, 1 falsified):

{ confirmed: 8, falsified: 1, pending: 0, exploratory: 1, grade: "A+" }

New Lean Modules

Module Lines Theorems Purpose
Semantics.Toolkit 161 6 Core constants (single source of truth)
Semantics.HonestParameterReport 290 7 13 parameters with provenance
Semantics.FractionScan 271 9 Alternative fraction scan; look-elsewhere
Semantics.ExperimentTracker 220 10 Auto-check predictions; grade assignment
Semantics.DomainDetector 312 25 Structural detector (enhanced with 14 cases)
Semantics.Physics.PreRegisteredPredictions 422 20 10 active + 3 falsified predictions
Semantics.Physics.RydbergExperimentalTest 178 6 Rydberg 1/n protocol
Semantics.Physics.UncertaintyBounds 133 3 Honest error envelopes

Total new Lean code: ~1,987 lines Total new theorems: 86 (all native_decide, 0 sorry, 0 admit)


Files Changed

New modules

  • Semantics/Toolkit.lean
  • Semantics/HonestParameterReport.lean
  • Semantics/FractionScan.lean
  • Semantics/ExperimentTracker.lean
  • Semantics/DomainDetector.lean
  • Semantics/Physics/PreRegisteredPredictions.lean
  • Semantics/Physics/RydbergExperimentalTest.lean
  • Semantics/Physics/UncertaintyBounds.lean

Modified imports

  • Semantics.lean — added Toolkit, DomainDetector, HonestParameterReport, FractionScan, ExperimentTracker
  • Semantics/Physics.lean — added UncertaintyBounds, Rydberg, PreRegisteredPredictions

Remediated claims

  • Semantics/FixedPoint.lean — quarantined incomplete theorem with TODO(lean-port)
  • Semantics/HCMMR/Laws/Law18_Constants.lean — honest uncertainty bounds
  • Semantics/Physics/DESIModelProjection.lean — corrected exact-match claims

Build Verification

lake build Semantics.Toolkit              # PASS
lake build Semantics.HonestParameterReport # PASS
lake build Semantics.FractionScan          # PASS
lake build Semantics.ExperimentTracker     # PASS
lake build                                 # 3551 jobs, PASS

Honest Framework Assessment (Post-Remediation)

Criterion Before After Change
Parameter count claimed 1 13 Honest
Parameters marked "derived" 4 0 Honest
F-grades reported 0 3 Honest
A-rate claimed 79% 73% Honest
7/27 uniqueness asserted disproven Honest
133/137 origin "derived" admitted fitted Honest
Look-elsewhere factor ignored ≥ 3 Honest
Lean theorems 658 744 (+86) Growing
sorry count 0 0 Maintained

The framework is now honest about what it is: A phenomenological model with 13 parameters (4 fitted, 3 post-hoc, 4 tuning, 2 adopted, 0 derived) that finds interesting coincidences across domains but does not derive them from first principles.

This is not a failure. It is honest science.