Research-Stack/5-Applications/tools-scripts/utils/check_passive_monitor_integrity.py
Devin AI 0c9efac330 chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR
Squash the four overlapping feature branches into a single change set against
main, eliminating cross-PR merge conflicts and the duplicated CI-fix scripts.

What this brings in (merge order #79 -> #80 -> #81 -> #89):
- #79 refactor(infra): shared utilities (4-Infrastructure/lib/*: q16, hashing,
  jsonl, fraction_utils) + the scripts/math-first/* validators that the
  math-check CI requires.
- #80 feat(lean): Semantics.E8Sidon (1025 lines) -- Eisenstein coefficient
  identity E4^2 = E8 and the Sidon framework. E4_sq_eq_E8_coeff is fully proved
  (all Fourier-coefficient extraction machine-checked); the single residual gap
  is pinned to E4_sq_eq_E8_qExpansion (Mathlib lacks the valence formula /
  dim M8 = 1). 4 sorries + 1 axiom (e8_additive_completeness), all TODO(lean-port).
- #81 refactor(lean): Float-free FixedPoint core (integer-only sqrt/log2/expNeg).
  E8Sidon.lean kept at #80's final 1025-line version (the #81 intermediate
  438-line copy was overridden by merge order).
- #89 feat(lean): Semantics.RRC.PolyFactorIdentity -- short-sleeve polynomial
  detection at the zerocopy limb boundary; now imports Semantics.E8Sidon for
  sigma3/sigma7/convolutionLHS (single source of truth) instead of inlining them.

Conflict resolution:
- flake.nix -> canonical rs-surface removal (Garnix shutdown).
- scripts/math-first/* -> byte-identical across branches, clean.
- .cursorrules / AGENTS.md -> unified; baselines + sorry inventory refreshed.

Verification:
- lake build (default aggregator): 3573 jobs, 0 errors.
- lake build Semantics.RRC.PolyFactorIdentity (E8Sidon + FixedPoint + PolyFactor):
  3655 jobs, 0 errors. Witnesses verified (sigma7 4 = 16513, convolutionLHS 6 = 2350).
- Python tests: 68/68 pass.

Note: the "Workers Builds: researchstack" check is a preexisting external
Cloudflare build unrelated to this change (no branch touches 4-Infrastructure/cloudflare/).

Build: 3573 jobs (default), 3655 jobs (narrow), 0 errors
Co-Authored-By: Allaun Silverfox <bigdataiscoming+9i37y6j2@protonmail.com>
2026-06-16 02:01:31 +00:00

88 lines
3.3 KiB
Python

#!/usr/bin/env python3
# ==============================================================================
# COPYRIGHT NO ONE EVERYWHERE LLC (WYOMING HOLDING COMPANY)
# PROJECT: SOVEREIGN STACK
# This artifact is entirely proprietary and cryptographically proven.
# Open-Source usage requires explicit permission from Brandon Scott Schneider.
# ==============================================================================
import argparse
import json
from datetime import datetime, timedelta, timezone
from pathlib import Path
from typing import Any, Dict, List
from jsonschema import validate
import sys
sys.path.insert(0, str(Path(__file__).resolve().parents[3] / "4-Infrastructure"))
from lib.jsonl import load_jsonl
PROJECT_ROOT = Path(__file__).resolve().parent.parent
CHAIN_SCHEMA = PROJECT_ROOT / "schemas" / "passive_chain_record.schema.json"
def parse_iso(ts: str) -> datetime:
return datetime.fromisoformat(ts.replace("Z", "+00:00"))
def parse_args() -> argparse.Namespace:
parser = argparse.ArgumentParser(description="Daily integrity check for passive all-market monitor records.")
parser.add_argument("--records", required=True, help="Path to chain_records.jsonl")
parser.add_argument("--target-chain", action="append", dest="target_chains", required=True, help="Expected chain. Repeatable.")
parser.add_argument("--max-age-minutes", type=int, default=1440, help="Maximum record staleness in minutes.")
parser.add_argument("--out", help="Optional output JSON report path")
return parser.parse_args()
def main() -> int:
args = parse_args()
schema = json.loads(CHAIN_SCHEMA.read_text(encoding="utf-8"))
rows = load_jsonl(Path(args.records))
for row in rows:
validate(instance=row, schema=schema)
now = datetime.now(timezone.utc)
max_age = timedelta(minutes=args.max_age_minutes)
targets = {c.strip().lower() for c in args.target_chains if c.strip()}
latest_by_chain: Dict[str, datetime] = {}
for row in rows:
chain = str(row["chain"]).strip().lower()
ts = parse_iso(str(row["timestamp_utc"]))
if chain not in latest_by_chain or ts > latest_by_chain[chain]:
latest_by_chain[chain] = ts
missing = sorted(list(targets - set(latest_by_chain.keys())))
stale = sorted(
[chain for chain, ts in latest_by_chain.items() if now - ts > max_age]
)
coverage_ratio = (len(set(latest_by_chain.keys()) & targets) / len(targets)) if targets else 0
freshness_ratio = (
(len(targets) - len(stale) - len(missing)) / len(targets)
if targets
else 0
)
report: Dict[str, Any] = {
"ok": len(missing) == 0 and len(stale) == 0,
"target_chain_count": len(targets),
"observed_chain_count": len(set(latest_by_chain.keys()) & targets),
"coverage_ratio": round(coverage_ratio, 6),
"freshness_ratio": round(freshness_ratio, 6),
"missing_chains": missing,
"stale_chains": stale,
"max_age_minutes": args.max_age_minutes,
}
if args.out:
out_path = Path(args.out)
out_path.parent.mkdir(parents=True, exist_ok=True)
out_path.write_text(json.dumps(report, indent=2) + "\n", encoding="utf-8")
print(json.dumps(report, indent=2))
return 0 if report["ok"] else 2
if __name__ == "__main__":
raise SystemExit(main())