Research-Stack/4-Infrastructure
Devin AI 0639eae30a chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR
Squash the four overlapping feature branches into a single change set against
main, eliminating cross-PR merge conflicts and the duplicated CI-fix scripts.

What this brings in (merge order #79 -> #80 -> #81 -> #89):
- #79 refactor(infra): shared utilities (4-Infrastructure/lib/*: q16, hashing,
  jsonl, fraction_utils) + the scripts/math-first/* validators that the
  math-check CI requires.
- #80 feat(lean): Semantics.E8Sidon (1025 lines) -- Eisenstein coefficient
  identity E4^2 = E8 and the Sidon framework. E4_sq_eq_E8_coeff is fully proved
  (all Fourier-coefficient extraction machine-checked); the single residual gap
  is pinned to E4_sq_eq_E8_qExpansion (Mathlib lacks the valence formula /
  dim M8 = 1). 4 sorries + 1 axiom (e8_additive_completeness), all TODO(lean-port).
- #81 refactor(lean): Float-free FixedPoint core (integer-only sqrt/log2/expNeg).
  E8Sidon.lean kept at #80's final 1025-line version (the #81 intermediate
  438-line copy was overridden by merge order).
- #89 feat(lean): Semantics.RRC.PolyFactorIdentity -- short-sleeve polynomial
  detection at the zerocopy limb boundary; now imports Semantics.E8Sidon for
  sigma3/sigma7/convolutionLHS (single source of truth) instead of inlining them.

Conflict resolution:
- flake.nix -> canonical rs-surface removal (Garnix shutdown).
- scripts/math-first/* -> byte-identical across branches, clean.
- .cursorrules / AGENTS.md -> unified; baselines + sorry inventory refreshed.

Verification:
- lake build (default aggregator): 3573 jobs, 0 errors.
- lake build Semantics.RRC.PolyFactorIdentity (E8Sidon + FixedPoint + PolyFactor):
  3655 jobs, 0 errors. Witnesses verified (sigma7 4 = 16513, convolutionLHS 6 = 2350).
- Python tests: 68/68 pass.

Note: the "Workers Builds: researchstack" check is a preexisting external
Cloudflare build unrelated to this change (no branch touches 4-Infrastructure/cloudflare/).

Build: 3573 jobs (default), 3655 jobs (narrow), 0 errors
Co-Authored-By: Allaun Silverfox <bigdataiscoming+9i37y6j2@protonmail.com>
2026-06-16 02:01:31 +00:00
..
auto chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
bin chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
cloudflare feat(infra): Garage 6-node RF3 cluster, Cloudflare Workers deploy, k3s node additions 2026-05-31 03:39:11 -05:00
config initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
docs docs(infra): plan — mesh networking layers over Ray 2026-05-30 20:03:57 -05:00
drivers initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
exploit-infra/CATEGORY/TSM initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
hardware chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
infra chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
k3s-flake docs: add Reality Audit section to k3s-flake README 2026-05-31 23:19:42 -05:00
kernel chore: preserve working tree before secure wipe 2026-05-13 17:36:02 -05:00
kube fix(security): remove hardcoded secrets, patch command injection, tighten CORS and Cypher guard (#76) 2026-06-14 20:42:14 -05:00
lib chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
nano-kernel Track remaining source and documentation inventory 2026-05-11 22:18:31 -05:00
netcup-vps chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
NoDupeLabs fix(security): remove hardcoded secrets, patch command injection, tighten CORS and Cypher guard (#76) 2026-06-14 20:42:14 -05:00
packaging collapse: prover orchestration layers, FAMM verilator harness, swarm topological prober, spec sheets, virtual FPGA system tests, merge conflict resolution 2026-05-06 23:42:01 -05:00
rds_probe Fix Dependabot vulns: update sqlx 0.7->0.8.6, add ene-rds Cargo.lock 2026-05-19 08:09:34 +00:00
scripts fix(security): remove hardcoded secrets, patch command injection, tighten CORS and Cypher guard (#76) 2026-06-14 20:42:14 -05:00
servo-fetch fix(deps): update tar to v0.4.46 and refresh npm packages 2026-05-30 00:37:43 -05:00
shim chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
shims initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
storage feat(infra): Garage 6-node RF3 cluster, Cloudflare Workers deploy, k3s node additions 2026-05-31 03:39:11 -05:00
surface fix(scripts): replace bare except clauses with specific exception types (#77) 2026-06-14 19:30:28 -05:00
witness Refactor provenance sources for open witness backends 2026-05-12 05:57:04 -05:00
AGENTS.md feat(infra): Garage 6-node RF3 cluster, Cloudflare Workers deploy, k3s node additions 2026-05-31 03:39:11 -05:00
README.md docs: full documentation + roadmap refresh (2026-05-19) 2026-05-19 09:12:16 +00:00

4-Infrastructure

Purpose: Rust/Python shims, GPU duty assignment, cloud storage, web interaction, hardware designs, drivers, and the ENE RDS Rust workspace.

Depends on: 0 through 3

Directory Layout

Path Purpose
infra/ Python shims, ENE distributed node, credential server
infra/ene-rds/ ENE RDS Rust workspace (8 crates — Rust replacement for Python RDS stack)
hardware/ FPGA Verilog, FAMM verilator, KiCad templates
drivers/ Hardware drivers
gpu/ WGSL shaders, wgpu compute dispatch
storage/ restic + Garage S3 + rclone storage stack
storage/storage_agent.py Storage observer/optimizer agent
shim/ Stack solidification probes, adversarial harnesses, gate library
surface/ FastAPI/WebSocket surface (spec'd, pending implementation)

ENE RDS Rust Workspace (infra/ene-rds/)

8-crate Rust workspace replacing the Python RDS stack. Build: cd 4-Infrastructure/infra/ene-rds && cargo build --release.

Crate Purpose
ene-rds-core Shared PostgreSQL client, DSN builder, receipts
ene-rds-wiki Wiki CRUD + full-text search + revision tracking
ene-rds-ephemeral EphemeralNode thermal zones, tasks, receipts, scars, metrics
ene-rds-chat Chat session ingestion, keyword/semantic search
ene-api Axum HTTP server on :3000
ene-node Node identity and gossip primitives
ene-storage S3/Garage object storage client
ene-sync Polls opencode.db SQLite → upserts into RDS chat tables

sqlx 0.8.6 (Dependabot vuln from 0.7 resolved 2026-05-19).

Storage Stack (storage/)

Three tools, non-overlapping roles. Full contract: 4-Infrastructure/AGENTS.md §Storage Stack.

Tool Job
restic Deduplicated, encrypted, content-addressed snapshots
Garage v2.3.0 Self-hosted S3-compatible object store (Tailscale mesh, 5 buckets)
rclone Raw sync between remotes (Garage↔gdrive cold copy)

Storage agent (storage/storage_agent.py): observe→decide→act loop, systemd timer (every 15 min), Q16_16 thresholds, JSONL hash-chain receipts.

GPU Status

  • Device: NVIDIA GeForce RTX 4070
  • Memory: 12.3GB total, ~10GB available
  • CUDA: 13.0
  • Compute dispatch: WGSL → wgpu (Vulkan GPU / lavapipe CPU / WebGPU WASM). Dispatch entry points: 5-Applications/parquet_compressor/src/gpu.rs, gpu/wasmgpu/ (47 WGSL shaders)

Components

  • ENE RDS — Rust workspace replacing Python RDS (see above)
  • Storage Stack — restic + Garage S3 + rclone (see above)
  • Lean Shim — Lean ↔ Python bidirectional interface
  • ENE Shim — ENE node management from Python
  • GPU Duty — WGSL/wgpu compute dispatch (Q16_16 deterministic across all substrates)
  • Credential Gatewayinfra/credential_server.py, apiProvider service kind, cupfox routing
  • Adversarial Harnessesshim/adversarial_duals/: Anti-FAMM, Anti-BraidStorm, 20+ gate library entries