Research-Stack/4-Infrastructure/README.md
Brandon Schneider 4d715908fd docs: full documentation + roadmap refresh (2026-05-19)
- CHANGELOG: add 2026-05-09 through 2026-05-19 entry covering Lean
  hardening, storage stack, 20+ new gates, physics RG suite
- ROADMAP: update layer model (746 modules, 3529 jobs, 0 errors);
  mark eigensolid_convergence proven; add section 12 (Infrastructure
  & Data Layer) covering ENE RDS, Garage S3, storage agent, devcontainer
- TODO_MAP: add B11 (eigensolid convergence, DONE), Phase I (infra),
  Phase J (adversarial gates); rename old Phase I to Phase K
- README: update Lean module/build counts; add Infrastructure table
- ARCHITECTURE: update L0 row; add repository structure rows for
  ene-rds, storage, devcontainer; add sections 11-13 (Storage &
  Persistence Layer, ENE RDS Workspace, Braid Eigensolid Compressor)
- CONCEPTS: add Braid Eigensolid Compressor, Constrained Agent
  Framework, and Garage S3 Storage Stack concept entries
- 4-Infrastructure/README: rewrite to reflect ENE RDS Rust workspace,
  restic/Garage/rclone storage stack, storage agent, GPU dispatch,
  adversarial harnesses

Generated with [Devin](https://cli.devin.ai/docs)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-05-19 09:12:16 +00:00

3 KiB

4-Infrastructure

Purpose: Rust/Python shims, GPU duty assignment, cloud storage, web interaction, hardware designs, drivers, and the ENE RDS Rust workspace.

Depends on: 0 through 3

Directory Layout

Path Purpose
infra/ Python shims, ENE distributed node, credential server
infra/ene-rds/ ENE RDS Rust workspace (8 crates — Rust replacement for Python RDS stack)
hardware/ FPGA Verilog, FAMM verilator, KiCad templates
drivers/ Hardware drivers
gpu/ WGSL shaders, wgpu compute dispatch
storage/ restic + Garage S3 + rclone storage stack
storage/storage_agent.py Storage observer/optimizer agent
shim/ Stack solidification probes, adversarial harnesses, gate library
surface/ FastAPI/WebSocket surface (spec'd, pending implementation)

ENE RDS Rust Workspace (infra/ene-rds/)

8-crate Rust workspace replacing the Python RDS stack. Build: cd 4-Infrastructure/infra/ene-rds && cargo build --release.

Crate Purpose
ene-rds-core Shared PostgreSQL client, DSN builder, receipts
ene-rds-wiki Wiki CRUD + full-text search + revision tracking
ene-rds-ephemeral EphemeralNode thermal zones, tasks, receipts, scars, metrics
ene-rds-chat Chat session ingestion, keyword/semantic search
ene-api Axum HTTP server on :3000
ene-node Node identity and gossip primitives
ene-storage S3/Garage object storage client
ene-sync Polls opencode.db SQLite → upserts into RDS chat tables

sqlx 0.8.6 (Dependabot vuln from 0.7 resolved 2026-05-19).

Storage Stack (storage/)

Three tools, non-overlapping roles. Full contract: 4-Infrastructure/AGENTS.md §Storage Stack.

Tool Job
restic Deduplicated, encrypted, content-addressed snapshots
Garage v2.3.0 Self-hosted S3-compatible object store (Tailscale mesh, 5 buckets)
rclone Raw sync between remotes (Garage↔gdrive cold copy)

Storage agent (storage/storage_agent.py): observe→decide→act loop, systemd timer (every 15 min), Q16_16 thresholds, JSONL hash-chain receipts.

GPU Status

  • Device: NVIDIA GeForce RTX 4070
  • Memory: 12.3GB total, ~10GB available
  • CUDA: 13.0
  • Compute dispatch: WGSL → wgpu (Vulkan GPU / lavapipe CPU / WebGPU WASM). Dispatch entry points: 5-Applications/parquet_compressor/src/gpu.rs, gpu/wasmgpu/ (47 WGSL shaders)

Components

  • ENE RDS — Rust workspace replacing Python RDS (see above)
  • Storage Stack — restic + Garage S3 + rclone (see above)
  • Lean Shim — Lean ↔ Python bidirectional interface
  • ENE Shim — ENE node management from Python
  • GPU Duty — WGSL/wgpu compute dispatch (Q16_16 deterministic across all substrates)
  • Credential Gatewayinfra/credential_server.py, apiProvider service kind, cupfox routing
  • Adversarial Harnessesshim/adversarial_duals/: Anti-FAMM, Anti-BraidStorm, 20+ gate library entries