allaun/Research-Stack
1
0
Fork 0
mirror of https://github.com/allaunthefox/Research-Stack.git synced 2026-07-31 03:05:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
Research-Stack/4-Infrastructure
History
Brandon Schneider 2d30156e7a Rust ene-session-sync: complete rewrite with Python adaptation layer 
Major expansion of the ene-session-sync Rust service with 9 new modules
(~9.8k lines) that mirror the existing Python infrastructure:

New Rust modules:
- compression.rs: Delta GCL compression service (ports delta_gcl_compression_service.py)
- credential.rs: Credential provider + minimal HTTP credential server
- ene_core.rs: Core ENE data structures and operations
- fractal_fold.rs: Fractal folding algorithms and data structures
- math.rs: Mathematical utilities and Q16_16 fixed-point arithmetic
- misc.rs: Miscellaneous utilities and helpers
- s3c.rs: S3-compatible storage client abstraction
- swarm.rs: Swarm API client and orchestration
- topology.rs: Topology management and 5D torus operations
- wiki.rs: Wiki/TiddlyWiki ingestion and processing

Cargo.toml:
- Add crypto deps: aes-gcm, sha2, hex, base64
- Keep existing deps: anyhow, chrono, clap, reqwest, rusqlite, serde, tokio, etc.

Lean proof quarantine:
- Replace detailed proofs with sorry + TODO(lean-port) placeholders in:
  * FiveDTorusTopology.lean (torusDistanceSymmetric, torusDiameterFormula)
  * PISTMachine.lean (mirror_preserves_mass, zero_mass_iff_square)
  * TorsionalPIST.lean (torsionPreservesMass)
  * SubagentOrchestrator.lean (subagentInvariantPreservation)
- Simplify UnifiedCompression.lean proof structure
- Add TODO comments for future Lean proof completion

This creates a complete Rust foundation that can operate independently
while the Lean proofs are completed incrementally.

Generated with [Devin](https://cli.devin.ai/docs)

Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-05-19 13:53:19 +00:00
..
bin initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
config initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
drivers initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
exploit-infra/CATEGORY/TSM initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
gpu initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
hardware Track remaining source and documentation inventory 2026-05-11 22:18:31 -05:00
infra Rust ene-session-sync: complete rewrite with Python adaptation layer 2026-05-19 13:53:19 +00:00
k3s-flake Expand devcontainer with full Python stack, add MCP servers (Notion/AWS), strengthen Lean theorems 2026-05-19 01:52:14 -05:00
kernel chore: preserve working tree before secure wipe 2026-05-13 17:36:02 -05:00
nano-kernel Track remaining source and documentation inventory 2026-05-11 22:18:31 -05:00
NoDupeLabs Scrub tracked API key material 2026-05-11 22:25:43 -05:00
packaging collapse: prover orchestration layers, FAMM verilator harness, swarm topological prober, spec sheets, virtual FPGA system tests, merge conflict resolution 2026-05-06 23:42:01 -05:00
rds_probe Fix Dependabot vulns: update sqlx 0.7->0.8.6, add ene-rds Cargo.lock 2026-05-19 08:09:34 +00:00
servo-fetch Remediate dependency alert residue 2026-05-11 23:26:12 -05:00
shim Expand devcontainer with full Python stack, add MCP servers (Notion/AWS), strengthen Lean theorems 2026-05-19 01:52:14 -05:00
shims initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
storage Expand devcontainer with full Python stack, add MCP servers (Notion/AWS), strengthen Lean theorems 2026-05-19 01:52:14 -05:00
surface initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
witness Refactor provenance sources for open witness backends 2026-05-12 05:57:04 -05:00
AGENTS.md Expand devcontainer with full Python stack, add MCP servers (Notion/AWS), strengthen Lean theorems 2026-05-19 01:52:14 -05:00
README.md docs: full documentation + roadmap refresh (2026-05-19) 2026-05-19 09:12:16 +00:00

README.md

4-Infrastructure

Purpose: Rust/Python shims, GPU duty assignment, cloud storage, web interaction, hardware designs, drivers, and the ENE RDS Rust workspace.

Depends on: 0 through 3

Directory Layout

Path Purpose
infra/ Python shims, ENE distributed node, credential server
infra/ene-rds/ ENE RDS Rust workspace (8 crates — Rust replacement for Python RDS stack)
hardware/ FPGA Verilog, FAMM verilator, KiCad templates
drivers/ Hardware drivers
gpu/ WGSL shaders, wgpu compute dispatch
storage/ restic + Garage S3 + rclone storage stack
storage/storage_agent.py Storage observer/optimizer agent
shim/ Stack solidification probes, adversarial harnesses, gate library
surface/ FastAPI/WebSocket surface (spec'd, pending implementation)

ENE RDS Rust Workspace (infra/ene-rds/)

8-crate Rust workspace replacing the Python RDS stack. Build: cd 4-Infrastructure/infra/ene-rds && cargo build --release.

Crate Purpose
ene-rds-core Shared PostgreSQL client, DSN builder, receipts
ene-rds-wiki Wiki CRUD + full-text search + revision tracking
ene-rds-ephemeral EphemeralNode thermal zones, tasks, receipts, scars, metrics
ene-rds-chat Chat session ingestion, keyword/semantic search
ene-api Axum HTTP server on :3000
ene-node Node identity and gossip primitives
ene-storage S3/Garage object storage client
ene-sync Polls opencode.db SQLite → upserts into RDS chat tables

sqlx 0.8.6 (Dependabot vuln from 0.7 resolved 2026-05-19).

Storage Stack (storage/)

Three tools, non-overlapping roles. Full contract: 4-Infrastructure/AGENTS.md §Storage Stack.

Tool Job
restic Deduplicated, encrypted, content-addressed snapshots
Garage v2.3.0 Self-hosted S3-compatible object store (Tailscale mesh, 5 buckets)
rclone Raw sync between remotes (Garage↔gdrive cold copy)

Storage agent (storage/storage_agent.py): observe→decide→act loop, systemd timer (every 15 min), Q16_16 thresholds, JSONL hash-chain receipts.

GPU Status

  • Device: NVIDIA GeForce RTX 4070
  • Memory: 12.3GB total, ~10GB available
  • CUDA: 13.0
  • Compute dispatch: WGSL → wgpu (Vulkan GPU / lavapipe CPU / WebGPU WASM). Dispatch entry points: 5-Applications/parquet_compressor/src/gpu.rs, gpu/wasmgpu/ (47 WGSL shaders)

Components

  • ENE RDS — Rust workspace replacing Python RDS (see above)
  • Storage Stack — restic + Garage S3 + rclone (see above)
  • Lean Shim — Lean ↔ Python bidirectional interface
  • ENE Shim — ENE node management from Python
  • GPU Duty — WGSL/wgpu compute dispatch (Q16_16 deterministic across all substrates)
  • Credential Gateway — infra/credential_server.py, apiProvider service kind, cupfox routing
  • Adversarial Harnesses — shim/adversarial_duals/: Anti-FAMM, Anti-BraidStorm, 20+ gate library entries