allaun/Research-Stack
1
0
Fork 0
mirror of https://github.com/allaunthefox/Research-Stack.git synced 2026-07-31 03:05:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
Research-Stack/4-Infrastructure
History
allaun d28e9de6ca fix(infra): optimize drive compression memory usage and download skip 
Check file sizes before loading bytes into memory and stream large files
directly into the tarball to prevent OOM errors on Steam Deck. Skip downloading
files that already exist locally.

Build: 0 errors (py_compile)
2026-06-22 01:11:17 -05:00
..
auto chore(repo): push local 768-commit branch state onto clean remote baseline 2026-06-15 22:46:50 -05:00
bin chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
cloudflare feat(infra): Garage 6-node RF3 cluster, Cloudflare Workers deploy, k3s node additions 2026-05-31 03:39:11 -05:00
config initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
docs chore(repo): push local 768-commit branch state onto clean remote baseline 2026-06-15 22:46:50 -05:00
drivers initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
exploit-infra/CATEGORY/TSM initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
hardware chore(repo): push local 768-commit branch state onto clean remote baseline 2026-06-15 22:46:50 -05:00
infra fix(infra): wrap lean-lsp-mcp to correct severity schema for Moonshot API 2026-06-22 01:11:12 -05:00
k3s-flake chore(repo): push local 768-commit branch state onto clean remote baseline 2026-06-15 22:46:50 -05:00
kernel chore: preserve working tree before secure wipe 2026-05-13 17:36:02 -05:00
kube chore(repo): push local 768-commit branch state onto clean remote baseline 2026-06-15 22:46:50 -05:00
lib chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
nano-kernel Track remaining source and documentation inventory 2026-05-11 22:18:31 -05:00
netcup-vps chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
NoDupeLabs feat(lean): close gaussian_line_integral_unit_dir + consolidate infrastructure 2026-06-18 16:53:23 -05:00
packaging collapse: prover orchestration layers, FAMM verilator harness, swarm topological prober, spec sheets, virtual FPGA system tests, merge conflict resolution 2026-05-06 23:42:01 -05:00
rds_probe fix(deps): audit-driven updates across npm, pnpm, cargo, pip 2026-06-20 19:00:38 -05:00
scripts fix(security): remove hardcoded secrets, patch command injection, tighten CORS and Cypher guard (#76) 2026-06-14 20:42:14 -05:00
servo-fetch fix(deps): audit-driven updates across npm, pnpm, cargo, pip 2026-06-20 19:00:38 -05:00
shim fix(infra): optimize drive compression memory usage and download skip 2026-06-22 01:11:17 -05:00
shims initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
storage fix(infra): point default RDS host to neon server Tailscale IP 2026-06-18 23:28:46 -05:00
surface/static chore(repo): push local 768-commit branch state onto clean remote baseline 2026-06-15 22:46:50 -05:00
witness Refactor provenance sources for open witness backends 2026-05-12 05:57:04 -05:00
workers/s2-proxy feat(infra): Semantic Scholar Cloudflare worker proxy 2026-06-21 01:04:19 -05:00
AGENTS.md fix(infra): optimize drive compression memory usage and download skip 2026-06-22 01:11:17 -05:00
README.md docs: full documentation + roadmap refresh (2026-05-19) 2026-05-19 09:12:16 +00:00

README.md

4-Infrastructure

Purpose: Rust/Python shims, GPU duty assignment, cloud storage, web interaction, hardware designs, drivers, and the ENE RDS Rust workspace.

Depends on: 0 through 3

Directory Layout

Path Purpose
infra/ Python shims, ENE distributed node, credential server
infra/ene-rds/ ENE RDS Rust workspace (8 crates — Rust replacement for Python RDS stack)
hardware/ FPGA Verilog, FAMM verilator, KiCad templates
drivers/ Hardware drivers
gpu/ WGSL shaders, wgpu compute dispatch
storage/ restic + Garage S3 + rclone storage stack
storage/storage_agent.py Storage observer/optimizer agent
shim/ Stack solidification probes, adversarial harnesses, gate library
surface/ FastAPI/WebSocket surface (spec'd, pending implementation)

ENE RDS Rust Workspace (infra/ene-rds/)

8-crate Rust workspace replacing the Python RDS stack. Build: cd 4-Infrastructure/infra/ene-rds && cargo build --release.

Crate Purpose
ene-rds-core Shared PostgreSQL client, DSN builder, receipts
ene-rds-wiki Wiki CRUD + full-text search + revision tracking
ene-rds-ephemeral EphemeralNode thermal zones, tasks, receipts, scars, metrics
ene-rds-chat Chat session ingestion, keyword/semantic search
ene-api Axum HTTP server on :3000
ene-node Node identity and gossip primitives
ene-storage S3/Garage object storage client
ene-sync Polls opencode.db SQLite → upserts into RDS chat tables

sqlx 0.8.6 (Dependabot vuln from 0.7 resolved 2026-05-19).

Storage Stack (storage/)

Three tools, non-overlapping roles. Full contract: 4-Infrastructure/AGENTS.md §Storage Stack.

Tool Job
restic Deduplicated, encrypted, content-addressed snapshots
Garage v2.3.0 Self-hosted S3-compatible object store (Tailscale mesh, 5 buckets)
rclone Raw sync between remotes (Garage↔gdrive cold copy)

Storage agent (storage/storage_agent.py): observe→decide→act loop, systemd timer (every 15 min), Q16_16 thresholds, JSONL hash-chain receipts.

GPU Status

  • Device: NVIDIA GeForce RTX 4070
  • Memory: 12.3GB total, ~10GB available
  • CUDA: 13.0
  • Compute dispatch: WGSL → wgpu (Vulkan GPU / lavapipe CPU / WebGPU WASM). Dispatch entry points: 5-Applications/parquet_compressor/src/gpu.rs, gpu/wasmgpu/ (47 WGSL shaders)

Components

  • ENE RDS — Rust workspace replacing Python RDS (see above)
  • Storage Stack — restic + Garage S3 + rclone (see above)
  • Lean Shim — Lean ↔ Python bidirectional interface
  • ENE Shim — ENE node management from Python
  • GPU Duty — WGSL/wgpu compute dispatch (Q16_16 deterministic across all substrates)
  • Credential Gateway — infra/credential_server.py, apiProvider service kind, cupfox routing
  • Adversarial Harnesses — shim/adversarial_duals/: Anti-FAMM, Anti-BraidStorm, 20+ gate library entries