All research stack related work and material is folded here, each project subdivided into it's own folders.
Find a file
Devin AI 0c9efac330 chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR
Squash the four overlapping feature branches into a single change set against
main, eliminating cross-PR merge conflicts and the duplicated CI-fix scripts.

What this brings in (merge order #79 -> #80 -> #81 -> #89):
- #79 refactor(infra): shared utilities (4-Infrastructure/lib/*: q16, hashing,
  jsonl, fraction_utils) + the scripts/math-first/* validators that the
  math-check CI requires.
- #80 feat(lean): Semantics.E8Sidon (1025 lines) -- Eisenstein coefficient
  identity E4^2 = E8 and the Sidon framework. E4_sq_eq_E8_coeff is fully proved
  (all Fourier-coefficient extraction machine-checked); the single residual gap
  is pinned to E4_sq_eq_E8_qExpansion (Mathlib lacks the valence formula /
  dim M8 = 1). 4 sorries + 1 axiom (e8_additive_completeness), all TODO(lean-port).
- #81 refactor(lean): Float-free FixedPoint core (integer-only sqrt/log2/expNeg).
  E8Sidon.lean kept at #80's final 1025-line version (the #81 intermediate
  438-line copy was overridden by merge order).
- #89 feat(lean): Semantics.RRC.PolyFactorIdentity -- short-sleeve polynomial
  detection at the zerocopy limb boundary; now imports Semantics.E8Sidon for
  sigma3/sigma7/convolutionLHS (single source of truth) instead of inlining them.

Conflict resolution:
- flake.nix -> canonical rs-surface removal (Garnix shutdown).
- scripts/math-first/* -> byte-identical across branches, clean.
- .cursorrules / AGENTS.md -> unified; baselines + sorry inventory refreshed.

Verification:
- lake build (default aggregator): 3573 jobs, 0 errors.
- lake build Semantics.RRC.PolyFactorIdentity (E8Sidon + FixedPoint + PolyFactor):
  3655 jobs, 0 errors. Witnesses verified (sigma7 4 = 16513, convolutionLHS 6 = 2350).
- Python tests: 68/68 pass.

Note: the "Workers Builds: researchstack" check is a preexisting external
Cloudflare build unrelated to this change (no branch touches 4-Infrastructure/cloudflare/).

Build: 3573 jobs (default), 3655 jobs (narrow), 0 errors
Co-Authored-By: Allaun Silverfox <bigdataiscoming+9i37y6j2@protonmail.com>
2026-06-16 02:01:31 +00:00
.agents/plugins Consolidate research stack updates 2026-05-05 21:09:48 -05:00
.consolidation-manifests initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
.contextstream chore: rename workspace from nodupelabs to researchstack 2026-05-27 00:46:44 -05:00
.cursor WIP: accumulated changes 2026-05-25 16:24:21 -05:00
.devcontainer devcontainer: replace Alpine base with nixos/nix; add sagemath 2026-05-19 09:40:14 +00:00
.devin feat(skills): extend lean-proof skill with anti-drift rules 2026-05-26 22:52:52 -05:00
.github chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
.hermes/plans chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
.kilo/rules chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
.opencode/agents docs: sync all editor rules, opencode agents, and sorry audit 2026-05-28 17:53:54 -05:00
.roo docs: sync all editor rules, opencode agents, and sorry audit 2026-05-28 17:53:54 -05:00
.vscode Stabilize remote proof endpoint and RDS shims 2026-05-25 20:48:25 -05:00
.windsurf docs: sync all editor rules, opencode agents, and sorry audit 2026-05-28 17:53:54 -05:00
0-Core-Formalism chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
1-Distributed-Systems fix(adversarial-review): resolve 35 critical coding bugs across 8 subsystems 2026-05-31 23:38:03 -05:00
2-Search-Space fix(deps): update tar to v0.4.46 and refresh npm packages 2026-05-30 00:37:43 -05:00
3-Mathematical-Models chore(manifold): remove orphaned MISC Python tests 2026-05-20 18:50:11 -05:00
4-Infrastructure chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
5-Applications chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
6-Documentation feat(infra): Garage 6-node RF3 cluster, Cloudflare Workers deploy, k3s node additions 2026-05-31 03:39:11 -05:00
6-Kernel-Shim Consolidate research stack updates 2026-05-05 21:09:48 -05:00
ai-math-discovery-systems fix: correct Q16_16 add/sub signed/unsigned bug, add missing lemmas 2026-05-18 00:31:44 -05:00
archive/2026-05-26 archive: preserve duplicate PISTMachine search-space copy 2026-05-26 14:30:39 -05:00
data/erdos_famm_solved_scars Add OpenAI unit-distance disproof as Erdos FAMM solved scar 2026-05-20 23:01:41 -05:00
desi_model_projection_receipt_2026-05-13 feat(infra): Jellyfin wizard complete, SSO-Auth plugin files deployed 2026-05-31 14:14:20 -05:00
docs fix(docs): full soft color override — entire page #f5f0eb 2026-05-30 21:07:18 -05:00
obsidian-vault docs: add external research import maps 2026-05-20 18:41:21 -05:00
pending/lean_unification chore(pending): move python ENE ContextStream MCP surface into pending quarantine 2026-05-26 17:59:51 -05:00
plugins chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
scratch chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
scripts chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
shared-data feat: integrate May 2026 math papers into Research Stack 2026-05-30 18:16:57 -05:00
test-results feat(infra): Jellyfin wizard complete, SSO-Auth plugin files deployed 2026-05-31 14:14:20 -05:00
workspace-config initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
.aider.conf.yml chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
.clinerules docs: sync all editor rules, opencode agents, and sorry audit 2026-05-28 17:53:54 -05:00
.codeiumignore Add workspace load-shedding ignores 2026-05-11 15:53:59 -05:00
.cursorrules chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
.gitattributes chore: untrack *.pdf from LFS (GitHub LFS budget exceeded) 2026-05-30 00:10:55 -05:00
.gitignore archive: remove dated receipts, experimental probes, and uncompiled prototypes 2026-05-25 16:51:58 -05:00
.gitmodules archive: remove dated receipts, experimental probes, and uncompiled prototypes 2026-05-25 16:51:58 -05:00
.mcp.json Stabilize ENE API and context shim 2026-05-25 21:06:46 -05:00
.pre-commit-config.yaml math-first: fix pre-commit evidence-gate filter bug, polish schema + validator 2026-05-12 04:40:20 +00:00
.python-version Track DeepSeek review receipts and CAD setup tasks 2026-05-11 22:41:44 -05:00
.sops.yaml WIP: accumulated changes 2026-05-25 16:24:21 -05:00
AGENTS.md docs(infra): update public documentation for virtualized DMA compute backplane 2026-05-30 19:51:24 -05:00
airtable_compute_substrate_schema.json chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_hardware_substrates.csv chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_import_guide.md chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_integration_patterns.csv chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_math_workloads.csv chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_optimal_configurations.csv chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_performance_metrics.csv chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
airtable_scaling_analysis.csv chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
ARCHITECTURE.md chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
CHANGELOG.md docs: full documentation + roadmap refresh (2026-05-19) 2026-05-19 09:12:16 +00:00
CITATION.cff chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
claims.yaml Merge math-first tooling guardrails 2026-05-11 23:34:48 -05:00
CLAUDE.md chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
CONCEPTS.md WIP: accumulated changes 2026-05-25 16:24:21 -05:00
Containerfile integrate stashed changes: math model data updates + 4 receipt dirs + container config 2026-05-17 12:03:19 -05:00
cupfox-config.nix WIP: accumulated changes 2026-05-25 16:24:21 -05:00
flake.lock Expand ene-rds Rust workspace and refine devcontainer 2026-05-19 07:52:39 +00:00
flake.nix chore(consolidation): integrate E8Sidon stack (PRs #79 #80 #81 #89) into one PR 2026-06-16 02:01:31 +00:00
GEMINI.md chore: commit accumulated working tree changes 2026-05-30 00:10:02 -05:00
GETTING_STARTED.md Refactor provenance sources for open witness backends 2026-05-12 05:57:04 -05:00
kilo.jsonc WIP: accumulated changes 2026-05-25 16:24:21 -05:00
LICENSE initial: sovereign research stack (consolidated, weightless, and lfs-optimized) 2026-05-04 18:11:36 -05:00
Modelfile integrate infrastructure config, axiom cleanup, and documentation updates 2026-05-17 12:03:19 -05:00
NOTICE Track HCMMR sources and ignore generated mirrors 2026-05-11 21:53:32 -05:00
opencode.json feat(pist): pist_trace_classify MCP tool — classify proof traces against 57-theorem flexure library 2026-05-26 11:23:53 -05:00
package-lock.json fix(deps): update tar to v0.4.46 and refresh npm packages 2026-05-30 00:37:43 -05:00
package.json Bump better-sqlite3 in the root-npm-minor-patch group across 1 directory 2026-05-20 23:03:34 -05:00
pyrightconfig.json wip: refined investigation script for Erdős–Gyárfás conjecture 2026-05-08 14:50:03 -05:00
README.md docs(infra): update public documentation for virtualized DMA compute backplane 2026-05-30 19:51:24 -05:00
requirements-optional-science.txt Add optional science toolbelt probe 2026-05-12 00:21:34 -05:00
result-devcontainer Expand devcontainer with full Python stack, add MCP servers (Notion/AWS), strengthen Lean theorems 2026-05-19 01:52:14 -05:00
run-container.sh integrate stashed changes: math model data updates + 4 receipt dirs + container config 2026-05-17 12:03:19 -05:00
system-packages-optional-science.txt Harden optional science toolbelt probe 2026-05-12 05:12:46 -05:00
THIRD_PARTY_NOTICES.md collapse: prover orchestration layers, FAMM verilator harness, swarm topological prober, spec sheets, virtual FPGA system tests, merge conflict resolution 2026-05-06 23:42:01 -05:00
TODO_MAP.md docs(agents): project-wide AGENTS.md audit — cross-refs, baseline, contracts 2026-05-26 22:34:46 -05:00

Research-Stack (OTOM)

Heretical Science Engineering

Ultra-low power, zero-decimal data routing and compression.

If you just stumbled across this repository, you might see words like "Topological State Machine" and "Manifold Points" and assume this is dense, academic magic. It isn't.

This project is actually built on a very simple, grounded idea: Modern computing is incredibly wasteful.

Right now, running AI or compressing massive datasets requires giant, power-hungry GPUs because they rely on Floating-Point Math (heavy decimals like 3.14159...). We prove that you don't need decimals. You can map complex data (like the grammar of the English language) into structural shapes, and navigate them using only simple integers (whole numbers).

Because we only use addition, subtraction, multiplication, and modulo, this system can run on a $15 blank-slate microchip (an FPGA) instead of a massive server farm.

🛠️ How we know it works (Zero Guesswork)

We do not guess that our integer math works. We prove it. The core of this project is written in Lean 4, a strict mathematical theorem prover. If our logic has a flaw, the code physically will not compile. We currently have 746 verified Lean modules across a 3,313-job deterministic build (0 errors) securing this engine.

Python, Rust, and Verilog only exist in this repository to act as "dumb pipes" to feed data into our proven mathematical core.


📁 Repository Structure (By Goal)

Everything is numbered so you know exactly what depends on what.

Folder What it actually is (Plain English)
0-Core-Formalism/ The Brain. Lean 4 code. The mathematically proven integer arithmetic. This is the source of truth.
1-Distributed-Systems/ The Network. Code for making multiple computers talk to each other to share the workload.
2-Search-Space/ The Navigator. Algorithms that search through our data shapes to find the best routes.
3-Mathematical-Models/ The Library. Where we store our databases of equations and compressed English grammar shapes.
4-Infrastructure/ The Drivers. Code that physically talks to the hardware, GPUs, and APIs.
5-Applications/ The Executables. Python scripts that run the system end-to-end. (These are just shims connecting data to our Lean 4 Brain).
6-Documentation/ The Manual. Where you'll find plain-English explanations and our theoretical papers.
shared-data/ Raw data, cache, and exported files.

📖 Where to start?

If you are new here, read these two files first:

  1. Explanation for Humans - A translation guide for our technical jargon.
  2. Calculator-Plain Math - Proof that every complex concept we use can be calculated on a high-school graphing calculator.

🚀 Quick Start

# 1. Compile the mathematically proven core (Takes ~1-2 minutes)
cd "0-Core-Formalism/lean/Semantics"
lake build

# 2. Run the English Manifold Builder (Compresses English via grammar shapes)
cd "../../.."
python3 5-Applications/scripts/redpajama_english_manifold.py

⚖️ The One Rule for Contributors

Lean is the source of truth. If you add logic, it goes in 0-Core-Formalism/lean/Semantics/ and must be mathematically proven. Python scripts may not contain complex math, branching logic, or cost functions. Python is just the delivery boy for Lean.


🗄️ Infrastructure (Current)

Component Description
4-Infrastructure/infra/ene-rds/ Rust workspace (8 crates) replacing the Python RDS stack — Axum HTTP API, PostgreSQL, Ollama embeddings
4-Infrastructure/storage/ restic + Garage S3 (v2.3.0, Tailscale mesh) + rclone storage stack with automated observer agent
.devcontainer/ NixOS hermetic devcontainer with OpenGL/X11, Lean, Python science stack, MCP servers (Notion + AWS)
4-Infrastructure/infra/credential_server.py Credential gateway with apiProvider service kind and cupfox routing
4-Infrastructure/shim/vcn_compute_substrate.py VCN H.265 video-as-compute substrate with auto-profiling (NVIDIA CABAC lossless vs. AMD UMA bandwidth optimization)
4-Infrastructure/shim/qemu_framebuffer_packer.py Zero-copy framebuffer (/dev/fb0) packer with ARGB8888 100% density mapping (1 pixel = 1 scalar)
6-Documentation/docs/specs/virtio_net_compute_fabric_spec.md Spec detailing Virtio-Net packet-as-computation (PIST) and QEMU graphics backplanes

Research Stack — All Rights Reserved