Research-Stack/README.md
allaun 14cde6d09c docs: refresh READMEs, AGENTS.md, and project maps for recent Lean surface
- Update README.md and 0-Core-Formalism/README.md with build baseline
  (3314 jobs, 0 errors) and new modules (SDPVerify, GoormaghtighCert,
  Hachimoji, SieveLemmas, InteractionGraphSidon, GeneticBraidBridge)
- Update AGENTS.md and 0-Core-Formalism/lean/Semantics/AGENTS.md blessed
  surface tables and build baselines
- Add 6-Documentation/PROJECT_MAP.md and update existing project maps
  (MATH_MODEL_MAP*, LEAN_PORT_ORCHESTRATION_MAP, SIDON_FAMM_MAP,
  BEGINNERS_MAP) with new components and Gremlin mathblob graph loader
2026-06-20 20:34:09 -05:00

101 lines
6.1 KiB
Markdown

# Research-Stack (OTOM)
![Heretical Science Engineering](.github/assets/social-preview.png)
**Ultra-low power, zero-decimal data routing and compression.**
If you just stumbled across this repository, you might see words like "Topological State Machine" and "Manifold Points" and assume this is dense, academic magic. **It isn't.**
This project is actually built on a very simple, grounded idea: **Modern computing is incredibly wasteful.**
Right now, running AI or compressing massive datasets requires giant, power-hungry GPUs because they rely on *Floating-Point Math* (heavy decimals like `3.14159...`). We prove that you don't need decimals. You can map complex data (like the grammar of the English language) into structural shapes, and navigate them using **only simple integers (whole numbers).**
Because we only use addition, subtraction, multiplication, and modulo, this system can run on a $15 blank-slate microchip (an FPGA) instead of a massive server farm.
## 🛠️ How we know it works (Zero Guesswork)
We do not guess that our integer math works. We prove it.
The core of this project is written in **Lean 4**, a strict mathematical theorem prover.
If our logic has a flaw, *the code physically will not compile.* We currently have **746 verified Lean modules** across a **3,314-job deterministic `lake build Compiler`** (0 errors) securing this engine.
Python, Rust, and Verilog only exist in this repository to act as "dumb pipes" to feed data into our proven mathematical core.
---
## 📁 Repository Structure (By Goal)
Everything is numbered so you know exactly what depends on what.
| Folder | What it actually is (Plain English) |
| :--- | :--- |
| **`0-Core-Formalism/`** | **The Brain.** Lean 4 code. The mathematically proven integer arithmetic. This is the source of truth. |
| **`1-Distributed-Systems/`** | **The Network.** Code for making multiple computers talk to each other to share the workload. |
| **`2-Search-Space/`** | **The Navigator.** Algorithms that search through our data shapes to find the best routes. |
| **`3-Mathematical-Models/`** | **The Library.** Where we store our databases of equations and compressed English grammar shapes. |
| **`4-Infrastructure/`** | **The Drivers.** Code that physically talks to the hardware, GPUs, and APIs. |
| **`5-Applications/`** | **The Executables.** Python scripts that run the system end-to-end. (These are just shims connecting data to our Lean 4 Brain). |
| **`6-Documentation/`** | **The Manual.** Where you'll find plain-English explanations and our theoretical papers. |
| **`shared-data/`** | Raw data, cache, and exported files. |
---
## 🧩 Recent Additions
New Lean modules now part of the verified core:
| Module | What it actually is (Plain English) |
| :--- | :--- |
| **`Semantics.SDPVerify`** | A certificate verification engine that checks formal SDP proofs before they reach the rest of the stack. |
| **`Semantics.GoormaghtighCert`** | An SDP certificate formalizing the Goormaghtigh conjecture. |
| **`Semantics.HachimojiManifoldAxiom`** / **`Semantics.HachimojiSubstitution`** | Encoding Hachimoji DNA (8 synthetic bases) as manifold axioms and substitution rules. |
| **`Semantics.GeneticBraidBridge`** | A bridge that maps genetic sequence structure onto braid topology. |
| **`Semantics.SieveLemmas`** | Number-theoretic sieve results, including `depth_token_coprime_intersect`. |
| **`Semantics.InteractionGraphSidon`** | RRC weak axes modeled as atproto-style social-graph projections. |
New infrastructure and scripts:
| Script/Service | Description |
| :--- | :--- |
| **`scripts/load_dependency_graph.py`** | Loads the project dependency graph into the Gremlin graph database. |
| **`scripts/load_module_graph.py`** | Loads the Lean module graph for exploration and query. |
| **`scripts/test_graph_queries.py`** | Smoke-tests graph queries against the loaded database. |
| **Gremlin mathblob database** | Azure Cosmos DB graph now loaded with **14,449 vertices** and **29,379 edges**. |
Repository hygiene: **11 stale remote branches were deleted**; only `main` remains.
---
## 📖 Where to start?
If you are new here, read these two files first:
1. **[Explanation for Humans](6-Documentation/EXPLANATION_FOR_HUMANS.md)** - A translation guide for our technical jargon.
2. **[Calculator-Plain Math](6-Documentation/calculator_plain_math.md)** - Proof that every complex concept we use can be calculated on a high-school graphing calculator.
## 🚀 Quick Start
```bash
# 1. Compile the mathematically proven core (Takes ~1-2 minutes)
cd "0-Core-Formalism/lean/Semantics"
lake build
# 2. Run the English Manifold Builder (Compresses English via grammar shapes)
cd "../../.."
python3 5-Applications/scripts/redpajama_english_manifold.py
```
## ⚖️ The One Rule for Contributors
**Lean is the source of truth.**
If you add logic, it goes in `0-Core-Formalism/lean/Semantics/` and must be mathematically proven. Python scripts may not contain complex math, branching logic, or cost functions. Python is just the delivery boy for Lean.
---
## 🗄️ Infrastructure (Current)
| Component | Description |
| :--- | :--- |
| **`4-Infrastructure/infra/ene-rds/`** | Rust workspace (8 crates) replacing the Python RDS stack — Axum HTTP API, PostgreSQL, Ollama embeddings |
| **`4-Infrastructure/storage/`** | restic + Garage S3 (v2.3.0, Tailscale mesh) + rclone storage stack with automated observer agent |
| **`.devcontainer/`** | NixOS hermetic devcontainer with OpenGL/X11, Lean, Python science stack, MCP servers (Notion + AWS) |
| **`4-Infrastructure/infra/credential_server.py`** | Credential gateway with apiProvider service kind and cupfox routing |
| **`4-Infrastructure/shim/vcn_compute_substrate.py`** | VCN H.265 video-as-compute substrate with auto-profiling (NVIDIA CABAC lossless vs. AMD UMA bandwidth optimization) |
| **`4-Infrastructure/shim/qemu_framebuffer_packer.py`** | Zero-copy framebuffer (`/dev/fb0`) packer with ARGB8888 100% density mapping (1 pixel = 1 scalar) |
| **`6-Documentation/docs/specs/virtio_net_compute_fabric_spec.md`** | Spec detailing Virtio-Net packet-as-computation (PIST) and QEMU graphics backplanes |
---
*Research Stack — All Rights Reserved*