Research-Stack/6-Documentation/docs/semantics/AMMR_NODE_REDEFINITION.md

12 KiB

AMMR Node Redefinition

This note redefines an AMMR node as a committed QR-factorization summary.

The purpose is to replace vague "vector accumulation" language with a precise, auditable object:

  • each node stores a local orthonormal basis
  • each node stores projection coefficients in that basis
  • each node commits these quantities by hash
  • the AMMR tree becomes a committed QR factorization tree

Canonical Definition

Each AMMR node has the shape:

Node:
  hash: H(left.hash || right.hash || summary)
  summary:
    Q: orthonormal basis vectors
    R: projection coefficients
    metadata:
      dimension
      norm energy
      condition number (optional)

Interpretation:

  • Q is the local orthonormal frame for the node's retained subspace
  • R is the coefficient object describing the node in that frame
  • hash commits both ancestry and summary
  • metadata provides typed audit information for stability checks

Semantic Shift

Old AMMR intuition:

  • weighted vector accumulation
  • phase or resonance summaries
  • Merkle-like aggregation over heuristic vector state

New AMMR intuition:

  • hierarchical committed orthogonalization
  • subspace-preserving aggregation
  • QR summaries committed at every internal node

Therefore:

  • AMMR is no longer merely an accumulator
  • AMMR is a committed QR factorization tree

Summary Fields

Q: Orthonormal basis

Q represents the basis vectors spanning the retained subspace of the node.

Requirements:

  1. Basis vectors are mutually orthogonal.
  2. Each retained vector is normalized.
  3. The basis order is deterministic.
  4. The basis dimension is finite and explicitly recorded.

Minimal invariant:

Q^T Q = I

In implementation terms, exact floating-point orthogonality is not required in the proof layer. The proof layer should instead carry a typed witness that the basis has been accepted as orthonormal under the chosen fixed-point or exact representation.

R: Projection coefficients

R represents the coefficient object of the node summary in basis Q.

Requirements:

  1. Coefficients are defined with respect to the stored Q.
  2. Coefficient shape is deterministic for the stored dimension.
  3. If the parent is formed from child summaries, the parent R must be derived from the child contribution projected into the parent basis.

Minimal interpretation:

summary_payload ~= Q R

This note does not force a specific rectangular or triangular encoding yet. The only hard requirement is that R is the committed coefficient object associated to Q.

Metadata

Required metadata:

  1. dimension
  2. normEnergy

Optional metadata:

  1. conditionNumber

Definitions:

  • dimension: retained basis rank of the node
  • normEnergy: scalar magnitude of the committed summary
  • conditionNumber: numerical conditioning witness for stability-sensitive implementations

Parent Merge Law

Given child nodes L and R, form the parent by:

  1. concatenating or otherwise combining child summary payloads
  2. computing a deterministic orthogonalization step
  3. extracting the parent basis Q_parent
  4. extracting the parent coefficients R_parent
  5. computing parent metadata
  6. hashing left.hash || right.hash || summary_parent

Canonical parent:

parent.summary = QR(merge(left.summary, right.summary))
parent.hash    = H(left.hash || right.hash || parent.summary)

The exact merge operator may vary by domain, but it must be deterministic and must feed the orthogonalization procedure.

Hash Commitment

The node hash is a commitment to:

  1. left ancestry
  2. right ancestry
  3. QR summary
  4. metadata

So the hash is not merely a structural Merkle hash. It is a commitment to the compressed linear-algebra state at that node.

This gives two audit guarantees:

  1. ancestry integrity
  2. summary integrity

Required Invariants

Any later Lean formalization should target these invariants first.

Invariant 1: Basis admissibility

isOrthonormal(Q) = true

Completion condition:

  • proof-layer predicate exists
  • at least one witness theorem or #eval example exists

Invariant 2: Dimension consistency

metadata.dimension = rank(Q) = coeffDimension(R)

Completion condition:

  • dimension is explicit
  • no implicit shape assumptions remain in the node

Invariant 3: Energy consistency

metadata.normEnergy = energy(summary)

Completion condition:

  • energy functional is defined
  • one theorem or witness ties metadata to the summary payload

Invariant 4: Hash determinism

same children + same summary -> same hash

Completion condition:

  • hash constructor is fully deterministic
  • field ordering is fixed

Invariant 5: Parent commitment law

hash(parent) = H(hash(left) || hash(right) || summary(parent))

Completion condition:

  • parent constructor exists
  • commitment law is either definitional or theorem-backed

Relationship To Existing Repo Structures

This redefinition supersedes the weaker "hash + vector state" shape currently used in:

  • /home/allaun/Documents/Research Stack/0-Core-Formalism/lean/Semantics/Semantics/VecState.lean
  • /home/allaun/Documents/Research Stack/docs/semantics/ene_schema_specification.md

Specifically, the existing model:

  • stores vec
  • merges by additive vector superposition
  • hashes after merge

The new model should instead:

  • store a QR summary
  • merge by deterministic orthogonalization
  • hash the QR summary as the committed node payload

Lean-Oriented Refactor Target

The eventual Lean structure should look more like:

AMMRSummary
  qBasis
  rCoeff
  dimension
  normEnergy
  conditionNumber?

AMMRNode
  hash
  summary

with helper predicates:

  • isOrthonormalBasis
  • dimensionConsistent
  • energyConsistent
  • isDeterministicCommit

Mirror Algorithm -> LUT

This section refines the execution interpretation of the committed QR-tree.

The mirror algorithm should be interpreted as:

Mirror = dual-space projection

If AMMR stores:

  • Q
  • R

then the mirror LUT stores:

f(Q) -> precomputed outputs

So runtime becomes:

input -> project onto Q -> lookup result

Runtime Interpretation

Given a learned or retained basis:

Q = [pattern1, pattern2, pattern3, ...]

the runtime path is:

  1. project input into the basis carried by Q
  2. reduce the projection to a symbolic index
  3. query the mirror LUT with that index
  4. emit the precomputed action or result

Equivalent summary:

learned basis -> symbolic index -> constant-time execution

The committed QR-tree therefore acts as:

  1. a dimensionality-reduction layer
  2. a commitment layer
  3. a symbolic indexing layer for constant-time lookup

Mirror LUT Semantics

The mirror LUT is not an arbitrary cache.

It is the dual execution space corresponding to the retained basis. Its input is not the raw payload but the projection of the payload into the node's basis.

Canonical shape:

MirrorLUT:
  key   := quantize(project(input, Q))
  value := action | result | next-state

This means:

  • AMMR summarizes structure
  • mirror LUT operationalizes that structure

The QR-tree provides the stable symbolic address space; the LUT provides the constant-time action layer.

Architectural Synthesis

The overall stack is:

Layer 1: Field

  • QR / SVD-based orthogonal summaries
  • deterministic retained subspace per node

Layer 2: Memory

  • AMMR commits node summaries
  • ancestry + summary are cryptographically bound

Layer 3: Routing

  • routing weights are determined by projection similarity
  • nearest or strongest subspace match drives traffic

Layer 4: Nutrients

  • residual energy drives growth or decay
  • large residuals force refinement or expansion
  • small residuals support pruning or stabilization

Layer 5: Execution

  • mirror LUT maps basis-space indices to outputs
  • runtime path is projection first, lookup second

In short:

Field -> Memory -> Routing -> Nutrients -> Execution

Critical Constraints

These constraints are mandatory if the design is to remain deterministic and hardware-extractable.

Constraint 1: Floating-point instability

Naive Gram-Schmidt is not stable enough as the canonical implementation target.

Priority order:

  1. modified Gram-Schmidt
  2. Householder QR
  3. SVD where truncation and conditioning dominate

Proof-layer implication:

  • do not formalize correctness in terms of unconstrained floating-point numerics
  • formalize accepted summary objects and their invariants
  • leave concrete numeric factorization strategy to extraction targets until a fixed-point implementation is specified

Constraint 2: Hash determinism

Q cannot be hashed directly from unstable high-precision floating-point output.

Requirement:

Q -> deterministic quantization -> canonical serialization -> hash

Without quantization, equivalent bases may hash differently across platforms or executions.

Proof-layer implication:

  • the committed object is the canonicalized summary, not an implementation-local in-memory matrix layout

Constraint 3: Basis size control

Without rank control, the basis will grow without bound.

Requirement:

  • retain only significant components
  • truncate small singular values or low-energy directions
  • record retained rank in metadata

Canonical policy shape:

retain i iff singularValue(i) >= threshold

Proof-layer implication:

  • dimension must be explicit
  • truncation policy must be deterministic
  • parent summary rank must be reproducible from child summaries and policy

Formal O-AMMR Statement

The cleaned statement of the idea is:

Orthogonal AMMR (O-AMMR)

An Algebraic Merkle Mountain Range variant in which:

  1. node summaries are orthogonal bases derived from input vectors
  2. merge operations perform deterministic projection-based decomposition
  3. information redundancy is reduced through residual minimization
  4. the structure maintains a cryptographically committed QR/SVD factorization
  5. computation histories are translated into a dual LUT execution space

What This Makes AMMR

Under this redefinition, AMMR is best understood as:

a distributed, verifiable dimensionality-reduction engine

This is stronger than:

  • plain vector accumulation
  • heuristic resonance tracking
  • ordinary Merkle aggregation

because the node summary now carries a committed subspace model and the runtime execution path is expressed in basis-space rather than raw-space.

Immediate Lean-Facing Next Step

The next implementation step should now be split into two local targets.

Target A: Summary layer

Add:

  1. AMMRSummary
  2. AMMRNode
  3. dimensionConsistent
  4. commitParent

Completion metrics:

  • deterministic parent constructor exists
  • dimension consistency is witnessed
  • commitment law is definitional or theorem-backed

Target B: Execution layer

Add a separate execution-facing structure, for example:

MirrorLUTIndex
  basisId
  quantizedCoeff

MirrorLUTEntry
  index
  result

with theorem targets:

  1. projection indexing is deterministic
  2. equal quantized projections yield equal LUT addresses
  3. execution depends on basis-space key, not raw payload identity

Completion metrics:

  • no raw-space lookup remains in the formal execution path
  • lookup key is fully determined by basis identifier plus quantized coefficients
  • at least one witness shows constant-time symbolic execution after projection

Completion Metrics

This redefinition is complete only when all of the following are true:

  1. There is one canonical node shape in repo docs.
  2. The node is explicitly defined as a committed QR factorization summary.
  3. The parent merge law is deterministic and documented.
  4. The hash commitment includes both ancestry and summary.
  5. The five invariants above are mapped to Lean predicates or theorem targets.
  6. Existing AVMR/AMMR Merkle language is updated to match the committed QR-tree semantics where applicable.

Immediate Next Step

The next implementation step should be:

  1. add a Lean-facing AMMRSummary structure
  2. add a deterministic parent-constructor skeleton
  3. prove hash commitment and dimension consistency before attempting any full QR numerics

This keeps the proof layer honest while allowing later extraction targets to choose the concrete QR computation strategy.