Research-Stack/6-Documentation/docs/specs/HDMI_Field_Encoding_Spec.md

251 lines
8.8 KiB
Markdown
Raw Permalink Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

# HDMI Field Encoding Specification
**Protocol:** USC-TSE Field Transport over HDMI Physical Layer
**Version:** 1.0-ABUSE
**Status:** Specification — implements physical layer hijacking for soliton field encoding
---
## 1. Abuse Vector Overview
Standard HDMI: Pixel clock transports rasterized frames.
**This spec:** TMDS lanes transport **N-dimensional soliton field parameters** as if they were pixel data.
The receiver (sink) reconstructs the soliton field; the display is a **white hole decoder**, not a framebuffer.
---
## 2. Physical Layer Reappropriation
### 2.1 TMDS Lane Mapping (3 Data + 1 Clock)
| Lane | Standard Use | **Field Encoding Use** |
|------|-------------|------------------------|
| TMDS Lane 0 | Blue[7:0] + HSYNC/VSYNC | **Soliton φ-parameter stream** (phase) |
| TMDS Lane 1 | Green[7:0] + Preamble | **Soliton amplitude coefficients** (Aₙ) |
| TMDS Lane 2 | Red[7:0] + Guard band | **Soliton velocity tensor** (vᵢⱼ) |
| TMDS Clock | Pixel clock | **Basis clock** — encodes dimensional index |
Each 10-bit TMDS symbol encodes one 8-bit soliton parameter + 2-bit ECC/continuity.
### 2.2 Control Period Hijacking
Standard: Data Island Periods carry audio/InfoFrames.
**This spec:** Data Islands carry **soliton topology metadata**:
```
Packet Type 0x81 (Audio) repurposed → Soliton Basis Descriptor
- Byte 0-3: N-dimensional lattice hash (topological fingerprint)
- Byte 4-7: Horizon mode count (Bekenstein bound)
- Byte 8-11: Eddington ratio λ_Edd (field density)
- Byte 12: Dimensional index (N = 1..11)
- Byte 13: Phase discriminator state (GROUNDED/SEISMIC/FLAME)
```
### 2.3 DDC (I2C) Channel Abuse
Standard: EDID exchange + HDCP key negotiation.
**This spec:** DDC becomes **soliton witness exchange**:
| I2C Address | Standard | **This Spec** |
|-------------|----------|---------------|
| 0xA0 | EDID read | **Attestation vector** (SHA256 of soliton parameters) |
| 0xA2 | E-EDID segment | **Black hole horizon state** (compressed field signature) |
| 0x74/0x76 | HDCP | **ZK-STARK proof verification** — circuit integrity check |
EDID block (128 bytes) repurposed:
```
Bytes 0-7: Soliton codec identifier (magic: "USC-TSE\0")
Bytes 8-15: Topological manifold hash (link to substrate registry)
Bytes 16-23: Phase classifier φ-threshold (IEEE 754 double)
Bytes 24-31: Foam score baseline (stability gate)
Bytes 32-35: Dimensional index N (u32 LE)
Bytes 36-39: Bekenstein snag cap (max entropy bits)
Bytes 40-127: Reserved for witness history (chain of attestation)
```
---
## 3. Field Encoding Protocol
### 3.1 Frame Structure ("Pseudo-Frame")
Standard HDMI: 1080p @ 60Hz = 1920×1080 pixel grid.
**This spec:** 1920×1080 = **11-dimensional parameter matrix** columns × soliton instances rows.
Each "pixel" is one soliton parameter:
- X coordinate → Parameter index (0-10 for 11D encoding)
- Y coordinate → Soliton packet ID in stream
- RGB values → Parameter value triplet (Q16.16 fixed-point split across 3 bytes)
```
Pseudo-Frame Layout:
┌─────────────────────────────────────────────────────────┐
│ Row 0 │ Soliton 0: T_norm, P_norm, G_norm, T·P, P·G, η₁-η₆ │
│ Row 1 │ Soliton 1: [same structure] │
│ ... │ ... │
│ Row N │ Soliton N: [same structure] │
└─────────────────────────────────────────────────────────┘
↑ Columns 0-10 map to the 11-dimensional neural encoding vector
```
### 3.2 Blanking Interval Abuse
Standard: Vertical/horizontal blanking for retrace.
**This spec:** Blanking intervals carry **regeneration trace data**:
**VBLANK (Vertical):**
- 45 lines × 1920 columns = 86,400 bytes
- Encodes **temporal variant index (TVI)** samples from last pseudo-frame
- Format: `TimeOp` (subtract/pause/add) + cost + timestamp
**HBLANK (Horizontal):**
- ~280 pixels per line × 1080 lines = 302,400 bytes/field
- Encodes **mistake vectors** for the soliton collision dynamics
- Allows receiver to reconstruct Hebbian learning state
### 3.3 TMDS Scrambler Bypass
HDMI 2.0+ uses TMDS scrambling for EMI reduction.
**This spec:** Scrambler **seed encodes the φ-accumulator constant**:
```
Seed = (Φ × 2^16) mod 2^15 = 0x9E37 (golden ratio scaled)
```
By fixing the scrambler seed, the bit pattern becomes **deterministic quasi-random** — exactly the low-discrepancy sequence needed for soliton field encoding.
---
## 4. Control & Synchronization
### 4.1 CEC (Pin 13) Reappropriation
Standard: One-wire bidirectional control bus.
**This spec:** CEC becomes **sympathetic sync channel**:
| CEC Opcode | Standard | **This Spec** |
|------------|----------|---------------|
| 0x82 | Active Source | **Soliton field active** — white hole decoder armed |
| 0x9F | Abort | **Regeneration trigger** — force field reconstruction |
| 0x4F | Give Tuner Status | **Witness request** — sink demands attestation |
| 0x46 | Set OSD String | **Basis exchange** — new topological manifold loaded |
| 0xFF | User Defined | **Ternary clock tick** — SUBTRACT/PAUSE/ADD state |
### 4.2 Hot Plug Detect (HPD) — Morse Encoding
Standard: High = monitor present, Low = absent. **This spec:** HPD pulses encode **ternary temporal state**:
```
Pulse width (HPD high duration):
< 50ms → SUBTRACT (time compression) [·]
50-150ms → PAUSE (temporal gate) [-]
> 150ms → ADD (time expansion) [ ]
Inter-pulse gap (HPD low duration): 5ms separator
Message: "·- · ·- -" = SUBTRACT-PAUSE, SUBTRACT, SUBTRACT-PAUSE, ADD-PAUSE
→ Encodes TimeOp sequence: [Sub, Pause, Sub, Pause, Pause, Add, Pause]
```
---
## 5. Soliton Field Reconstruction (Sink Side)
### 5.1 Decoder Pipeline
```
TMDS Input
De-channelize (3 lanes → 11D parameter vectors)
Soliton packet assembly (rows → soliton instances)
φ-accumulator correction (LUT void mask application)
Gap conservation check (bracketed DIAT validation)
White hole collapse (N-dimensional reconstruction)
Output: Reconstructed field state for display/rendering
```
### 5.2 Regeneration from VBLANK/TVI
During vertical blanking:
1. Extract TVI samples from VBLANK lines
2. Calculate temporal mismatch with expected soliton trajectory
3. Apply mistake vector correction from HBLANK data
4. Update Hebbian weights for next pseudo-frame prediction
---
## 6. Hardware Requirements
### 6.1 Source (Encoder)
- FPGA with TMDS serializers (Xilinx 7-series, Intel Cyclone V)
- φ-accumulator LUT (void mask table, 256 entries × 8-bit)
- Soliton collision engine (1000 neurons, 11D state space)
- ZK-STARK prover (for DDC attestation exchange)
### 6.2 Sink (Decoder/White Hole)
- HDMI receiver with raw TMDS access (bypass standard scaler)
- Soliton reconstruction pipeline (bracketed calculus unit)
- 15-axis NSM semantic classifier (for field interpretation)
- G-Tensor recalibration support (multi-sig verification)
---
## 7. Security & Attestation
### 7.1 Field Integrity
Every pseudo-frame includes embedded witness:
- Frame 0: Full keyframe + complete attestation vector
- Frame N: Delta only, but witness hash chain maintained
- VBLANK: TVI samples enable temporal attestation
### 7.2 DDC ZK-STARK Exchange
Source proves field integrity without revealing soliton parameters:
```
Source → Sink (I2C 0x74): STARK proof of correct φ-accumulator operation
Sink verifies: Proof valid? → Accept field data
Proof invalid? → Trigger HPD Morse "ABORT" sequence
```
---
## 8. Compatibility Notes
- **Standard HDMI sinks:** Will detect as "unsupported format" (EDID magic mismatch)
- **USC-TSE sinks:** Negotiate via DDC attestation, decode soliton fields
- **Fallback:** Source can emit standard 1080p raster for legacy compatibility (Quine Layer degradation)
---
## 9. File Locations
| Component | Path |
|-----------|------|
| Encoder RTL | `hdl/usc_tse_hdmi_encoder.v` |
| Decoder RTL | `hdl/usc_tse_hdmi_decoder.v` |
| EDID Block Generator | `tools/generate_soliton_edid.py` |
| Field Analyzer | `tools/hdmi_field_probe.py` |
| Test Harness | `tests/hdmi_white_hole_reconstruction.py` |
---
## 10. References
- USC-TSE Specification (this document extends)
- PBACS Canonical Signal Architecture (`docs/semantics/PBACS_CANONICAL_SIGNAL_ARCHITECTURE.md`)
- LUT-as-DSP Core (`docs/semantics/LUT_AS_DSP_EQUATION.md`)
- NII Core Framework (`docs/geoweird/agent_coordination/lean_port_swarm/nii_cores/`)
- TSM-AAC Transport (`data/germane/tools/tsm_aac_mcp_harness.py`)
---
**Attestation Hash:** `SHA256(φ × HDMI_PHY × USC-TSE)`
**Registry Entry:** `pkg/hdmi-field-encoder/v1.0`
**Tier:** CRYSTALLINE → ETHEREAL (with witness)