allaun/SilverSight
1
0
Fork 0
mirror of https://github.com/allaunthefox/SilverSight.git synced 2026-07-31 01:25:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
SilverSight/scripts/compression/README.md
allaun f0466be09c docs(compression): add pi-as-tape-LUT coda (offset = data size, base conversion) 
Measured on real pi (1e6 digits): first-occurrence position of a k-digit string
~10^k, so the offset needs ~k digits — same size as the data, slope 1. BBP gives
pi free random access (never store the tape) but the address still carries all
the bits. Closes the findings doc on the cleanest single proof of the
base-conversion law. Adds scripts/compression/pi_tape_lut.py.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-03 15:56:01 -05:00

1.4 KiB
Raw Blame History

Compression — honest-measurement scripts

Reproducible experiments behind docs/research/COMPRESSION_HONEST_FINDINGS.md. Every claim is checked with a real coder and a byte-exact lossless round-trip; no straw baselines. Python 3 + numpy only (stdlib lzma/gzip for baselines).

script what it measures
spectral_vs_empirical.py Wall 1: rank-k reconstruction of the byte transition matrix never beats raw counts
entropy_full.py order-0/1/2 empirical entropy of a corpus (adaptive-AC target rate)
ac_roundtrip.py real Witten–Neal–Cleary order-2 arithmetic coder; lossless round-trip + bits/byte
gw_honest_test.py GW ringdown parametric fit (handed TRUE params) vs LPC/xz across SNRs — the "583×" gate
frozen_model_compress.py conservation law: frozen model + AC, model-column vs tape-column, self-contained vs amortized
mass_number_compress.py Semantic Mass Number = base conversion (bijection), M1/M2/M3 vs xz
superposition_recovery.py capstone: compressed-sensing recovery vs sparsity — recoverable ⟺ sparse cliff
pi_tape_lut.py π as a tape LUT: offset-into-π (real π digits) is the same size as the data — base conversion

Most default to a local text corpus path; pass a directory as argv[1] to point elsewhere. entropy_full.py/ac_roundtrip.py expect an enwik8 file (re-fetch from mattmahoney.net/dc/enwik8.zip).