allaun/SilverSight
1
0
Fork 0
mirror of https://github.com/allaunthefox/SilverSight.git synced 2026-07-31 01:25:21 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
SilverSight/scripts/compression/README.md
allaun 99c943dcd0 docs(compression): honest-findings writeup + reproducible scripts 
Records the full compression investigation as a repo doc plus the scripts that
back every number (real coders, byte-exact lossless round-trips, no straw
baselines). One law: recoverable <=> sparse/structured; no method beats K(data),
schemes only relocate bits between model and residual columns.

Findings (all measured): char-poly = integrity receipt not compressor; Braille/T9
= 4.167 b/B, loses to xz; "16D/583x" GW ringdown = zero-noise self-fit artifact,
~1.5x tying/losing to LPC on noisy strain; frozen-model conservation law
(k=3 smallest tape, worst total); Semantic Mass Number = base conversion
(1.00-1.10x, bijection); capstone superposition/compressed-sensing cliff
(recoverable iff k <= ~d/log N). Honest home for all: receipts/addresses/
recoverability gates (GCCL/RRC), never the ratio column.

docs/research/COMPRESSION_HONEST_FINDINGS.md + scripts/compression/ (7 scripts + README).

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
2026-07-03 15:52:27 -05:00

1.3 KiB
Raw Blame History

Compression — honest-measurement scripts

Reproducible experiments behind docs/research/COMPRESSION_HONEST_FINDINGS.md. Every claim is checked with a real coder and a byte-exact lossless round-trip; no straw baselines. Python 3 + numpy only (stdlib lzma/gzip for baselines).

script what it measures
spectral_vs_empirical.py Wall 1: rank-k reconstruction of the byte transition matrix never beats raw counts
entropy_full.py order-0/1/2 empirical entropy of a corpus (adaptive-AC target rate)
ac_roundtrip.py real Witten–Neal–Cleary order-2 arithmetic coder; lossless round-trip + bits/byte
gw_honest_test.py GW ringdown parametric fit (handed TRUE params) vs LPC/xz across SNRs — the "583×" gate
frozen_model_compress.py conservation law: frozen model + AC, model-column vs tape-column, self-contained vs amortized
mass_number_compress.py Semantic Mass Number = base conversion (bijection), M1/M2/M3 vs xz
superposition_recovery.py capstone: compressed-sensing recovery vs sparsity — recoverable ⟺ sparse cliff

Most default to a local text corpus path; pass a directory as argv[1] to point elsewhere. entropy_full.py/ac_roundtrip.py expect an enwik8 file (re-fetch from mattmahoney.net/dc/enwik8.zip).