Research-Stack/shared-data/data/concept_map/concept_map_receipt.json
allaun 19f40d03c4 feat(data): add concept maps and academic citation grounding
- cornfield_concepts.json: 48 concepts with full academic citations
  - 19 novel claims with explicit novelty_statements
  - 29 grounded in prior work with DOI/arxiv references
  - 0 uncited concepts
- markdown_concept_map.jsonl: 822 local files, 3,152 concepts extracted
- drive_concept_map.jsonl: 752 Google Drive files classified (19 related, 13 Google Docs)
- concept_map_receipt.json: extraction metadata and statistics

Academic citation schema deployed on neon-64gb:
- math_objects: paper_refs (jsonb), arxiv_ids, doi, primary_author, year_published,
  is_novel_claim, novelty_statement
- concept_citations: 118 citation records linking concepts to papers
- Key correction: cf_genetic_error_minimization updated from 10^-6 to 10^-20
  (Omachi et al. 2022 supersedes Freeland-Hurst 1998)

Build: 8604 jobs, 0 errors (lake build)
2026-06-22 01:11:17 -05:00

36 lines
1.2 KiB
JSON

{
"schema": "markdown_concept_map_v1",
"generated_at": "2026-06-21T23:45:00Z",
"source": "parallel agent extraction (7 shards)",
"total_files": 822,
"total_concepts": 3152,
"all_json_valid": true,
"shards": [
{"id": 1, "scope": "Root-level docs", "lines": 16, "concepts": 210},
{"id": 2, "scope": "6-Documentation/ + specs + plans + famm", "lines": 117, "concepts": 363},
{"id": 3, "scope": "docs/ + shared-data/artifacts/ + e2e/ + library/", "lines": 36, "concepts": 196},
{"id": 4, "scope": "4-Infrastructure/ + 0-Core-Formalism/ + scripts/", "lines": 22, "concepts": 147},
{"id": 5, "scope": "Wiki modules A-F", "lines": 260, "concepts": 830},
{"id": 6, "scope": "Wiki modules G-N", "lines": 156, "concepts": 0},
{"id": 7, "scope": "Wiki modules O-Z", "lines": 215, "concepts": 1290}
],
"concept_type_distribution": {
"definition": 1750,
"primitive": 280,
"architecture": 214,
"algorithm": 209,
"spec": 137,
"invariant": 122,
"gate": 99,
"tool": 77,
"theorem": 58,
"recipe": 47,
"protocol": 46,
"bridge": 40,
"pattern": 35,
"receipt": 32,
"pipeline": 2,
"glossary": 2
},
"output_file": "shared-data/data/concept_map/markdown_concept_map.jsonl"
}