Research-Stack/6-Documentation/papers/OTOM/15_Public_Domain_Language_Exemplars.md
2026-05-05 21:09:48 -05:00

19 KiB

Public Domain Language Exemplars from Archive.org

Authors: Research Stack Team Date: May 2026 Domain: TTM Layer A (Compression/Routing) + Linguistic Invariants Purpose: Archive.org public domain exemplars for languages in the invariant catalog

References: See 00_Master_References.md for complete source mapping


Executive Summary

This document provides public domain exemplars from archive.org for the 27+ languages documented in the language invariant catalog. These exemplars serve as:

  • Training data for invariant detection algorithms
  • Reference texts for compression analysis
  • Baseline corpora for cognitive load measurement
  • Historical language samples for evolutionary analysis

Indo-European Languages

1. English (en / eng)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Fixed SVO word order
  • Minimal inflection
  • Prepositional phrases
  • Tense markers

2. German (de / deu/ger)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Case marking (4 cases)
  • Verb-second syntax
  • Compound formation
  • Gender marking

3. French (fr / fra/fre)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Verbal system (tense, aspect, mood)
  • Article usage
  • Gender marking
  • Subjunctive mood

4. Spanish (es / spa)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Subjunctive mood
  • Ser/estar distinction
  • Gender/number agreement
  • Clitic pronouns

5. Italian (it / ita)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Verbal system (tense, aspect, mood)
  • Article usage
  • Gender marking
  • Subjunctive mood

6. Polish (pl / pol)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • Case marking (7 cases)
  • Gender marking (3 genders)
  • Aspectual verb pairs
  • Free word order

7. Russian (ru / rus)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • Case marking (6 cases)
  • Aspectual verb pairs
  • Verbal aspect
  • Free word order

8. Czech (cs / ces)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • Case marking (7 cases)
  • Gender marking (3 genders)
  • Aspectual verb pairs
  • Free word order

9. Danish (da / dan)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • Case marking (limited)
  • Definite articles
  • Verb position
  • Gender marking (2 genders)

10. Dutch (nl / nld)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • Case marking (limited)
  • Compound formation
  • Verb position
  • Gender marking (2 genders)

11. Serbian (sr / srp)

Archive.org Exemplars:

Fiction:

  • The Bridge on the Drina by Ivo Andrić (1945)

Structural Features Demonstrated:

  • Case marking (7 cases)
  • Aspectual verb pairs
  • Free word order
  • Gender marking (3 genders)

Semitic Languages

12. Arabic (ar / ara)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Root-pattern morphology
  • Non-concatenative morphology
  • Case marking (3 cases)
  • Gender marking (2 genders)

13. Hebrew (he / heb)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Root-pattern morphology
  • Non-concatenative morphology
  • Construct state
  • Gender marking (2 genders)

14. Amharic (am / amh)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Amharic.

Alternative:

Structural Features Demonstrated:

  • Root-pattern morphology
  • Ge'ez script
  • Complex verb morphology
  • Gender marking (2 genders)

East/Southeast Asian Languages

15. Chinese (zh / zho)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Logographic writing
  • Tonal system (Mandarin)
  • Topic-comment structure
  • Classifier system

16. Cantonese (yue / yue)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Cantonese.

Alternative:

Structural Features Demonstrated:

  • Logographic writing
  • Tonal system (6+ tones)
  • Topic-comment structure
  • Classifier system

17. Japanese (ja / jpn)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • SOV word order
  • Topic-comment structure
  • Honorific system
  • Verb conjugation

18. Korean (ko / kor)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Korean due to copyright laws.

Alternative:

Structural Features Demonstrated:

  • SOV word order
  • Honorific system
  • Agglutinative morphology
  • Topic-comment structure

19. Vietnamese (vi / vie)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Vietnamese.

Alternative:

Structural Features Demonstrated:

  • SVO word order
  • Tonal system (6 tones)
  • Analytic morphology
  • Classifier system

African Languages

20. Ewe (ee / ewe)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Ewe.

Alternative:

Structural Features Demonstrated:

  • SVO word order
  • Tonal system
  • Serial verb construction
  • Classifier system

21. Wolof (wo / wol)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Wolof.

Alternative:

Structural Features Demonstrated:

  • SVO word order
  • Tonal system
  • Serial verb construction
  • No grammatical gender

22. Yoruba (yo / yor)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Yoruba.

Alternative:

Structural Features Demonstrated:

  • SVO word order
  • Tonal system (3 tones)
  • Serial verb construction
  • Classifier system

Oceanic Languages

23. Lgu (lgu / lgu)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Lgu (Longgu).

Alternative:

Structural Features Demonstrated:

  • SVO word order
  • Reduplication
  • Possession marking
  • Verb serialization

24. Cam (cam / cam)

Archive.org Exemplars:

Note: Limited public domain materials available on archive.org for Cam (Cameroon Pidgin).

Alternative:

Structural Features Demonstrated:

  • SVO word order
  • Simplified morphology
  • Analytic structure
  • Reduplication

Uralic Languages

25. Finnish (fi / fin)

Archive.org Exemplars:

Fiction:

Non-Fiction:

Structural Features Demonstrated:

  • Agglutinative morphology
  • Case marking (15+ cases)
  • Vowel harmony
  • No grammatical gender

Iranian Languages

26. Persian (fa / fas)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • SOV word order
  • Agglutinative morphology
  • Ezafe construction
  • Gender-neutral

Creole Languages

27. English-lexified Creole (---)

Archive.org Exemplars:

Fiction:

Structural Features Demonstrated:

  • SVO word order
  • Simplified morphology
  • Analytic structure
  • Reduplication

Usage Guidelines

For Invariant Detection

  1. Text preprocessing: Remove formatting, normalize encoding
  2. Language identification: Use ISO codes from catalog
  3. Invariant extraction: Apply language-specific detection methods
  4. Compression analysis: Measure compressibility against baseline

For Cognitive Load Measurement

  1. Baseline selection: Use English as reference (CL-I1)
  2. Load calculation: Apply severity weights from catalog
  3. Cross-linguistic comparison: Normalize by text length
  4. Evolutionary analysis: Track changes across time periods

For Training Data

  1. Corpus construction: Combine fiction and non-fiction exemplars
  2. Balancing: Ensure equal representation across genres
  3. Validation: Use held-out sets for testing
  4. Version control: Track archive.org identifiers for reproducibility

Limitations

Resource constraints:

  • Academic funds at negative balance limited access to paid databases
  • Exemplars collected from freely available archive.org resources only
  • Some languages rely on grammar references rather than fiction due to availability

Copyright restrictions:

  • Many languages have limited public domain materials
  • Post-1923 works may not be available
  • Translation vs. original language distinction

Quality issues:

  • OCR errors in digitized texts
  • Incomplete collections
  • Variant editions and translations

Coverage gaps:

  • Some languages have no public domain exemplars
  • Oral traditions not well-represented
  • Contemporary works excluded

Future Work

Expand coverage:

  • Add more languages from invariant catalog
  • Include more recent public domain materials
  • Incorporate oral tradition recordings

Quality improvement:

  • OCR correction and validation
  • Text normalization and standardization
  • Metadata enrichment

Integration:

  • Link to invariant detection algorithms
  • Connect to cognitive load measurement
  • Integrate with compression analysis tools

References