Goals and scope
Problem
Modern LLM usage is dominated by text in, text out. For multi-step agents and long context that is expensive and misaligned with how the network computes.
We want a New AI Language in the broad sense: a stack of media (not slogans) that:
- Cuts tokens / memory / FLOPs without quality collapse.
- Improves structured multi-step reliability.
- Prefers no weight training (prompting, routing, external memory, tools, frozen inference structure).
Goals
G1 — Understand the machine
Document, at engineer level:
- Tokenization → embedding → residual
- Attention, QKV, softmax, output A(q)
- KV cache cost
- What training gradients do vs inference
G2 — Name the right bottleneck
Separate:
- Prompt tax (BPE / prose)
- Engine tax (KV m·d, attention matmul)
G3 — Track A: denser I/O language
Invent and run structured text codecs (palette + frame / STATE-IR) for agent memory.
Label clearly: still text.
G4 — Track B: architecture-native representation
Pursue Attention Output Cover (AOC): store a small cover of attention outputs (and hybrid exact window), not full keys and not chat novels — from the maths research (derivation 17+).
G5 — Ground in research
Keep theorems, empirics (r_Σ, A0, hybrid), and brutal honesty in-tree under maths/ and findings/.
G6 — Falsifiability
Every keep:
- Token or memory metric
- Quality / fidelity metric
- Kill condition
Out of scope (unless marked)
- Soft prompts / activation steering that need training
- New trained attention (e.g. tropical attention from scratch) as default
- Claims of infinite free context
Success criteria (project level)
| Track | Bar |
|---|---|
| Docs | New agent can explain arch + two tracks in 10 minutes |
| Track A | ≥25% prompt tokens vs full chat on multi-turn traces without >10% task drop |
| Track B | On gated heads: mem win vs dense KV at fixed A-error; eventually e2e needle/PPL |
| Honesty | No doc claims non-text for glyph; no universal constant-size claim without e2e |
Relationship to monorepo
This folder is the product narrative + knowledge base.
Heavy code and raw experiments stay in Research'/maths/ and memory/.
Lab discovery rules remain in root AGENTS.md.