Distillation

Date: September 16, 2026

• 🔴 [requested-validation] (22:35) User asked to resume the existing exact-tree reference-validation session from its current state, preserve completed work, avoid duplicating completed commands, and continue to a substantive PASS/FAIL rather than returning warning-only.
• 🔴 [enforced-workflow] (22:35) User directed that missing context be recovered with lore recall --project /home/byk/Code/opencode-lore --scope project ... or local /ui/search.
• 🔴 (22:35) User prohibited editing files, mutating VCS or server state, and accessing the production DB during the validation.
• 🔴 (22:36) User stated tests use a temporary SQLite DB via the Vitest setup file packages/core/test/setup.ts—never the production DB.
• 🔴 (22:36) User stated releases use Sentry Craft via GitHub Actions and directed: never manually bump versions or edit CHANGELOG.md; Craft handles both automatically.
• 🟡 (22:36) Repository metadata showed monorepo package manager pnpm@10.28.0, license FSL-1.1-Apache-2.0, root test script vitest run, build script pnpm -r run build, docs check tsx scripts/generate-config-docs.ts --check && tsx scripts/generate-env-docs.ts --check, social check node scripts/check-social-meta.mjs, formatter oxfmt, and premutation script pnpm --filter @loreai/gateway run bundle.
• 🟡 (22:36) Monorepo package map: @loreai/core at packages/core/ provides the shared memory engine; @loreai/gateway at packages/gateway/ provides the transparent LLM proxy, lore CLI, and web dashboard; @loreai/opencode at packages/opencode/ is the OpenCode lifecycle adapter using @opencode-ai/plugin; @loreai/pi at packages/pi/ is the Pi coding-agent extension adapter.
• 🟡 (22:36) CLI entry flow is packages/gateway/src/cli/bin.ts → packages/gateway/src/cli/main.ts (_cli()).
• 🟡 (22:36) Three-tier memory architecture includes Tier 3 in packages/core/src/gradient.ts: transform() runs on every message transform, with Layer 0 full passthrough, Layer 1 distilled prefix plus compressed raw content, Layer 2 aggressive tool-output stripping, and Layer 3 emergency compression; limits are dynamically calibrated from real API token counts with model-pricing-aware caps.
• 🟡 (22:36) Long-term knowledge has 4 creation paths: 1. LLM Curator in packages/core/src/curator.ts, periodically producing create/update/delete operations from conversation plus existing entries; 2. regex-based Pattern Extraction in packages/core/src/pattern-extract.ts, running after each distillation without an LLM; 3. File Import in packages/core/src/agents-file.ts, parsing .lore.md markers of the form <!-- lore:UUID --> and upserting into the DB; 4. curator.ts consolidate(), where an LLM merges/trims entries after the count exceeds maxEntries of 25.
• 🟡 (22:36) Memory data flow documented as: user conversation → temporal.store() → temporal_messages SQLite/FTS5; distillation.run() → observer LLM → generation-0 distillations; metaDistill() → reflector LLM → generation-1+ distillations while generation 0 is archived rather than deleted; curator.run() → curator LLM → knowledge; exportLoreFile() → project-root .lore.md; exportToFile() → AGENTS.md pointer; next-session importLoreFile() imports changed .lore.md; forSession() plus formatKnowledge() injects system-prompt knowledge; searchRecall powers recall-tool results.
• 🟡 (22:36) Build paths documented: packages/gateway/script/build.ts produces the gateway CJS bundle, script/bundle.ts creates the standalone binary, and packages/core/script/build.ts produces Node.js-compatible CJS output.
• 🟡 (22:36) Explicit release invocation example was gh workflow run release.yml -f version=0.23.0.
• 🟡 (22:38) Current exact-tree state had working-copy modifications in packages/gateway/src/pipeline.ts and packages/gateway/test/openai-responses-recall-aware-stream.test.ts.
• 🟡 (22:38) Current working copy was zkttmwun / commit 05d9998321f5fcd782163bb35c25cf5470de13e9, description fix(responses): close reference lifecycle gaps; parent was wywumkpt / 8063355c, bookmark fix/responses-private-references-v2, description fix(responses): keep item references private. Tree/hash output also included 84d3826b2c49e60fe7cd33552cb69bde73f65530713b93a4dd3140dd9a7ce30f.
• 🟡 (22:38) Jujutsu warned that bookmark fix/responses-private-references had conflicts and suggested jj bookmark list for details or jj bookmark set <name> -r <rev> to resolve them; no resolution was performed in this segment.
• 🟡 (22:39) Process inspection found an active vitest run -- --printConsoleTrace chain with shell PID 614547, Vitest PID 614548, and worker PIDs 614588, 614591, and 614593, running for about 01:15–01:16 under /home/byk/Code/opencode-lore-codex-reasoning, not the reference-v2 tree named in the process-search regex.
• 🟡 (22:39) The active test processes used Node 24.16.0 and Vitest 4.1.8; the inspection command searched for /home/byk/Code/opencode-lore-responses-reference-v2|vitest|oxlint|oxfmt|tsc|packages/gateway/script/bundle.