DashboardopencodeNuum incremental distillation and evalu…

Nuum incremental distillation and evaluation lessons

Category: architecture
Confidence: 1.00
ID: 01a086aa-bb28-798f-93a5-418d50685cce
Project ID: c0425955-02bc-4c17-9af2-b114c00077e7
Cross-project: No
Recalled in other projects: 2
Source session: (none)
Created: 2026-06-09 13:20:47
Updated: 2026-09-09 14:55:31

Cross-Project Recalls

ProjectHitsLast recalled
opencode-lore 2 21d ago
Code 1 2026-07-01

Content

Trigger backgroundDistill after storing a completed assistant message when undistilled count reaches config.distillation.maxSegment (default 50); retain session.idle as catchall. Historical sessions require explicit backfill. The distillation prompt must capture every assistant-generated item, preserve numbered ordering, and retain distinguishing quantities, ratios, temperatures, names, locations, and prices. Under-capture caused single-session-assistant accuracy to fall from 83.9% to 57.1%; explicit rules/examples raised it to 96.4%. LongMemEval improved from 72.6% baseline to 88.0% final, and coding evaluation from 10/15 to 14/15. Prioritize incremental batches, prompt coverage, then cross-session entity merging.

Move to: