Distillation

Date: Sep 16, 2026

• 🔴 (23:43) User stated telemetry must never break the embedding path; the telemetry call is guarded by try/catch.
• 🔴 (23:43) User stated localStackMissing self-healing tracks the epoch milliseconds of the last re-probe, where 0 means never and is primed on the first tick.
• 🔴 (23:43) User stated the embedding worker bootstrap distinguishes module systems: CJS uses __filename (always defined), while ESM uses import.meta.url.
• 🔴 (23:43) User stated a worker-bootstrap value is always defined in the relevant runtime context, with a shim retained to keep the source natural.
• 🔴 (23:43) User stated the deterministic fake-worker test seam is never set in production.
• 🟡 (23:43) packages/core/src/embedding/local.ts includes container-aware memory handling via resolveMemoryHeadroom, containerFreeBytes(), and capFreememAtLearn; its constrained-memory helper returns 0 when unconstrained and is available in Node ≥18.15 and Bun.
• 🟡 (23:43) packages/core/src/embedding/local.ts creates an embedding Worker with eval: true, derives a CJS/ESM-compatible worker entrypoint, and supports deterministic fake workers through a production-disabled test seam.
• 🟡 (23:43) packages/core/src/embedding/local.ts treats worker errors as potentially transient runtime/model startup-pressure failures, performs OOM backoff through handleOomBackoff(), supports a one-time WASM fallback guarded by wasmFallbackTried, and handles worker "init-error" messages separately.
• 🟡 (23:43) packages/core/src/embedding/local.ts preserves typed local-provider failure handling: a generic Error could bypass the intended path and cause silent data loss, so failures use the relevant local-provider error type such as LocalProviderUnavailableError.
• 🟡 (23:43) packages/core/src/embedding/pool.ts requires invalid pool-size environment values to resolve to undefined, never NaN, and to fall through to configuration; valid values must be finite and ≥1 and are normalized with Math.floor(n).
• 🟡 (23:43) packages/core/src/embedding/pool.ts defines MAX_QUEUED_EMBED_OPERATIONS = 256 and tracks queued memory through queuedBytes.
• 🟡 (23:43) packages/core/src/embedding/pool.ts pools LocalProvider workers so concurrent embedding requests execute in parallel rather than serially.
• 🟡 (23:43) During transient failure debt, packages/core/src/embedding/pool.ts routes new work only to proven healthy sibling slots and selects among candidates using their inflight counts.
• 🟡 (23:43) Pool worker memory admission is coordinated so workers do not each independently claim half of available memory and collectively cause an OOM.
• 🟡 (23:43) packages/core/src/embedding/pool.ts supports operation deduplication/tracking through operations, queue cleanup that clears operation.texts, abort handling with EmbeddingRequestAbortedError, retry dispatch through retryDispatchTimer, and token-batch progress through tokenBatchCheckpoints.
• 🟡 (23:43) packages/core/src/embedding/pool.ts recognizes localEmbeddingState.failureCause === "transient-init-exhausted" as a distinct failure state.