Session s2e6c0096b22

                         Embedding worker init fails in vitest (Node.js ESM extensionless imports) — withLocalModel silent skip masks it · Issue #606 · BYK/loreai · GitHub                                              

[Skip to content](#start-of-content)  

## Navigation Menu

Toggle navigation

[](/)

[Sign in](/login?return_to=https%3A%2F%2Fgithub.com%2FBYK%2Floreai%2Fissues%2F606)

Appearance settings

 

-   Platform
    
    -   AI CODE CREATION
        
        -   [
            
            GitHub CopilotWrite better code with AI
            
            ](https://github.com/features/copilot)
        -   [
            
            GitHub Copilot appDirect agents from issue to merge
            
            ](https://github.com/features/ai/github-app)
        -   [
            
            MCP RegistryNewIntegrate external tools
            
            ](https://github.com/mcp)
        
    -   DEVELOPER WORKFLOWS
        
        -   [
            
            ActionsAutomate ...

task_id: ses_15c212813ffeeeZd08qgqzTFG1 (for resuming to continue this task if needed)

<task_result>
Now I have all the data I need. Let me deliver the comprehensive structured summary.

---

# Embedding Worker Code: Comprehensive Analysis

## 1. `/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts`

**Absolute path:** `/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts`
**Total lines:** 408

### The Extensionless Import (Lines 24-31)

```ts
// packages/core/src/embedding-worker.ts:24-31
import {
  isOomError,
  isWasmFatalError,
  type WorkerInbound,
  type WorkerOutbound,
  type WorkerInitData,
  type EmbedRequest,
} from "./embedding-worker-types";
```

**Key point:** This is the **extensionless** import the user asked about. The path `./embedding-worker-types` has no `.ts` or `.js` extension. It works in the source TypeScript because `tsconfig.base.json:5` sets `moduleResolution: "bundler"`, but this is fragile at runtime when vitest is resolving ...

task_id: ses_15c210c4effeKHQi76FIOPtUwr (for resuming to continue this task if needed)

<task_result>
# Loreai Monorepo Build & Binary Pipeline: Structured Report

Comprehensive investigation of `/home/byk/Code/opencode-lore` covering build scripts, vitest setup, and embedding worker bundling. Package manager is **pnpm 10.28.0** (per `package.json:11`). Test runner is **vitest** (migrated from `bun:test` — see `.lore.md:43`).

---

## 1. `packages/gateway/script/build.ts` (102 lines)

**Absolute path:** `/home/byk/Code/opencode-lore/packages/gateway/script/build.ts`

**Purpose:** Now a **dev-shim generator**, NOT the real library build. Per the file header (`build.ts:1-16`):

> Two build modes:
> 1. `bun run script/build.ts` (default) — Produces dev shims.
> 2. `bun run script/build.ts --binary` — Delegates to `build-binary-sea.ts`.

**The shim logic** (`build.ts:46-77`):

```ts
// build.ts:53-58 — Embedding worker shim
const shims: Array<[string, string]> = [
  [
    ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
1: /**
2:  * Embedding worker thread — runs ONNX inference via @huggingface/transformers
3:  * off the main thread.
4:  *
5:  * This file is the entry point for a `node:worker_threads` Worker spawned by
6:  * `LocalProvider` in `embedding.ts`. It owns the transformers.js pipeline
7:  * and processes embed requests sequentially from a priority queue. Moving
8:  * inference here keeps the main thread's event loop free — HTTP requests,
9:  * SSE streams, and session APIs are no longer blocked during embedding.
10:  *
11:  * Communication uses `parentPort` message passing with structured clone.
12:  * Float32Array vectors are sent back directly (Bun preserves identity).
13:  *
14:  * The worker applies Nomic's recommended post-processing:
15:  *   1. Mean pooling (via pipeline option)
16:  *   2. Layer normalization
17:  *   3. ...

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
475:       .run(pid, now, now);
476: 
477:     const results = vectorSearchEntities(new Float32Array([1, 0, 0]), 1);
478:     expect(results.length).toBe(1);
479:     expect(results[0].id).toBe("ent-x");
480:   });
481: });
482: 
483: let loggedModelSkip = false;
484: 
485: /**
486:  * Run a model-dependent test body, tolerating an unavailable local model.
487:  *
488:  * In CI the model is vendored and `LORE_LOCAL_MODEL_PATH` points at it, so the
489:  * body runs normally. In local dev (or a CI cache miss) the model is fetched
490:  * from HuggingFace Hub on first use — which can fail transiently (429) or be
491:  * unavailable offline. When the body throws `LocalProviderUnavailableError` we
492:  * SKIP rather than hard-fail, so a flaky HF download never blocks an otherwise
493:  * green run. Any other error still fails the test. ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
280:     if (this.workerReady) return;
281:     if (this.workerInitError)
282:       throw new LocalProviderUnavailableError(this.workerInitError);
283:     if (this.initPromise) return this.initPromise;
284: 
285:     this.initPromise = (async () => {
286:       // Fast-fail if a previous attempt already marked local broken.
287:       if (localProviderKnownBroken) throw new LocalProviderUnavailableError();
288: 
289:       const { Worker } = await import("node:worker_threads");
290: 
291:       // Resolve how to spawn the worker.
292:       //
293:       // In fossilize SEA binary mode: the binary's sea-entry.ts reads
294:       // the worker source from the SEA asset and exposes it via
295:       // `globalThis.__LORE_WORKER_SOURCE__`. We pass it to
296:       // `new Worker(code, { eval: true, filename, workerData })`. ...

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
600:         const [queryVec] = await embed(["database schema changes"], "query");
601:         const results = vectorSearch(queryVec, 3);
602: 
603:         expect(results.length).toBe(3);
604:         // The PostgreSQL entry should be most relevant
605:         expect(results[0].id).toBe("local-0");
606:         expect(results[0].similarity).toBeGreaterThan(0.3);
607:       }),
608:     60_000,
609:   );
610: });
611: 
612: describe("LocalProvider worker thread", () => {
613:   test(
614:     "embed produces Float32Array vectors with 768 dimensions through worker",
615:     () =>
616:       withLocalModel(async () => {
617:         const [vec] = await embed(["test query via worker"], "query");
618:         expect(vec).toBeInstanceOf(Float32Array);
619:         expect(vec.length).toBe(768);
620:         const norm = Array.from(vec).reduce((sum, v) => sum + v * v, 0);
621:        ...

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
1: import {
2:   afterAll,
3:   afterEach,
4:   describe,
5:   test,
6:   expect,
7:   beforeEach,
8: } from "vitest";
9: import { db, ensureProject } from "../src/db";
10: import {
11:   cosineSimilarity,
12:   toBlob,
13:   fromBlob,
14:   isAvailable,
15:   vectorSearch,
16:   vectorSearchEntities,
17:   checkConfigChange,
18:   _shutdownAndDisable,
19:   _saveAndClearProvider,
20:   _restoreProvider,
21:   embed,
22:   LocalProviderUnavailableError,
23:   pickRemoteFallback,
24:   _resetLocalProviderProbe,
25:   _markLocalProviderUnavailable,
26: } from "../src/embedding";
27: 
28: describe("cosineSimilarity", () => {
29:   test("identical vectors return 1.0", () => {
30:     const a = new Float32Array([1, 2, 3]);
31:     expect(cosineSimilarity(a, a)).toBeCloseTo(1.0, 5);
32:   });
33: 
34:   test("opposite vectors return -1.0", () => {
35:     const a = new Float32Array([1, ...

task_id: ses_15c1b460affeCcd243k2A7C3gb (for resuming to continue this task if needed)

<task_result>
# Implementation Plan for issue #606

## 1. Validation of the fix

**Verdict: the `.js` extension change is correct and minimal.** No edge cases missed.

Why `.js` works everywhere in this codebase:
- `tsconfig.base.json` uses `moduleResolution: "bundler"` — esbuild/Vite transparently resolve `./x.js` → `./x.ts` at bundle/transform time. TypeScript itself accepts the `.js` suffix under `bundler` resolution.
- All three build paths (gateway CJS/ESM bundles, core node/bun bundles, SEA worker bundle) feed through esbuild, which strips/rewrites extensions as needed.
- Bun's resolver also handles `.js` → `.ts` mapping.
- Vitest's Vite transformer handles it the same way.
- The CJS shim in `packages/gateway/script/build.ts:55-58` writes `embedding-worker.js` with `export * from "../../core/src/embedding-worker.ts";` — confirming `.js` extension usage is already an established pattern in ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-vendor.ts</path>
<type>file</type>
<content>
80:  * The value is the cache ROOT, matching the binary wrapper's `localModelPath`:
81:  * transformers.js resolves the model at `<root>/<modelId>/<file>` (e.g.
82:  * `<root>/nomic-ai/nomic-embed-text-v1.5/onnx/model_quantized.onnx`). This is
83:  * the `.vendor-build/.model-cache` dir produced by `vendor-embeddings.ts`.
84:  *
85:  * Takes precedence over the binary-wrapper registration so it can also be used
86:  * to override a vendored binary's extracted path in tests.
87:  */
88: export const LOCAL_MODEL_PATH_ENV = "LORE_LOCAL_MODEL_PATH";
89: 
90: function envModelPath(): string | null {
91:   const p = process.env[LOCAL_MODEL_PATH_ENV];
92:   if (!p) return null;
93:   // Best-effort existence check — a missing or non-directory path falls through
94:   // to HF download rather than failing init (so a stale env var never bricks
95:   // embeddings). ...

88:export const LOCAL_MODEL_PATH_ENV = "LORE_LOCAL_MODEL_PATH";
91:  const p = process.env[LOCAL_MODEL_PATH_ENV];

1778326968114-tidy-nebula.md
1778345436769-hidden-pixel.md
1778359138854-clever-pixel.md
1778360615763-silent-cabin.md
1778361795079-brave-falcon.md
1778362858561-crisp-moon.md
1778367505784-silent-island.md
1778436617640-lucky-mountain.md
1778437735630-quick-pixel.md
1778451021071-cosmic-orchid.md
1778451798147-witty-lagoon.md
1778490739801-mighty-wizard.md
1778494915984-clever-panda.md
1778495219586-lucky-panda.md
1778497901298-quick-moon.md
1778499815297-happy-tiger.md
1778505303572-glowing-engine.md
1778505317992-glowing-wizard.md
1778505441597-stellar-eagle.md
1778506855923-witty-eagle.md
1778510484579-kind-panda.md
1778525359992-witty-garden.md
1778534079497-crisp-otter.md
1778535445593-nimble-wizard.md
1778538030497-shiny-mountain.md
1778538726066-curious-tiger.md
1778538814202-happy-sailor.md
1778542191032-misty-star.md
1778542967915-glowing-pixel.md
1778571987234-shiny-lagoon.md
1778586964506-proud-tiger.md
1778587032123-silent-cabin.md
1778589773690-kind-knight.md
17785898419...

Wrote file successfully.

The plan file at .opencode/plans/1780865688932-sunny-comet.md is empty. Please write the plan first before calling plan_exit.

(no output)

User approved switching to build agent. Wait for further instructions.

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
1: import {
2:   afterAll,
3:   afterEach,
4:   describe,
5:   test,
6:   expect,
7:   beforeEach,
8: } from "vitest";
9: import { db, ensureProject } from "../src/db";
10: import {
11:   cosineSimilarity,
12:   toBlob,
13:   fromBlob,
14:   isAvailable,
15:   vectorSearch,
16:   vectorSearchEntities,
17:   checkConfigChange,
18:   _shutdownAndDisable,
19:   _saveAndClearProvider,
20:   _restoreProvider,
21:   embed,
22:   LocalProviderUnavailableError,
23:   pickRemoteFallback,
24:   _resetLocalProviderProbe,
25:   _markLocalProviderUnavailable,
26: } from "../src/embedding";
27: 
28: describe("cosineSimilarity", () => {
29:   test("identical vectors return 1.0", () => {
30:     const a = new Float32Array([1, 2, 3]);

(Showing lines 1-30 of 740. Use offset=31 to continue.)
</content>

22:  LocalProviderUnavailableError,
160:  test("embed() throws LocalProviderUnavailableError when local provider is broken", async () => {
169:    expect(caught).toBeInstanceOf(LocalProviderUnavailableError);
176:      LocalProviderUnavailableError,
194:  test("embed() throws LocalProviderUnavailableError when local is broken (no auto-switch to Voyage)", async () => {
197:      LocalProviderUnavailableError,
201:  test("embed() throws LocalProviderUnavailableError when local is broken (no auto-switch to OpenAI)", async () => {
204:      LocalProviderUnavailableError,
491: * unavailable offline. When the body throws `LocalProviderUnavailableError` we
503:    if (err instanceof LocalProviderUnavailableError) {

Edit applied successfully.

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
480:     const results = vectorSearchEntities(new Float32Array([1, 0, 0]), 1);
481:     expect(results.length).toBe(1);
482:     expect(results[0].id).toBe("ent-x");
483:   });
484: });
485: 
486: function assertLocalModelAvailable(): void {
487:   const path = process.env[LOCAL_MODEL_PATH_ENV];
488:   if (!path) {
489:     throw new Error(
490:       `Local embedding model not available: ${LOCAL_MODEL_PATH_ENV} is not set. ` +
491:         `Set it to the vendored model cache root (e.g. .vendor-build/.model-cache) ` +
492:         `to run end-to-end embedding tests. See packages/core/src/embedding-vendor.ts.`,
493:     );
494:   }
495:   if (!existsSync(path)) {
496:     throw new Error(
497:       `Local embedding model not available: ${LOCAL_MODEL_PATH_ENV}="${path}" ` +
498:         `does not exist. Vendor the model or unset the env var.`,
499:     );
500:   }
501: }
502: ...

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
510:   beforeEach(() => {
511:     const pid = ensureProject(PROJECT);
512:     db().query("DELETE FROM knowledge WHERE project_id = ?").run(pid);
513:   });
514: 
515:   test(
516:     "embed produces Float32Array vectors with 768 dimensions",
517:     () =>
518:       withLocalModel(async () => {
519:         const { embed } = await import("../src/embedding");
520:         const [vec] = await embed(["test query for embedding"], "query");
521:         expect(vec).toBeInstanceOf(Float32Array);
522:         expect(vec.length).toBe(768);
523:         // Vector should not be all zeros
524:         const norm = Array.from(vec).reduce((sum, v) => sum + v * v, 0);
525:         expect(norm).toBeGreaterThan(0);
526:       }),
527:     60_000,
528:   );
529: 
530:   test(
531:     "query and document embeddings have reasonable similarity",
532:     () =>
533:       withLocalModel(async () ...

Edit applied successfully.

Edit applied successfully.

clean - no matches

7:  beforeAll,
486:function assertLocalModelAvailable(): void {
506:  beforeAll(() => {
507:    assertLocalModelAvailable();
597:  beforeAll(() => {
598:    assertLocalModelAvailable();

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
1: import {
2:   afterAll,
3:   afterEach,
4:   describe,
5:   test,
6:   expect,
7:   beforeAll,
8:   beforeEach,
9: } from "vitest";
10: import { existsSync } from "node:fs";
11: import { db, ensureProject } from "../src/db";
12: import { LOCAL_MODEL_PATH_ENV } from "../src/embedding-vendor";
13: import {
14:   cosineSimilarity,
15:   toBlob,

(Showing lines 1-15 of 722. Use offset=16 to continue.)
</content>

> lore-monorepo@ typecheck /home/byk/Code/opencode-lore
> pnpm -r run typecheck

Scope: 5 of 6 workspace projects
packages/core typecheck$ tsc --noEmit
packages/core typecheck: Done
packages/gateway typecheck$ tsc --noEmit
packages/gateway typecheck: Done
packages/opencode typecheck$ tsc --noEmit
packages/pi typecheck$ tsc --noEmit
packages/opencode typecheck: Done
packages/pi typecheck: Done

    592     │ - ····60_000,
    593     │ - ··);
        577 │ + ····expect(results.length).toBe(3);
        578 │ + ····//·The·PostgreSQL·entry·should·be·most·relevant
        579 │ + ····expect(results[0].id).toBe("local-0");
        580 │ + ····expect(results[0].similarity).toBeGreaterThan(0.3);
        581 │ + ··},·60_000);
    594 582 │   });
    595 583 │   
    ······· │ 
    599 587 │     });
    600 588 │   
    601     │ - ··test(
    602     │ - ····"embed·produces·Float32Array·vectors·with·768·dimensions·through·worker",
    603     │ - ····async·()·=>·{
    604     │ - ······const·[vec]·=·await·embed(["test·query·via·worker"],·"query");
    605     │ - ······expect(vec).toBeInstanceOf(Float32Array);
    606     │ - ······expect(vec.length).toBe(768);
  77 more lines truncated
  

Checked 255 files in 3s. No fixes applied.
Found 1 error.
Found 15 warnings. ...

    101 │         db.close();
  
  i any disables many type checking rules. Its use should be avoided.
  

Skipped 1 suggested fixes.
If you wish to apply the suggested (unsafe) fixes, use the command biome check --write --unsafe

Checked 255 files in 7s. Fixed 1 file.
Found 15 warnings.

    1031 │       const aliasValues = updated.aliases.map((a) => a.alias_value);
    1032 │       expect(aliasValues).toContain("alice-gh");
  

packages/gateway/test/helpers/harness.ts:99:47 lint/suspicious/noExplicitAny ━━━━━━━━━━━━━━━━━━━━━━━

  ! Unexpected any. Specify a different type.
  
     97 │         const stmt = db.prepare(sql);
     98 │         // eslint-disable-next-line @typescript-eslint/no-explicit-any
   > 99 │         return stmt.all(...((params ?? []) as any)) as T[];
        │                                               ^^^
    100 │       } finally {
    101 │         db.close();
  
  i any disables many type checking rules. Its use should be avoided.
  

Checked 255 files in 4s. No fixes applied.
Found 15 warnings.

/home/byk/Code/opencode-lore/.vendor-build/.model-cache
model cache exists

no env var

 ❯ packages/opencode/test/gateway-smoke.test.ts (4 tests | 1 failed) 24073ms
     × startGateway starts the gateway and responds to health checks 22880ms
(node:1321673) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
(node:1321673) ExperimentalWarning: SQLite is an experimental feature and might change at any time
--
 FAIL  packages/core/test/embedding.test.ts > LocalProvider integration
Error: Local embedding model not available: LORE_LOCAL_MODEL_PATH is not set. Set it to the vendored model cache root (e.g. .vendor-build/.model-cache) to run end-to-end embedding tests. See packages/core/src/embedding-vendor.ts.
 ❯ assertLocalModelAvailable packages/core/test/embedding.test.ts:489:11
    487|   const path = process.env[LOCAL_MODEL_PATH_ENV];
    488|   if (!path) {
--
    490|       `Local embedding model not available: ${LOCAL_MODEL_PATH_ENV} is…
    491|         `Set it to ...

LocalProviderUnavailableError: Local embedding provider unavailable: '@huggingface/transformers' failed to initialize. Recall will use FTS-only search. To use a remote provider instead, set search.embeddings.provider to 'voyage' or 'openai' in .lore.json and provide the corresponding API key (VOYAGE_API_KEY / OPENAI_API_KEY).
 ❯ LocalProvider.ensureWorker packages/core/src/embedding.ts:282:13
    280|     if (this.workerReady) return;
    281|     if (this.workerInitError)
    282|       throw new LocalProviderUnavailableError(this.workerInitError);
       |             ^
    283|     if (this.initPromise) return this.initPromise;
    284|
 ❯ LocalProvider.embed packages/core/src/embedding.ts:467:16
 ❯ embed packages/core/src/embedding.ts:749:19
 ❯ packages/core/test/embedding.test.ts:610:24

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[6/7]⎯

 FAIL  packages/opencode/test/gateway-smoke.test.ts > in-process gateway startup > startGateway starts the gateway and responds to health checks
AssertionError: ...

(Use `node --trace-warnings ...` to show where the warning was created)
stderr | packages/core/test/embedding.test.ts > LocalProvider integration > embed produces Float32Array vectors with 768 dimensions
[lore] embedding worker crashed: Error [ERR_MODULE_NOT_FOUND]: Cannot find module '/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types.js' imported from /home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts
    at finalizeResolution (node:internal/modules/esm/resolve:274:11)
    at moduleResolve (node:internal/modules/esm/resolve:864:10)
    at defaultResolve (node:internal/modules/esm/resolve:990:11)
    at #cachedDefaultResolve (node:internal/modules/esm/loader:718:20)
    at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:735:38)
    at ModuleLoader.resolveSync (node:internal/modules/esm/loader:764:52)
    at #resolve (node:internal/modules/esm/loader:700:17)
    at ModuleLoader.getOrCreateModuleJob ...

/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts:25:  isOomError,
/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts:26:  isWasmFatalError,
/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts:31:} from "./embedding-worker-types.js";
/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts:328:        if (!isOomError(raw) || !tokenizer) throw err;
/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts:370:      if (isWasmFatalError(raw)) {
/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts:380:      const msg = isOomError(raw)
/home/byk/Code/opencode-lore/packages/core/src/embedding.ts:21:  isWasmFatalError,
/home/byk/Code/opencode-lore/packages/core/src/embedding.ts:25:} from "./embedding-worker-types";
/home/byk/Code/opencode-lore/packages/core/src/embedding.ts:372:              if (isWasmFatalError(msg.error)) {

/home/byk/Code/opencode-lore/packages/core/package.json
/home/byk/Code/opencode-lore/package.json

    "build": "tsx script/build.ts"

    "tsx": "^4.22.3",

dist
LICENSE
package.json
README.md
tsx installed

v24.13.0

error: Cannot find module '/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types.js' imported from /home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts

error: Cannot find module '/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types.js' imported from /home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts

(no output)

not set

      - uses: actions/setup-node@v6
          node-version: '24'
          node packages/gateway/dist/bin.cjs --version
          node packages/gateway/dist/bin.cjs help
          node packages/gateway/dist/bin.cjs start -p 7990 &
          path: .node-cache
          FOSSILIZE_CACHE_DIR: ${{ github.workspace }}/.node-cache
          FOSSILIZE_CACHE_DIR: ${{ github.workspace }}/.node-cache
      - uses: actions/setup-node@v6
          node-version: '24'

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
320:           filename: join(homedir(), ".cache", "lore", "worker.cjs"),
321:           workerData: workerInitData,
322:         };
323:         this.worker = new Worker(workerSource, opts);
324:       } else {
325:         // npm bundle / dev path: point at a sibling worker file.
326:         let workerUrl: string | URL;
327:         const selfUrl =
328:           typeof import.meta.url === "string" ? import.meta.url : undefined;
329:         if (selfUrl) {
330:           workerUrl = new URL(
331:             `./embedding-worker${selfUrl.endsWith(".ts") ? ".ts" : ".js"}`,
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           workerUrl = new URL(
337:             "./embedding-worker.cjs",
338:             pathToFileURL(__filename),
339:           );
340:         }
341:         this.worker = ...

OK

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
324:       } else {
325:         // npm bundle / dev path: point at a sibling worker file.
326:         let workerUrl: string | URL;
327:         const selfUrl =
328:           typeof import.meta.url === "string" ? import.meta.url : undefined;
329:         if (selfUrl) {
330:           workerUrl = new URL(
331:             `./embedding-worker${selfUrl.endsWith(".ts") ? ".ts" : ".js"}`,
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           workerUrl = new URL(
337:             "./embedding-worker.cjs",
338:             pathToFileURL(__filename),
339:           );
340:         }
341:         const isDevSource =
342:           workerUrl instanceof URL && workerUrl.pathname.endsWith(".ts");
343:         this.worker = new Worker(workerUrl, {
344:           workerData: workerInitData,
345:           ...

(Use `node --trace-warnings ...` to show where the warning was created)

⎯⎯⎯⎯⎯⎯⎯ Failed Tests 1 ⎯⎯⎯⎯⎯⎯⎯

 FAIL  packages/opencode/test/gateway-smoke.test.ts > in-process gateway startup > startGateway starts the gateway and responds to health checks
AssertionError: expected false to be true // Object.is equality

- Expected
+ Received

- true
+ false

 ❯ packages/opencode/test/gateway-smoke.test.ts:50:21
     48|     // sequentially and resolves the OS-assigned port).
     49|     const healthy = await probeGateway(base, 2000);
     50|     expect(healthy).toBe(true);
       |                     ^
     51|
     52|     // Verify the health endpoint returns expected shape.

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[1/1]⎯


 Test Files  1 failed | 81 passed (82)
      Tests  1 failed | 2286 passed (2287)
   Start at  21:31:21
   Duration  121.38s (transform 35.64s, setup 15.77s, import 106.20s, tests 165.80s, environment 32ms)

 ELIFECYCLE  Test failed. See above for more details.

[lore] embedding failed for knowledge entry 019505a1-7c00-7000-8000-aabbccddeeff : LocalProviderUnavailableError: Local embedding provider unavailable: '@huggingface/transformers' failed to initialize. Recall will use FTS-only search. To use a remote provider instead, set search.embeddings.provider to 'voyage' or 'openai' in .lore.json and provide the corresponding API key (VOYAGE_API_KEY / OPENAI_API_KEY).
[lore] embedding failed for knowledge entry 019ea402-5feb-78d1-acbd-7433a06d1b42 : LocalProviderUnavailableError: Local embedding provider unavailable: '@huggingface/transformers' failed to initialize. Recall will use FTS-only search. To use a remote provider instead, set search.embeddings.provider to 'voyage' or 'openai' in .lore.json and provide the corresponding API key (VOYAGE_API_KEY / OPENAI_API_KEY).
 Test Files  2 failed | 80 passed (82)
      Tests  15 failed | 2271 passed (2286)
 ELIFECYCLE  Test failed. See above for more details.

Saved working directory and index state WIP on (no branch): 8291bbf fix(core,gateway): restore bun export conditions for OpenCode plugin (#597)


<shell_metadata>
shell tool terminated command after exceeding timeout 120000 ms. If this command is expected to take longer and is not waiting for interactive input, retry with a larger timeout value in milliseconds.
</shell_metadata>

HEAD detached from 4076721
nothing to commit, working tree clean
---
stash@{0}: WIP on (no branch): 8291bbf fix(core,gateway): restore bun export conditions for OpenCode plugin (#597)
stash@{1}: On codex/social-icons-size: worktree
stash@{2}: On fix/recall-streaming-followup: lore.md updates
stash@{3}: WIP on fix/provider-routing-followups: 99499e3 fix(gateway): provider routing follow-up fixes from post-merge audit
stash@{4}: WIP on fix/provider-id-routing: 4181ed0 feat(gateway): provider-ID-based upstream routing

HEAD detached from 4076721
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   packages/core/src/embedding-worker.ts
	modified:   packages/core/src/embedding.ts
	modified:   packages/core/src/entities.ts
	modified:   packages/core/test/embedding.test.ts
	modified:   packages/core/test/entity-dedup.test.ts
	modified:   packages/gateway/src/ui.ts
---
HEAD detached from 4076721
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   packages/core/src/embedding-worker.ts
	modified:   packages/core/src/embedding.ts
	modified:   packages/core/src/entities.ts
	modified:   packages/core/test/embedding.test.ts
	modified:   packages/core/test/entity-dedup.test.ts
	modified:   packages/gateway/src/ui.ts

no changes added to commit (use "git add" and/or ...

 packages/core/src/embedding-worker.ts   |   2 +-
 packages/core/src/embedding.ts          |   3 +
 packages/core/src/entities.ts           |  25 +++
 packages/core/test/embedding.test.ts    | 294 ++++++++++++++------------------
 packages/core/test/entity-dedup.test.ts |  28 +++
 packages/gateway/src/ui.ts              |  11 +-
 6 files changed, 193 insertions(+), 170 deletions(-)

diff --git a/packages/core/src/entities.ts b/packages/core/src/entities.ts
index 688fa22..dc45a7f 100644
--- a/packages/core/src/entities.ts
+++ b/packages/core/src/entities.ts
@@ -1697,6 +1697,31 @@ export type EntityDedupFeedbackSource =
 const MIN_ENTITY_CALIBRATION_SAMPLES = 20;
 /** Only record auto-signals for pairs with similarity >= this floor. */
 const ENTITY_AUTO_SIGNAL_MIN_SIMILARITY = 0.8;
+/**
+ * Return a Set of "nameA\x1fnameB" keys for entity pairs that have been
+ * explicitly dismissed (accepted=0) via the dashboard. Both orderings are
+ * included so callers can do a single `has()` check.
+ *
+ * Dismissals are name-based; renaming an entity resets its dismiss state
+ * (the old names won't match), which is the correct behavior since the
+ * entity's identity has changed.
+ */
+export function getDismissedEntityPairs(): Set<string> {
+  const rows = db()
+    .query(
+      `SELECT entry_a_title, entry_b_title FROM dedup_feedback
+       WHERE kind = 'entity' AND ...

diff --git a/packages/gateway/src/ui.ts b/packages/gateway/src/ui.ts
index d16159d..f6cc8df 100644
--- a/packages/gateway/src/ui.ts
+++ b/packages/gateway/src/ui.ts
@@ -2797,7 +2797,16 @@ async function pageEntities(): Promise<string> {
       const dupes = await entities.deduplicateEntities(undefined, {
         dryRun: true,
       });
-      const clusters = [...dupes.merged, ...dupes.suggested];
+      // Filter out pairs the user has already dismissed via the dashboard.
+      const dismissed = entities.getDismissedEntityPairs();
+      const clusters = [...dupes.merged, ...dupes.suggested]
+        .map((c) => ({
+          ...c,
+          merged: c.merged.filter(
+            (m) => !dismissed.has(`${m.name}\x1f${c.surviving.name}`),
+          ),
+        }))
+        .filter((c) => c.merged.length > 0);
       if (clusters.length > 0) {
         const pairCount = clusters.reduce((n, c) => n + c.merged.length, 0);
         body += `<div class="banner" style="border:1px solid ...

HEAD detached from 4076721
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   packages/core/src/embedding-worker.ts
	modified:   packages/core/src/embedding.ts
	modified:   packages/core/test/embedding.test.ts

no changes added to commit (use "git add" and/or "git commit -a")

diff --git a/packages/core/src/embedding-worker.ts b/packages/core/src/embedding-worker.ts
index 92a5418..82c02bb 100644
--- a/packages/core/src/embedding-worker.ts
+++ b/packages/core/src/embedding-worker.ts
@@ -28,7 +28,7 @@ import {
   type WorkerOutbound,
   type WorkerInitData,
   type EmbedRequest,
-} from "./embedding-worker-types";
+} from "./embedding-worker-types.js";
 
 // ---------------------------------------------------------------------------
 // workerData

diff --git a/packages/core/src/embedding.ts b/packages/core/src/embedding.ts
index abeb020..04b6d39 100644
--- a/packages/core/src/embedding.ts
+++ b/packages/core/src/embedding.ts
@@ -338,8 +338,11 @@ class LocalProvider implements EmbeddingProvider {
             pathToFileURL(__filename),
           );
         }
+        const isDevSource =
+          workerUrl instanceof URL && workerUrl.pathname.endsWith(".ts");
         this.worker = new Worker(workerUrl, {
           workerData: workerInitData,
+          ...(isDevSource ? { execArgv: ["--import", "tsx/esm"] } : {}),
         });
       }
 

> lore-monorepo@ typecheck /home/byk/Code/opencode-lore
> pnpm -r run typecheck

Scope: 5 of 6 workspace projects
packages/core typecheck$ tsc --noEmit
packages/core typecheck: Done
packages/gateway typecheck$ tsc --noEmit
packages/gateway typecheck: Done
packages/opencode typecheck$ tsc --noEmit
packages/pi typecheck$ tsc --noEmit
packages/opencode typecheck: Done
packages/pi typecheck: Done

   > 99 │         return stmt.all(...((params ?? []) as any)) as T[];
        │                                               ^^^
    100 │       } finally {
    101 │         db.close();
  
  i any disables many type checking rules. Its use should be avoided.
  

Checked 255 files in 3s. No fixes applied.
Found 15 warnings.

> lore-monorepo@ test /home/byk/Code/opencode-lore
> vitest run -- embedding


 RUN  v4.1.8 /home/byk/Code/opencode-lore

(node:1338294) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
(node:1338294) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
(node:1338294) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
terminate called after throwing an instance of 'Napi::Error'
  what():  
Aborted
 ELIFECYCLE  Test failed. See above for more details.

+          ...(isDevSource ? { execArgv: ["--import", "tsx/esm"] } : {}),

      // device: "cpu" — in npm mode, transformers.js uses onnxruntime-node
      // (native CPU). In the compiled binary, onnxruntime-node is redirected
      // to onnxruntime-web by the build plugin, which handles "cpu" via its

  dist/bun/embedding-worker.js      1.7mb ⚠️
  dist/bun/embedding-worker.js.map  1.9mb

⚡ Done in 1080ms
✓ built dist/node/index.js + embedding-worker.js
✓ built dist/bun/index.js + embedding-worker.js
Emitting type declarations...
✓ declarations copied to dist/{node,bun}/
build complete

var __defProp = Object.defineProperty;
var __getOwnPropNames = Object.getOwnPropertyNames;
var __esm = (fn, res) => function __init() {
  return fn && (res = (0, fn[__getOwnPropNames(fn)[0]])(fn = 0)), res;
};

// src/embedding-worker-types.ts

var __defProp = Object.defineProperty;
var __getOwnPropNames = Object.getOwnPropertyNames;
var __esm = (fn, res) => function __init() {
  return fn && (res = (0, fn[__getOwnPropNames(fn)[0]])(fn = 0)), res;
};

// src/embedding-worker-types.ts

156:      // device: "cpu" — in npm mode, transformers.js uses onnxruntime-node
157:      // (native CPU). In the compiled binary, onnxruntime-node is redirected
158:      // to onnxruntime-web by the build plugin, which handles "cpu" via its

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
150:       }
151: 
152:       // Create feature-extraction pipeline with ONNX quantized model.
153:       // dtype: 'q8' selects the INT8 quantized ONNX variant (model_quantized.onnx)
154:       // which is ~137MB for Nomic v1.5 vs ~547MB for the full FP32 model.
155:       //
156:       // device: "cpu" — in npm mode, transformers.js uses onnxruntime-node
157:       // (native CPU). In the compiled binary, onnxruntime-node is redirected
158:       // to onnxruntime-web by the build plugin, which handles "cpu" via its
159:       // WASM+SIMD backend (API-compatible, ~2x faster on batch workloads). ...

-rw-r--r-- 1 byk byk 1811951 Jun  7 21:39 /home/byk/Code/opencode-lore/packages/core/dist/node/embedding-worker.js

OK

---

(no output)

/home/byk/Code/opencode-lore/node_modules/vitest/dist/runtime.js
/home/byk/Code/opencode-lore/node_modules/vitest/dist/nodejs-worker-loader.js
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/worker.d.ZpHpO4yb.d.ts

import { V as VITEST_VM_CONTEXT_SYMBOL, s as startVitestModuleRunner, a as VitestModuleRunner } from './chunks/startVitestModuleRunner.bRl2_oI_.js';
	VITEST_VM_CONTEXT_SYMBOL,

/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/vm.DVLYObm9.js:	process.env.VITEST_VM_POOL = "1";
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/startVitestModuleRunner.bRl2_oI_.js:const VITEST_VM_CONTEXT_SYMBOL = "__vitest_vm_context__";
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/coverage.DM_a_rWm.js:	if (process.env.VITEST_MAX_WORKERS) resolved.maxWorkers = Number.parseInt(process.env.VITEST_MAX_WORKERS);
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/coverage.DM_a_rWm.js:	if (resolved.server.debug?.dump || process.env.VITEST_DEBUG_DUMP) {
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/coverage.DM_a_rWm.js:		const userFolder = resolved.server.debug?.dump || process.env.VITEST_DEBUG_DUMP;

/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/traces.DT5aQ62U.js:					else if (options.watchMode !== true && process.env.VITEST_MODE !== "watch") console.warn(`OpenTelemetry instrumentation module (${options.sdkPath}) does not have a default export with a "shutdown" method. Vitest won't be able to ensure that all traces are processed in time. Try running Vitest in watch mode instead.`);
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/native.DPzPHdi5.js:			const result = nextResolve(isVitest ? specifier.replace(REGEXP_VITEST, "") : specifier, context);
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/index.DXx9Dtk7.js:				stack = (/* @__PURE__ */ new Error("VITEST_DETECT_ASYNC_LEAKS")).stack || "";
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/cli-api.BfdDOPPI.js:	code = "VITEST_FILES_NOT_FOUND";
/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/cli-api.BfdDOPPI.js:	code = "VITEST_GIT_NOT_FOUND";

(no output)

/home/byk/Code/opencode-lore/node_modules/vitest/dist/chunks/cli-api.BfdDOPPI.js:	process.env.VITEST = "true";

WARNING: import line not found, adding manually
OK

346:          const built = new URL("../dist/node/embedding-worker.js", import.meta.url);
347:          if (existsSync(fileURLToPath(built))) {

235: * ONNX inference runs in a dedicated `node:worker_threads` Worker so the
254:  private worker: import("node:worker_threads").Worker | null = null;
289:      const { Worker } = await import("node:worker_threads");

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
1: /**
2:  * Embedding integration for vector search.
3:  *
4:  * Supports multiple embedding providers behind a common interface:
5:  *   - "local" (default): @huggingface/transformers + nomic-embed-text-v1.5
6:  *     (768 dims, Matryoshka-capable). Runs ONNX inference in a worker thread.
7:  *   - "voyage": Voyage AI API (voyage-code-3, 1024 dims)
8:  *   - "openai": OpenAI API (text-embedding-3-small, 1536 dims)
9:  *
10:  * Provides embedding generation, pure-JS cosine similarity, and vector search
11:  * over the knowledge and distillation tables. All operations are gated behind
12:  * `search.embeddings.enabled` config + the provider's API key env var — falls
13:  * back silently to FTS-only when unavailable.
14:  */
15: 
16: import { db } from "./db";
17: import { config } from "./config";
18: import * as log from "./log";
19: import { vendorModelInfo } from ...

OK

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
16: import { existsSync } from "node:fs";
17: import { fileURLToPath } from "node:url";
18: import { db } from "./db";
19: import { config } from "./config";
20: import * as log from "./log";
21: import { vendorModelInfo } from "./embedding-vendor";
22: import {
23:   isWasmFatalError,
24:   type WorkerInbound,
25:   type WorkerOutbound,

(Showing lines 16-25 of 1543. Use offset=26 to continue.)
</content>

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
338:           workerUrl = new URL(
339:             "./embedding-worker.cjs",
340:             pathToFileURL(__filename),
341:           );
342:         }
343:         // In vitest, the worker is spawned from TS source. Node's native ESM
344:         // resolver can load the .ts entry but does not map internal .js imports
345:         // back to .ts files, and spawning under tsx/esm corrupts onnxruntime-node
346:         // (NAPI abort). Point at the pre-built worker in dist/node/ instead.
347:         if (workerUrl instanceof URL && workerUrl.pathname.endsWith(".ts")) {
348:           const built = new URL("../dist/node/embedding-worker.js", import.meta.url);
349:           if (existsSync(fileURLToPath(built))) {
350:             workerUrl = built;
351:           }
352:         }
353:         this.worker = new Worker(workerUrl, {
354:           workerData: workerInitData,
355:        ...

> @loreai/core@0.24.1 typecheck /home/byk/Code/opencode-lore/packages/core
> tsc --noEmit

 ❯ LocalProvider.ensureWorker packages/core/src/embedding.ts:284:13
    282|     if (this.workerReady) return;
    283|     if (this.workerInitError)
    284|       throw new LocalProviderUnavailableError(this.workerInitError);
       |             ^
    285|     if (this.initPromise) return this.initPromise;
    286|
 ❯ LocalProvider.embed packages/core/src/embedding.ts:479:16
 ❯ embed packages/core/src/embedding.ts:761:19
 ❯ packages/core/test/embedding.test.ts:610:24

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[7/7]⎯


 Test Files  2 failed | 80 passed (82)
      Tests  7 failed | 2279 passed (2286)
   Start at  21:43:58
   Duration  111.38s (transform 42.02s, setup 12.37s, import 85.63s, tests 165.32s, environment 33ms)

 ELIFECYCLE  Test failed. See above for more details.

[lore] embedding worker crashed: Error [ERR_MODULE_NOT_FOUND]: Cannot find package 'onnxruntime-node' imported from /home/byk/Code/opencode-lore/packages/core/dist/node/embedding-worker.js
  code: 'ERR_MODULE_NOT_FOUND'
Caused by: Error: Cannot find package 'onnxruntime-node' imported from /home/byk/Code/opencode-lore/packages/core/dist/node/embedding-worker.js
Serialized Error: { code: 'ERR_MODULE_NOT_FOUND' }

NOT installed
not in core

(no output)

(no output)

/home/byk/Code/opencode-lore/node_modules/.bun/onnxruntime-node@1.21.0/node_modules/onnxruntime-node
/home/byk/Code/opencode-lore/node_modules/.pnpm/onnxruntime-node@1.21.0/node_modules/onnxruntime-node

// ../../node_modules/.bun/onnxruntime-common@1.21.0/node_modules/onnxruntime-common/dist/esm/backend-impl.js
  "../../node_modules/.bun/onnxruntime-common@1.21.0/node_modules/onnxruntime-common/dist/esm/backend-impl.js"() {
// ../../node_modules/.bun/onnxruntime-common@1.21.0/node_modules/onnxruntime-common/dist/esm/backend.js
  "../../node_modules/.bun/onnxruntime-common@1.21.0/node_modules/onnxruntime-common/dist/esm/backend.js"() {
// ../../node_modules/.bun/onnxruntime-common@1.21.0/node_modules/onnxruntime-common/dist/esm/version.js

HEAD detached from 4076721
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   packages/core/src/embedding-worker.ts
	modified:   packages/core/test/embedding.test.ts

no changes added to commit (use "git add" and/or "git commit -a")

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types.ts</path>
<type>file</type>
<content>
1: /**
2:  * Shared message types for the embedding worker thread.
3:  *
4:  * The embedding worker (`embedding-worker.ts`) runs ONNX inference via
5:  * `@huggingface/transformers` in a separate `node:worker_threads` Worker
6:  * so the main thread's event loop stays free during inference. This file
7:  * defines the message protocol between the main thread (`LocalProvider`
8:  * in `embedding.ts`) and the worker.
9:  *
10:  * Imported by both sides — keep this file free of runtime dependencies.
11:  */
12: 
13: // ---------------------------------------------------------------------------
14: // Main thread → Worker
15: // ---------------------------------------------------------------------------
16: 
17: /** Request an embedding batch. */
18: export interface EmbedRequest {
19:   type: "embed";
20:   /** Monotonic request ID for correlating responses. ...

<string>:42: SyntaxWarning: invalid escape sequence '\d'
ERROR: marker not found

(no output)

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
55: 
56: /** Maximum number of OOM retry attempts (including the initial full-length
57:  *  try). On OOM the token limit halves each retry: full → 4096 → 2048 → 1024.
58:  *  Three truncated retries covers extreme cases. */
59: const OOM_MAX_RETRIES = 3;
60: 
61: // ---------------------------------------------------------------------------
62: // Model lifecycle — lazy init on first embed request
63: // ---------------------------------------------------------------------------
64: 
65: /** The transformers.js pipeline instance, typed loosely since the exact
66:  *  return type depends on the pipeline task. */
67: type FeatureExtractionPipeline = {
68:   (
69:     texts: string[],
70:     options?: Record<string, unknown>,
71:   ): Promise<{
72:     dims: number[];
73:     data: Float32Array;
74:     tolist(): number[][];

(Showing lines 55-74 of 408. Use offset=75 to ...

OK

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
22: 
23: import { parentPort, workerData } from "node:worker_threads";
24: import {
25:   type WorkerInbound,
26:   type WorkerOutbound,
27:   type WorkerInitData,
28:   type EmbedRequest,
29: } from "./embedding-worker-types";
30: 
31: // ---------------------------------------------------------------------------
32: // workerData
33: // ---------------------------------------------------------------------------
34: 
35: // This module is only ever loaded as a worker thread entry point, so
36: // `parentPort` is always present. Capture it into a non-null local and fail
37: // fast otherwise.
38: if (!parentPort) {
39:   throw new Error("embedding-worker must be run as a worker thread");
40: }
41: const port = parentPort;
42: 
43: const { modelId, dimensions, vendorModel } = workerData as WorkerInitData;
44: 
45: /**
46:  * Token ceiling used when retrying after an ONNX OOM. ...

> @loreai/core@0.24.1 typecheck /home/byk/Code/opencode-lore/packages/core
> tsc --noEmit

- true
+ false

 ❯ packages/opencode/test/gateway-smoke.test.ts:50:21
     48|     // sequentially and resolves the OS-assigned port).
     49|     const healthy = await probeGateway(base, 2000);
     50|     expect(healthy).toBe(true);
       |                     ^
     51|
     52|     // Verify the health endpoint returns expected shape.

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[7/7]⎯


 Test Files  2 failed | 80 passed (82)
      Tests  7 failed | 2279 passed (2286)
   Start at  21:51:28
   Duration  104.60s (transform 32.46s, setup 13.90s, import 86.90s, tests 148.44s, environment 70ms)

 ELIFECYCLE  Test failed. See above for more details.

[lore] embedding worker crashed: Error [ERR_MODULE_NOT_FOUND]: Cannot find module '/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types' imported from /home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts
  code: 'ERR_MODULE_NOT_FOUND',
Caused by: Error: Cannot find module '/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types' imported from /home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts
Serialized Error: { code: 'ERR_MODULE_NOT_FOUND', url: 'file:///home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types' }

(no output)

<path>/home/byk/Code/opencode-lore/tsconfig.base.json</path>
<type>file</type>
<content>
1: {
2:   "compilerOptions": {
3:     "target": "ESNext",
4:     "module": "ESNext",
5:     "moduleResolution": "bundler",
6:     "strict": true,
7:     "esModuleInterop": true,
8:     "skipLibCheck": true,
9:     "declaration": true,
10:     "types": []
11:   }
12: }

(End of file - total 12 lines)
</content>

error: Unexpected token '{'

loaded: [ 'isOomError', 'isWasmFatalError' ]

error: Cannot find module '/home/byk/Code/opencode-lore/packages/core/src/embedding-worker-types' imported from /home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts

error: Unexpected token '{'

ok 42

node:internal/modules/esm/resolve:274
    throw new ERR_MODULE_NOT_FOUND(
          ^

Error [ERR_MODULE_NOT_FOUND]: Cannot find module '/tmp/nonexistent-file.ts' imported from /tmp/test-type-prefix.ts
    at finalizeResolution (node:internal/modules/esm/resolve:274:11)
    at moduleResolve (node:internal/modules/esm/resolve:864:10)
    at defaultResolve (node:internal/modules/esm/resolve:990:11)
    at #cachedDefaultResolve (node:internal/modules/esm/loader:718:20)
    at #resolveAndMaybeBlockOnLoaderThread (node:internal/modules/esm/loader:735:38)
    at ModuleLoader.resolveSync (node:internal/modules/esm/loader:764:52)
    at #resolve (node:internal/modules/esm/loader:700:17)
    at ModuleLoader.getOrCreateModuleJob (node:internal/modules/esm/loader:620:35)
    at ModuleJob.syncLink (node:internal/modules/esm/module_job:143:33)
    at ModuleJob.link (node:internal/modules/esm/module_job:228:17) {
  code: 'ERR_MODULE_NOT_FOUND',
  url: 'file:///tmp/nonexistent-file.ts'
}

Node.js ...

OK

> @loreai/core@0.24.1 typecheck /home/byk/Code/opencode-lore/packages/core
> tsc --noEmit

     49|     const healthy = await probeGateway(base, 2000);
     50|     expect(healthy).toBe(true);
       |                     ^
     51|
     52|     // Verify the health endpoint returns expected shape.

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[1/1]⎯


 Test Files  1 failed | 81 passed (82)
      Tests  1 failed | 2285 passed (2286)
   Start at  21:57:50
   Duration  108.44s (transform 36.94s, setup 13.35s, import 91.90s, tests 150.43s, environment 27ms)

 ELIFECYCLE  Test failed. See above for more details.

 ❯ packages/opencode/test/gateway-smoke.test.ts (4 tests | 1 failed) 14010ms
 ❯ packages/core/test/embedding.test.ts (38 tests | 6 skipped) 922ms
 ELIFECYCLE  Test failed. See above for more details.

(no output)

(no output)

> lore-monorepo@ test /home/byk/Code/opencode-lore
> vitest run -- embedding.test


 RUN  v4.1.8 /home/byk/Code/opencode-lore

(node:1355386) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
(node:1355386) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
(node:1355386) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
 ❯ packages/opencode/test/gateway-smoke.test.ts (4 tests | 1 failed) 13680ms
     × startGateway starts the gateway and responds to health checks 12769ms
(node:1355386) ExperimentalWarning: SQLite is an experimental feature and might change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
 ❯ ...

⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯[1/1]⎯


 Test Files  1 failed | 81 passed (82)
      Tests  1 failed | 2285 passed (2286)
   Start at  22:04:01
   Duration  89.94s (transform 26.25s, setup 11.03s, import 70.20s, tests 136.33s, environment 38ms)

 ELIFECYCLE  Test failed. See above for more details.

  i any disables many type checking rules. Its use should be avoided.
  

Checked 255 files in 3s. No fixes applied.
Found 15 warnings.

Scope: 5 of 6 workspace projects
packages/core typecheck$ tsc --noEmit
packages/core typecheck: Done
packages/gateway typecheck$ tsc --noEmit
packages/gateway typecheck: Done
packages/opencode typecheck$ tsc --noEmit
packages/pi typecheck$ tsc --noEmit
packages/opencode typecheck: Done
packages/pi typecheck: Done

 packages/core/src/embedding-worker.ts |  36 ++++-
 packages/core/test/embedding.test.ts  | 294 +++++++++++++++-------------------
 2 files changed, 155 insertions(+), 175 deletions(-)

diff --git a/packages/core/src/embedding-worker.ts b/packages/core/src/embedding-worker.ts
index 92a5418..66a5e73 100644
--- a/packages/core/src/embedding-worker.ts
+++ b/packages/core/src/embedding-worker.ts
@@ -21,13 +21,11 @@
  */
 
 import { parentPort, workerData } from "node:worker_threads";
-import {
-  isOomError,
-  isWasmFatalError,
-  type WorkerInbound,
-  type WorkerOutbound,
-  type WorkerInitData,
-  type EmbedRequest,
+import type {
+  WorkerInbound,
+  WorkerOutbound,
+  WorkerInitData,
+  EmbedRequest,
 } from "./embedding-worker-types";
 
 // ---------------------------------------------------------------------------
@@ -58,6 +56,30 @@ const OOM_RETRY_START_TOKENS = 4096;
  *  Three truncated retries covers extreme cases. */
 const OOM_MAX_RETRIES = 3;
 
+// ---------------------------------------------------------------------------
+// Error classifiers — inlined to keep the worker self-contained. ...

diff --git a/packages/core/test/embedding.test.ts b/packages/core/test/embedding.test.ts
index 22837c9..0a6a6f0 100644
--- a/packages/core/test/embedding.test.ts
+++ b/packages/core/test/embedding.test.ts
@@ -4,9 +4,12 @@ import {
   describe,
   test,
   expect,
+  beforeAll,
   beforeEach,
 } from "vitest";
+import { existsSync } from "node:fs";
 import { db, ensureProject } from "../src/db";
+import { LOCAL_MODEL_PATH_ENV } from "../src/embedding-vendor";
 import {
   cosineSimilarity,
   toBlob,
@@ -480,190 +483,145 @@ describe("vectorSearchEntities", () => {
   });
 });
 
-let loggedModelSkip = false;
-
-/**
- * Run a model-dependent test body, tolerating an unavailable local model.
- *
- * In CI the model is vendored and `LORE_LOCAL_MODEL_PATH` points at it, so the
- * body runs normally. In local dev (or a CI cache miss) the model is fetched
- * from HuggingFace Hub on first use — which can fail transiently (429) or be
- * unavailable offline. ...

<path>/home/byk/Code/opencode-lore/.opencode/plans/1780865688932-sunny-comet.md</path>
<type>file</type>
<content>
1: # Fix: Embedding worker init fails in vitest (Node.js ESM extensionless imports)
2: 
3: Closes [#606](https://github.com/BYK/loreai/issues/606).
4: 
5: ## Root cause
6: 
7: `packages/core/src/embedding-worker.ts:31` has an extensionless relative import:
8: 
9: ```ts
10: } from "./embedding-worker-types";

(Showing lines 1-10 of 117. Use offset=11 to continue.)
</content>

<path>/home/byk/Code/opencode-lore/.opencode/plans/1780865688932-sunny-comet.md</path>
<type>file</type>
<content>
1: # Fix: Embedding worker init fails in vitest (Node.js ESM extensionless imports)
2: 
3: Closes [#606](https://github.com/BYK/loreai/issues/606).
4: 
5: ## Root cause
6: 
7: `packages/core/src/embedding-worker.ts:31` has an extensionless relative import:
8: 
9: ```ts
10: } from "./embedding-worker-types";
11: ```
12: 
13: This works in Bun and esbuild (which resolve extensionless `.ts` imports transparently) but fails with `ERR_MODULE_NOT_FOUND` when the worker is spawned from TS source under vitest. The vitest config uses `pool: "threads"` (`vitest.config.ts:19`), which loads the worker file as Node.js ESM — and Node's runtime resolver requires an explicit extension.
14: 
15: The error surfaces as `LocalProviderUnavailableError` and is silently swallowed by the `withLocalModel` wrapper at `packages/core/test/embedding.test.ts:483-516`, masking the real bug behind 6 ...

Wrote file successfully.

> lore-monorepo@ build /home/byk/Code/opencode-lore
> pnpm -r run build

Scope: 5 of 6 workspace projects
packages/core build$ tsx script/build.ts
packages/website build$ astro build
packages/website build: sh: 1: astro: not found
/home/byk/Code/opencode-lore/packages/website:
 ERR_PNPM_RECURSIVE_RUN_FIRST_FAIL  @loreai/website@ build: `astro build`
spawn ENOENT
 WARN   Local package.json exists, but node_modules missing, did you mean to install?
 ELIFECYCLE  Command failed with exit code 1.

✓ built dist/node/index.js + embedding-worker.js

  dist/bun/embedding-worker.js      1.7mb ⚠️
  dist/bun/embedding-worker.js.map  1.9mb

⚡ Done in 811ms
✓ built dist/bun/index.js + embedding-worker.js
Emitting type declarations...
✓ declarations copied to dist/{node,bun}/
build complete
---

> @loreai/gateway@0.24.1 build /home/byk/Code/opencode-lore/packages/gateway
> tsx script/build.ts

  embedding-worker.js: skipped (real bundle exists)
✓ @loreai/gateway: dev shims ready (use `bun run bundle` for npm build)

function isOomError(msg) {
function isWasmFatalError(msg) {
  if (isOomError(msg)) return true;

(no output)

/home/byk/Code/opencode-lore/.git:
total 124
drwxr-xr-x 1 byk byk   520 Jun  7 22:09 .
drwxr-xr-x 1 byk byk   578 Jun  7 14:19 ..
-rw-r--r-- 1 byk byk    41 May  9 11:46 18d2c92f2cccbf3d595dabc2303d662c14e57d0e

HEAD detached from 4076721
Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   packages/core/src/embedding-worker.ts
	modified:   packages/core/test/embedding.test.ts

no changes added to commit (use "git add" and/or "git commit -a")
---
---
8291bbf fix(core,gateway): restore bun export conditions for OpenCode plugin (#597)
7fe80db feat(website): Migrate website to Astro (#559)
75f1ce4 fix(gateway): decouple worker wire protocol from provider identity (#596)
4076721 fix(entities): fix self/person merge, dashboard UX, and alias copy bug (#595)
96a2cf2 fix(gateway,core): protocol-safe worker routing + atomic tool_use/tool_result on eviction (#594)

Switched to a new branch 'fix/issue-606-embedding-worker'

 M packages/core/src/embedding-worker.ts
 M packages/core/test/embedding.test.ts

(no output)

> @loreai/core@0.24.1 typecheck /home/byk/Code/opencode-lore/packages/core
> tsc --noEmit

---
      Tests  1 failed | 2285 passed (2286)
   Start at  22:10:35
   Duration  108.90s (transform 38.56s, setup 13.88s, import 90.33s, tests 160.17s, environment 70ms)

 ELIFECYCLE  Test failed. See above for more details.

[fix/issue-606-embedding-worker 97eb926] fix(core): inline embedding worker classifiers to fix vitest init
 2 files changed, 155 insertions(+), 175 deletions(-)

remote: 
remote: Create a pull request for 'fix/issue-606-embedding-worker' on GitHub by visiting:        
remote:      https://github.com/BYK/loreai/pull/new/fix/issue-606-embedding-worker        
remote: 
remote: GitHub found 1 vulnerability on BYK/loreai's default branch (1 moderate). To find out more, visit:        
remote:      https://github.com/BYK/loreai/security/dependabot/2        
remote: 
To https://github.com/BYK/loreai.git
 * [new branch]      fix/issue-606-embedding-worker -> fix/issue-606-embedding-worker
branch 'fix/issue-606-embedding-worker' set up to track 'origin/fix/issue-606-embedding-worker'.

/usr/bin/bash: line 1: .ts: command not found
/usr/bin/bash: line 1: .js: command not found
/usr/bin/bash: line 1: .ts: command not found
/usr/bin/bash: line 1: ERR_MODULE_NOT_FOUND: command not found
/usr/bin/bash: line 1: ./embedding-worker-types: No such file or directory
/usr/bin/bash: line 1: LocalProviderUnavailableError: command not found
/usr/bin/bash: command substitution: line 2: syntax error: unexpected end of file
/usr/bin/bash: line 1: embedding.test.ts: command not found
/usr/bin/bash: line 1: packages/core/src/embedding-worker.ts: Permission denied
import-im6.q16: unable to open X server `' @ error/import.c/ImportImageCommand/346.
/usr/bin/bash: line 1: isOomError: command not found
/usr/bin/bash: line 1: isWasmFatalError: command not found
/usr/bin/bash: line 1: embedding-worker-types.ts: command not found
/usr/bin/bash: line 1: embedding.ts: command not found
/usr/bin/bash: line 1: packages/core/test/embedding.test.ts: Permission denied
/usr/bin/bash: line 1: ...

Wrote file successfully.

https://github.com/BYK/loreai/pull/613

no checks reported on the 'fix/issue-606-embedding-worker' branch

{"statusCheckRollup":[]}

completed	failure	fix(core): inline embedding worker classifiers to fix vitest init	Lore Eval Suite	fix/issue-606-embedding-worker	push	27106368528	0s	2026-06-07T22:12:47Z

X fix/issue-606-embedding-worker Lore Eval Suite BYK/loreai#613 · 27106368528
Triggered via push about 2 minutes ago

X This run likely failed because of a workflow file issue.

For more information, see: https://github.com/BYK/loreai/actions/runs/27106368528

failed to get run log: log not found

{"conclusion":"failure","jobs":[]}

{"state":"OPEN","statusCheckRollup":[],"title":"fix(core): inline embedding worker classifiers to fix vitest init","url":"https://github.com/BYK/loreai/pull/613"}

cch-seed-check.yml
ci.yml
cleanup-nightlies.yml
docs-preview.yml
eval.yml
publish.yml
release.yml

completed	failure	fix(core): inline embedding worker classifiers to fix vitest init	Lore Eval Suite	fix/issue-606-embedding-worker	push	27106368528	0s	2026-06-07T22:12:47Z

on:
  pull_request:
  # Change detection: skip heavy CI for docs-only changes
    runs-on: ubuntu-latest
    runs-on: ubuntu-latest
      nightly-version: ${{ steps.nightly.outputs.version }}
          node-version: '24'
          echo "Current version: ${CURRENT}"
          echo "Nightly version: ${VERSION} (bump: ${BUMP_TYPE}, from: ${CURRENT})"
            runs-on: macos-14

completed	success	fix(gateway): use fossilize programmatic API instead of impl-* glob d…	CI	main	push	27105496112	6m56s	2026-06-07T21:35:12Z
completed	success	fix(gateway): remove cache fields from ZERO_USAGE and consolidate SSE…	CI	main	push	27105426059	7m22s	2026-06-07T21:32:19Z
completed	success	ci: add actionlint to catch workflow YAML errors (#612)	CI	main	push	27105387637	6m47s	2026-06-07T21:30:45Z
completed	success	fix(gateway): use fossilize programmatic API instead of impl-* glob dance	CI	fix/gateway-use-fossilize-programmatic-api	pull_request	27105372686	3m34s	2026-06-07T21:30:10Z
completed	success	fix(gateway): remove cache fields from ZERO_USAGE and consolidate SSE extraction	CI	fix/review-followups	pull_request	27105321885	3m58s	2026-06-07T21:28:03Z

(no output)

(no output)

{"mergeStateStatus":"DIRTY","mergeable":"CONFLICTING"}

From https://github.com/BYK/loreai
 * branch            main       -> FETCH_HEAD
Rebasing (1/1)
Auto-merging packages/core/test/embedding.test.ts
CONFLICT (content): Merge conflict in packages/core/test/embedding.test.ts
error: could not apply 97eb926... fix(core): inline embedding worker classifiers to fix vitest init
hint: Resolve all conflicts manually, mark them as resolved with
hint: "git add/rm <conflicted_files>", then run "git rebase --continue".
hint: You can instead skip this commit: run "git rebase --skip".
hint: To abort and get back to the state before "git rebase", run "git rebase --abort".
Could not apply 97eb926... fix(core): inline embedding worker classifiers to fix vitest init

diff --cc packages/core/test/embedding.test.ts
index 234b129,0a6a6f0..0000000
--- a/packages/core/test/embedding.test.ts
+++ b/packages/core/test/embedding.test.ts
@@@ -480,41 -483,20 +483,58 @@@ describe("vectorSearchEntities", () => 
    });
  });
  
++<<<<<<< HEAD
 +let loggedModelSkip = false;
 +
 +/**
 + * Run a model-dependent test body, tolerating an unavailable local model.
 + *
 + * In CI the model is vendored and `LORE_LOCAL_MODEL_PATH` points at it, so the
 + * body runs normally. When the body throws `LocalProviderUnavailableError` we
 + * SKIP rather than hard-fail, because the underlying worker init has a
 + * known pre-existing test-infra limitation: the source worker at
 + * `packages/core/src/embedding-worker.ts` does extensionless relative imports
 + * (e.g. `./embedding-worker-types`) that Node.js ESM cannot resolve when the
 + * worker thread is spawned from source. This is unrelated to test correctness
 + * — it surfaces whenever the dev path is taken. ...

Updated 1 path from the index
error: Terminal is dumb, but EDITOR unset
Please supply the message using either -m or -F option.
error: could not commit staged changes.

[detached HEAD 71b0ed1] fix(core): inline embedding worker classifiers to fix vitest init
 2 files changed, 155 insertions(+), 173 deletions(-)

                                                                                
Successfully rebased and updated refs/heads/fix/issue-606-embedding-worker.

remote: 
remote: GitHub found 1 vulnerability on BYK/loreai's default branch (1 moderate). To find out more, visit:        
remote:      https://github.com/BYK/loreai/security/dependabot/2        
remote: 
To https://github.com/BYK/loreai.git
 + 97eb926...71b0ed1 fix/issue-606-embedding-worker -> fix/issue-606-embedding-worker (forced update)

{"mergeStateStatus":"BLOCKED","mergeable":"MERGEABLE","statusCheckRollup":[{"__typename":"CheckRun","completedAt":"0001-01-01T00:00:00Z","conclusion":"","detailsUrl":"https://github.com/BYK/loreai/actions/runs/27106479108/job/79996432499","name":"preview","startedAt":"2026-06-07T22:17:46Z","status":"IN_PROGRESS","workflowName":"Docs Preview"},{"__typename":"CheckRun","completedAt":"2026-06-07T22:17:52Z","conclusion":"SUCCESS","detailsUrl":"https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432449","name":"changes","startedAt":"2026-06-07T22:17:46Z","status":"COMPLETED","workflowName":"CI"},{"__typename":"CheckRun","completedAt":"2026-06-07T22:17:55Z","conclusion":"SUCCESS","detailsUrl":"https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432444","name":"actionlint","startedAt":"2026-06-07T22:17:46Z","status":"COMPLETED","workflowName":"CI"},{"__typename":"CheckRun","completedAt":"0001-01-01T00:00:00Z","conclusion":"","detailsUrl":"https://github.com/BYK/loreai/...

Refreshing checks status every 10 seconds. Press Ctrl+C to quit.

test	pending	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996439775	
actionlint	pass	9s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432444	
changes	pass	6s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432449	
preview	pass	18s	https://github.com/BYK/loreai/actions/runs/27106479108/job/79996432499	
Refreshing checks status every 10 seconds. Press Ctrl+C to quit.

test	pending	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996439775	
actionlint	pass	9s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432444	
changes	pass	6s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432449	
preview	pass	18s	https://github.com/BYK/loreai/actions/runs/27106479108/job/79996432499	
Refreshing checks status every 10 seconds. Press Ctrl+C to ...

X fix/issue-606-embedding-worker CI BYK/loreai#613 · 27106479104
Triggered via pull_request about 1 minute ago

X test in 1m4s (ID 79996439775)
  ✓ Set up job
  ✓ Run actions/checkout@v6
  ✓ Run pnpm/action-setup@v4
  ✓ Run actions/setup-node@v6
  ✓ Run pnpm install --frozen-lockfile
  ✓ Run pnpm run build
  ✓ Restore vendor staging
  - Populate vendor staging (cache miss)
  ✓ Typecheck
  ✓ Lint
  X Test
  - Fetch commits since last release
  - Install Craft CLI
  - Compute nightly version
  - Build npm bundle (CJS)

test	Test	2026-06-07T22:18:36.6009981Z  ^[[32m✓^[[39m packages/gateway/test/cache-warmer.test.ts ^[[2m(^[[22m^[[2m126 tests^[[22m^[[2m)^[[22m^[[32m 215^[[2mms^[[22m^[[39m
test	Test	2026-06-07T22:18:37.6015647Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: discards distillation when output > expansion limit, marks messages distilled
test	Test	2026-06-07T22:18:37.6046587Z ^[[22m^[[39m[lore] WARN: distill expansion discarded: 6 msgs, 1200→1201 tokens (exceeds 1200 limit)
test	Test	2026-06-07T22:18:37.6065645Z 
test	Test	2026-06-07T22:18:37.6187484Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: stores distillation when output < input tokens
test	Test	2026-06-07T22:18:37.6286451Z ^[[22m^[[39m[lore] distill segment: 6 msgs, 1200→100 tokens, R=2.89, ...

test	Run pnpm install --frozen-lockfile	2026-06-07T22:18:08.0975295Z . postinstall:   embedding-worker.js: dev shim created
test	Run pnpm install --frozen-lockfile	2026-06-07T22:18:08.1349271Z │   onnxruntime-node@1.21.0, protobufjs@7.6.2.                                 │
test	Run pnpm run build	2026-06-07T22:18:09.5311804Z packages/core build:   dist/bun/embedding-worker.js      1.7mb ⚠️
test	Run pnpm run build	2026-06-07T22:18:09.5318181Z packages/core build:   dist/bun/embedding-worker.js.map  1.9mb
test	Run pnpm run build	2026-06-07T22:18:09.5320576Z packages/core build: ✓ built dist/bun/index.js + embedding-worker.js
test	Run pnpm run build	2026-06-07T22:18:09.5376670Z packages/core build:   dist/node/embedding-worker.js      1.7mb ⚠️
test	Run pnpm run build	2026-06-07T22:18:09.5405910Z packages/core build:   dist/node/embedding-worker.js.map  1.9mb
test	Run pnpm run build	2026-06-07T22:18:09.5420274Z packages/core build: ✓ built dist/node/index.js + embedding-worker.js
test	Run ...

test	Run pnpm install --frozen-lockfile	2026-06-07T22:18:08.0975295Z . postinstall:   embedding-worker.js: dev shim created
test	Run pnpm install --frozen-lockfile	2026-06-07T22:18:08.1349271Z │   onnxruntime-node@1.21.0, protobufjs@7.6.2.                                 │
test	Run pnpm run build	2026-06-07T22:18:09.5311804Z packages/core build:   dist/bun/embedding-worker.js      1.7mb ⚠️
test	Run pnpm run build	2026-06-07T22:18:09.5318181Z packages/core build:   dist/bun/embedding-worker.js.map  1.9mb
test	Run pnpm run build	2026-06-07T22:18:09.5320576Z packages/core build: ✓ built dist/bun/index.js + embedding-worker.js
test	Run pnpm run build	2026-06-07T22:18:09.5376670Z packages/core build:   dist/node/embedding-worker.js      1.7mb ⚠️
test	Run pnpm run build	2026-06-07T22:18:09.5405910Z packages/core build:   dist/node/embedding-worker.js.map  1.9mb
test	Run pnpm run build	2026-06-07T22:18:09.5420274Z packages/core build: ✓ built dist/node/index.js + embedding-worker.js
test	Run ...

test	Test	2026-06-07T22:18:36.1185321Z ^[[90mstderr^[[2m | packages/core/test/gradient.test.ts^[[2m > ^[[22m^[[2mreasoning preservation (F-REASONING-AUDIT mini-pin)^[[2m > ^[[22m^[[2mlayer 0 preserves reasoning parts unchanged
test	Test	2026-06-07T22:18:36.1189771Z ^[[90mstderr^[[2m | packages/core/test/gradient.test.ts^[[2m > ^[[22m^[[2mgradient — distillation snapshot caching^[[2m > ^[[22m^[[2mconsecutive transforms with same user message reuse cached distillation rows
test	Test	2026-06-07T22:18:36.1202127Z ^[[90mstderr^[[2m | packages/core/test/gradient.test.ts^[[2m > ^[[22m^[[2mgradient — distillation snapshot caching^[[2m > ^[[22m^[[2mnew user message triggers distillation refresh
test	Test	2026-06-07T22:18:36.1216793Z ^[[90mstderr^[[2m | packages/core/test/gradient.test.ts^[[2m > ^[[22m^[[2mgradient — distillation snapshot caching^[[2m > ^[[22m^[[2monIdleResume clears distillation snapshot
test	Test	2026-06-07T22:18:36.1225520Z ^[[90mstderr^[[2m | ...

CI Status	fail	2s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996503363	
test	fail	1m4s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996439775	
Binary smoke (${{ matrix.target }})	skipping	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996503396	
Build Nightly Binaries	skipping	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996503409	
Generate Delta Patches	skipping	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996503669	
Generate Release Patches	skipping	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996503605	
Publish Nightly to GHCR	skipping	0	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996503769	
actionlint	pass	9s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432444	
changes	pass	6s	https://github.com/BYK/loreai/actions/runs/27106479104/job/79996432449	
preview	pass	18s	https://github.com/BYK/loreai/actions/runs/27106479108/job/79996432499	

(no output)

<shell_metadata>
shell tool terminated command after exceeding timeout 120000 ms. If this command is expected to take longer and is not waiting for interactive input, retry with a larger timeout value in milliseconds.
</shell_metadata>

/home/byk/Code/opencode-lore/packages/gateway/test/cache-warmer.test.ts

(no output)

(no output)

test	Run pnpm install --frozen-lockfile	2026-06-07T22:18:08.1349271Z │   onnxruntime-node@1.21.0, protobufjs@7.6.2.                                 │
test	Test	2026-06-07T22:18:34.3755769Z   dist/embedding-worker.cjs — embedding worker CJS (Node.js)
test	Test	2026-06-07T22:18:34.3757174Z   dist/embedding-worker.js  — embedding worker ESM (Bun)
test	Test	2026-06-07T22:18:37.8921200Z  5: 0x7f6738ca52ab OrtValueToNapiValue(Napi::Env, Ort::Value&&) [/home/runner/work/loreai/loreai/node_modules/.pnpm/onnxruntime-node@1.21.0/node_modules/onnxruntime-node/bin/napi-v3/linux/x64/onnxruntime_binding.node]
test	Test	2026-06-07T22:18:37.8923631Z  6: 0x7f6738c9178d InferenceSessionWrap::Run(Napi::CallbackInfo const&) [/home/runner/work/loreai/loreai/node_modules/.pnpm/onnxruntime-node@1.21.0/node_modules/onnxruntime-node/bin/napi-v3/linux/x64/onnxruntime_binding.node]
test	Test	2026-06-07T22:18:37.8927441Z  7: 0x7f6738c935a2 ...

(no output)

rg: unrecognized flag --include

similar flags that are available: --include-zero

(no output)

(no output)

(no output)

(no output)

(no output)

test	Test	2026-06-07T22:18:34.3755769Z   dist/embedding-worker.cjs — embedding worker CJS (Node.js)
test	Test	2026-06-07T22:18:34.3757174Z   dist/embedding-worker.js  — embedding worker ESM (Bun)

import { describe, test, expect, beforeEach } from "vitest";
import {
import type {
import { compressBody } from "../src/cache-analytics";
import {
import { db, projectId } from "@loreai/core";

import { db, projectId } from "@loreai/core";

import { describe, test, expect, beforeEach } from "vitest";
import {
  createHistogram,
  recordGap,
  survivalFunction,
  conditionalReturnProbability,
  blendHistograms,
  prepareAnthropicWarmupBody,
  buildAnthropicProfile,
  shouldWarm,
  checkCircuitBreaker,
  isCircuitBreakerTripped,
  isWarmupAuthDisabled,
  clearWarmupAuthDisabled,
  breakFraction,
  pSessionFinished,
  expectedWarmupCycles,
  costThreshold,
  cumulativeCostThreshold,
  maxProfitableCycles,
  MAX_TOOL_CALL_WARMING_MS,
  MIN_WARMUPS_FOR_ROI_CHECK,
  MIN_RETURN_PROBABILITY_FLOOR,
  TOOL_CALL_MAX_CYCLES,
  HISTOGRAM_BINS,
  BREAK_FLOOR_MS,
  _resetForTest,
} from "../src/cache-warmer";
import type {
  SessionState,

(no output)

(no output)

(no output)

test	Test	2026-06-07T22:18:37.6771894Z ^[[22m^[[39m[lore] WARN: distill expansion discarded: 1 msgs, 80→401 tokens (exceeds 400 limit)
test	Test	2026-06-07T22:18:37.6799948Z 
test	Test	2026-06-07T22:18:37.6828948Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: small segment (100-499 tokens) allows up to 2x expansion
test	Test	2026-06-07T22:18:37.6876031Z ^[[22m^[[39m[lore] distill segment: 2 msgs, 300→550 tokens, R=31.75, C_norm=0.000
test	Test	2026-06-07T22:18:37.6905467Z 
test	Test	2026-06-07T22:18:37.6919014Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mtiny segment: absorbed (mark distilled) in force mode without LLM call
test	Test	2026-06-07T22:18:37.6923283Z ^[[22m^[[39m[lore] absorb tiny segment: 2 msgs, 20 tokens (below min 64)
test	Test	2026-06-07T22:18:37.6923880Z ...

(no output)

import {
import type {
import { decompressBody } from "./cache-analytics";
import { resolveAuth, authHeaders, markAuthStale } from "./auth";
import { resignBody } from "./cch";
import { resolveUpstreamRoute } from "./config";
import { getModelEntrySync } from "./worker-model";
import { recordWarmupCost } from "./cost-tracker";
import { upstreamFetch } from "./fetch";

/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts
/home/byk/Code/opencode-lore/packages/core/test/embedding-vendor.test.ts
/home/byk/Code/opencode-lore/packages/core/test/ltm.test.ts

    // vectorSearch / promotion queries are unscoped — wipe ALL knowledge so

import * as embedding from "./embedding";
        embeddingMap.set(row.id, embedding.fromBlob(row.embedding));
        embeddingMap.set(row.id, embedding.fromBlob(row.embedding));

test	Test	2026-06-07T22:18:37.6015647Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: discards distillation when output > expansion limit, marks messages distilled
test	Test	2026-06-07T22:18:37.6187484Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: stores distillation when output < input tokens
test	Test	2026-06-07T22:18:37.6497575Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: exact equal size passes for large segments (limit = sourceTokens)
test	Test	2026-06-07T22:18:37.6627000Z ^[[90mstderr^[[2m | packages/core/test/distillation.test.ts^[[2m > ^[[22m^[[2mrun() expansion guard and tiny-segment handling^[[2m > ^[[22m^[[2mexpansion guard: ...

(no output)

import * as embedding from "./embedding";

    embedding.embedDistillation(distillId, result.observations);
    embedding.embedDistillation(metaId, result.observations);

[fix/issue-606-embedding-worker 24d554b] ci: re-run tests
remote: 
remote: GitHub found 1 vulnerability on BYK/loreai's default branch (1 moderate). To find out more, visit:        
remote:      https://github.com/BYK/loreai/security/dependabot/2        
remote: 
To https://github.com/BYK/loreai.git

test	pending	0	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997229515	
actionlint	pass	5s	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997217284	
changes	pass	7s	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997217289	
preview	pass	19s	https://github.com/BYK/loreai/actions/runs/27106764452/job/79997217297	

Refreshing checks status every 10 seconds. Press Ctrl+C to quit.

test	pending	0	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997229515	
actionlint	pass	5s	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997217284	
changes	pass	7s	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997217289	
preview	pass	19s	https://github.com/BYK/loreai/actions/runs/27106764452/job/79997217297	
Refreshing checks status every 10 seconds. Press Ctrl+C to quit.

test	pending	0	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997229515	
actionlint	pass	5s	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997217284	
changes	pass	7s	https://github.com/BYK/loreai/actions/runs/27106764464/job/79997217289	
preview	pass	19s	https://github.com/BYK/loreai/actions/runs/27106764452/job/79997217297	
Refreshing checks status every 10 seconds. Press Ctrl+C to ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
105: } | null = null;
106: let layerNormFn:
107:   | ((
108:       input: unknown,
109:       normalized_shape: number[],
110:     ) => {
111:       dims: number[];
112:       data: Float32Array;
113:       normalize(
114:         p: number,
115:         dim: number,
116:       ): { tolist(): number[][]; data: Float32Array; dims: number[] };
117:       slice(...args: unknown[]): {
118:         normalize(
119:           p: number,
120:           dim: number,
121:         ): { tolist(): number[][]; data: Float32Array; dims: number[] };
122:       };
123:     })
124:   | null = null;
125: let initPromise: Promise<void> | null = null;
126: let initFailed = false;
127: let initError: string | null = null;
128: 
129: /**
130:  * Ensure the transformers.js pipeline is loaded. Lazy — first call triggers
131:  * the dynamic import + pipeline creation, subsequent calls return immediately. ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
395:           id: req.id,
396:           error: `WASM fatal error (worker exiting): ${raw}`,
397:         });
398:         process.exit(1);
399:         return; // unreachable, but makes intent clear
400:       }
401: 
402:       const msg = isOomError(raw)
403:         ? `ONNX runtime out of memory after ${OOM_MAX_RETRIES} retries ` +
404:           `(batch=${req.texts.length}, ` +
405:           `longest≈${Math.max(...req.texts.map((t) => t.length))} chars). ` +
406:           `Raw: ${raw}`
407:         : raw;
408:       post({ type: "error", id: req.id, error: msg });
409:     }
410:   }
411: }
412: 
413: // ---------------------------------------------------------------------------
414: // Message handling
415: // ---------------------------------------------------------------------------
416: 
417: function post(msg: WorkerOutbound): void {
418:   ...

test	Run pnpm install --frozen-lockfile	2026-06-07T22:30:50.4711260Z │   onnxruntime-node@1.21.0, protobufjs@7.6.2.                                 │
test	Test	2026-06-07T22:31:21.0103413Z FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
test	Test	2026-06-07T22:31:21.0106061Z  3: 0xc1b45e v8::EscapableHandleScopeBase::EscapableHandleScopeBase(v8::Isolate*) [node]
test	Test	2026-06-07T22:31:21.0109340Z  5: 0x7f70f8b452ab OrtValueToNapiValue(Napi::Env, Ort::Value&&) [/home/runner/work/loreai/loreai/node_modules/.pnpm/onnxruntime-node@1.21.0/node_modules/onnxruntime-node/bin/napi-v3/linux/x64/onnxruntime_binding.node]
test	Test	2026-06-07T22:31:21.0112561Z  6: 0x7f70f8b3178d InferenceSessionWrap::Run(Napi::CallbackInfo const&) [/home/runner/work/loreai/loreai/node_modules/.pnpm/onnxruntime-node@1.21.0/node_modules/onnxruntime-node/bin/napi-v3/linux/x64/onnxruntime_binding.node]
test	Test	2026-06-07T22:31:21.0116241Z  7: 0x7f70f8b335a2 ...

(no output)

test	Test	2026-06-07T22:31:19.9077751Z  ^[[32m✓^[[39m packages/gateway/test/cache-warmer.test.ts ^[[2m(^[[22m^[[2m126 tests^[[22m^[[2m)^[[22m^[[32m 216^[[2mms^[[22m^[[39m
test	Test	2026-06-07T22:31:21.0103413Z FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
test	Test	2026-06-07T22:31:21.0104023Z ----- Native stack trace -----
test	Test	2026-06-07T22:31:21.0104198Z 
test	Test	2026-06-07T22:31:21.0104769Z  1: 0x74499c node::OnFatalError(char const*, char const*) [node]
test	Test	2026-06-07T22:31:21.0105337Z  2: 0xc19aa4  [node]
test	Test	2026-06-07T22:31:21.0106061Z  3: 0xc1b45e v8::EscapableHandleScopeBase::EscapableHandleScopeBase(v8::Isolate*) [node]
test	Test	2026-06-07T22:31:21.0107326Z  4: 0x893e3a napi_open_escapable_handle_scope [node]
test	Test	2026-06-07T22:31:21.0109340Z  5: 0x7f70f8b452ab OrtValueToNapiValue(Napi::Env, Ort::Value&&) ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
340:     let texts = req.texts;
341:     let lastError: Error | undefined;
342: 
343:     for (let attempt = 0; attempt <= OOM_MAX_RETRIES; attempt++) {
344:       try {
345:         const vectors = await runInference(texts);
346:         post({ type: "result", id: req.id, vectors });
347:         return;
348:       } catch (err) {
349:         const raw = err instanceof Error ? err.message : String(err);
350:         if (!isOomError(raw) || !tokenizer) throw err;
351:         lastError = err instanceof Error ? err : new Error(raw);
352: 
353:         // If all texts are already shorter than the smallest retry ceiling
354:         // (1024 tokens ≈ chars at worst-case 1:1 ratio), truncation cannot
355:         // help — the OOM is a model-init/runtime allocation failure, not
356:         // input-size-driven. Throw immediately to reach the fatal exit path. ...

OK

https://github.com/BYK/loreai/pull/613

test	Test	2026-06-07T22:31:21.0119245Z ----- JavaScript stack trace -----
test	Test	2026-06-07T22:31:21.0119576Z 
test	Test	2026-06-07T22:31:21.0120847Z 1: /home/runner/work/loreai/loreai/node_modules/.pnpm/onnxruntime-node@1.21.0/node_modules/onnxruntime-node/dist/backend.js:48:108
test	Test	2026-06-07T22:31:21.0122154Z 2: processImmediate (node:internal/timers:504:21)
test	Test	2026-06-07T22:31:21.0122561Z 

"use strict";
// Copyright (c) Microsoft Corporation. All rights reserved.
// Licensed under the MIT License.
var __classPrivateFieldSet = (this && this.__classPrivateFieldSet) || function (receiver, state, value, kind, f) {
    if (kind === "m") throw new TypeError("Private method is not writable");
    if (kind === "a" && !f) throw new TypeError("Private accessor was defined without a setter");
    if (typeof state === "function" ? receiver !== state || !f : !state.has(receiver)) throw new TypeError("Cannot write private member to an object whose class did not declare it");
    return (kind === "a" ? f.call(receiver, value) : f ? f.value = value : state.set(receiver, value)), value;
};
var __classPrivateFieldGet = (this && this.__classPrivateFieldGet) || function (receiver, state, kind, f) {
    if (kind === "a" && !f) throw new TypeError("Private accessor was defined without a getter");
    if (typeof state === "function" ? receiver !== state || !f : !state.has(receiver)) throw new ...

/home/byk/Code/opencode-lore/packages/core/src/pattern-echo.ts: * Replaces the plain `embedDistillation()` call at the gen-0 distillation
/home/byk/Code/opencode-lore/packages/core/src/pattern-echo.ts: * 1. Stores the embedding (same as embedDistillation)
/home/byk/Code/opencode-lore/packages/core/src/distillation.ts:    embedding.embedDistillation(distillId, result.observations);
/home/byk/Code/opencode-lore/packages/core/src/distillation.ts:    embedding.embedDistillation(metaId, result.observations);
/home/byk/Code/opencode-lore/packages/core/src/embedding.ts:export function embedDistillation(id: string, observations: string): void {

1030:export function embedDistillation(id: string, observations: string): void {
1031-  if (!isAvailable()) return;
1032-  embed([observations], "document")
1033-    .then(([vec]) => {
1034-      db()
1035-        .query("UPDATE distillations SET embedding = ? WHERE id = ?")

5: *   - "local" (default): @huggingface/transformers + nomic-embed-text-v1.5
180:// Local provider (@huggingface/transformers + nomic-embed-text-v1.5)
191:      "Local embedding provider unavailable: '@huggingface/transformers' failed to initialize. " +
228: * Local embedding provider using @huggingface/transformers with
238: * The worker owns the transformers.js pipeline and processes requests

279:  private async ensureWorker(): Promise<void> {
296:      // `new Worker(code, { eval: true, filename, workerData })`.
321:          workerData: workerInitData,
323:        this.worker = new Worker(workerSource, opts);
341:        this.worker = new Worker(workerUrl, {
342:          workerData: workerInitData,
350:      this.worker.on("message", (msg: WorkerOutbound) => {
410:      this.worker.on("error", (err: Error) => {
422:      this.worker.on("exit", (code) => {
428:        // future ensureWorker() calls fast-fail instead of respawning a
471:    await this.ensureWorker();
500:        // Worker may have been terminated between ensureWorker() and here
538:      worker.on("exit", () => resolve());
540:        worker.postMessage({ type: "shutdown" } satisfies WorkerInbound);

test	Test	2026-06-07T22:31:19.4172117Z ^[[22m^[[39m[lore] gradient: session=grad-sess layer=0 tokens=53 (distilled=0 raw=53) usable=8000 tier=0 l0cap=off
test	Test	2026-06-07T22:31:19.4173562Z 
test	Test	2026-06-07T22:31:19.4177933Z ^[[22m^[[39m[lore] gradient: session=grad-sess layer=0 tokens=880 (distilled=0 raw=880) usable=8000 tier=0 l0cap=off
test	Test	2026-06-07T22:31:19.4178822Z 
test	Test	2026-06-07T22:31:19.4181917Z ^[[22m^[[39m[lore] distillation refresh: 0 rows (user msg nuclear-8)
test	Test	2026-06-07T22:31:19.4192426Z [lore] gradient: session=grad-sess layer=4 tokens=2714 (distilled=0 raw=2714) usable=1500 tier=0 l0cap=off
test	Test	2026-06-07T22:31:19.4196230Z 
test	Test	2026-06-07T22:31:19.4198513Z ^[[22m^[[39m[lore] gradient: session=grad-tiny-sess layer=0 tokens=490 (distilled=0 raw=490) usable=10000 tier=0 l0cap=off
test	Test	2026-06-07T22:31:19.4199357Z 
test	Test	2026-06-07T22:31:19.4202822Z ^[[22m^[[39m[lore] gradient: session=ltm-flag-sess layer=0 tokens=45 ...

(no output)

154:  test("embedded literal [tool:<id>] inside a payload does NOT fabricate a split (former F3 known limitation 2)", () => {
409:      "[tool:bash] embedded literal that could fabricate pre-F3b",

5:import * as embedding from "./embedding";
275:// (trailing-text swallow + embedded-envelope fabrication); both are
746:// vector recall (`embedding.ts`) skips them via `WHERE archived = 0`. This
1077:  if (embedding.isAvailable() && config().knowledge.enabled) {
1087:  } else if (embedding.isAvailable()) {
1088:    embedding.embedDistillation(distillId, result.observations);
1306:  if (embedding.isAvailable()) {
1307:    embedding.embedDistillation(metaId, result.observations);

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
185:       })) as unknown as FeatureExtractionPipeline;
186: 
187:       // Stash a reference to the pipeline's tokenizer for token-level
188:       // truncation during OOM retries.
189:       tokenizer = (pipe as unknown as { tokenizer: typeof tokenizer })
190:         .tokenizer;
191: 
192:       layerNormFn = layer_norm as typeof layerNormFn;
193:     })().catch((err) => {
194:       initFailed = true;
195:       initError = err instanceof Error ? err.message : String(err);
196:       initPromise = null;
197:       // Notify main thread — all pending + future requests should fail.
198:       post({ type: "init-error", error: initError });
199:       throw err;
200:     });
201:   }
202: 
203:   await initPromise;
204:   if (!pipe) throw new Error("pipeline init completed but pipe is null");
205: }
206: 
207: // ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
460:     if (this.pendingRequests.size > 0) {
461:       this.worker.ref();
462:     } else {
463:       this.worker.unref();
464:     }
465:   }
466: 
467:   async embed(
468:     texts: string[],
469:     inputType: "document" | "query",
470:   ): Promise<Float32Array[]> {
471:     await this.ensureWorker();
472: 
473:     // Pre-truncate texts that exceed the safe ONNX inference limit.
474:     // This prevents OOM on single inputs near the model's 8192-token max.
475:     const truncated = texts.map(safeLocalTruncate);
476: 
477:     // Prepend Nomic task instruction prefix.
478:     const prefix =
479:       inputType === "document" ? "search_document: " : "search_query: ";
480:     const prefixed = truncated.map((t) => prefix + t);
481: 
482:     const id = this.nextRequestId++;
483:     // Recall queries (single query-type texts) get high priority so they
484:     // jump ahead ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
265:     if (text.length <= maxTokens) return text;
266:     // Exclude [CLS]/[SEP] special tokens so ids.length reflects pure content
267:     // token count — otherwise the 2 extra tokens skew the limit check.
268:     const ids = tk.encode(text, { add_special_tokens: false });
269:     if (ids.length <= maxTokens) return text;
270:     return tk.decode(ids.slice(0, maxTokens), {
271:       skip_special_tokens: true,
272:     });
273:   });
274: }
275: 
276: // isOomError and isWasmFatalError are imported from embedding-worker-types.ts
277: // (shared with the main thread to prevent classification drift).
278: 
279: /** Run inference on `texts` and return per-text vectors. ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
390:       // request and exit the worker so the main thread marks the provider
391:       // as broken and stops sending work.
392:       if (isWasmFatalError(raw)) {
393:         post({
394:           type: "error",
395:           id: req.id,
396:           error: `WASM fatal error (worker exiting): ${raw}`,
397:         });
398:         process.exit(1);
399:         return; // unreachable, but makes intent clear
400:       }
401: 
402:       const msg = isOomError(raw)
403:         ? `ONNX runtime out of memory after ${OOM_MAX_RETRIES} retries ` +
404:           `(batch=${req.texts.length}, ` +
405:           `longest≈${Math.max(...req.texts.map((t) => t.length))} chars). ` +
406:           `Raw: ${raw}`
407:         : raw;
408:       post({ type: "error", id: req.id, error: msg });
409:     }
410:   }
411: }
412: 
413: // ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
415: // ---------------------------------------------------------------------------
416: 
417: function post(msg: WorkerOutbound): void {
418:   port.postMessage(msg);
419: }
420: 
421: port.on("message", (msg: WorkerInbound) => {
422:   switch (msg.type) {
423:     case "embed":
424:       enqueue(msg);
425:       break;
426:     case "shutdown":
427:       process.exit(0);
428:       break;
429:   }
430: });

(End of file - total 430 lines)
</content>

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
320:     vec.set(normalized.data.subarray(start, start + dim));
321:     vectors.push(vec);
322:   }
323: 
324:   return vectors;
325: }
326: 
327: async function processEmbed(req: EmbedRequest): Promise<void> {
328:   try {
329:     await ensurePipeline();
330: 
331:     // Try inference at full length first. On ONNX OOM, retry with
332:     // progressively halved token limits using the real tokenizer.
333:     // This preserves maximum semantic content for normal texts while
334:     // handling dense-token content (code, CJK, base64) adaptively.
335:     //
336:     // attempt 0 = original texts (no truncation)
337:     // attempt 1 = truncated to 4096 tokens
338:     // attempt 2 = truncated to 2048 tokens
339:     // attempt 3 = truncated to 1024 tokens
340:     let texts = req.texts;
341:     let lastError: Error | undefined;
342: 
343:     for (let attempt = 0; attempt ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
327: async function processEmbed(req: EmbedRequest): Promise<void> {
328:   inflight++;
329:   try {
330:     await ensurePipeline();
331: 
332:     // Try inference at full length first. On ONNX OOM, retry with
333:     // progressively halved token limits using the real tokenizer.
334:     // This preserves maximum semantic content for normal texts while
335:     // handling dense-token content (code, CJK, base64) adaptively.
336:     //
337:     // attempt 0 = original texts (no truncation)
338:     // attempt 1 = truncated to 4096 tokens
339:     // attempt 2 = truncated to 2048 tokens
340:     // attempt 3 = truncated to 1024 tokens
341:     let texts = req.texts;

(Showing lines 327-341 of 431. Use offset=342 to continue.)
</content>

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
369:         // attempt 3 failed at 1024       → loop exits, throw below
370:         if (attempt < OOM_MAX_RETRIES) {
371:           const maxTokens = OOM_RETRY_START_TOKENS >> attempt; // 4096, 2048, 1024
372:           texts = truncateTexts(req.texts, maxTokens);
373:           console.warn(
374:             `[lore] ONNX OOM on attempt ${attempt + 1}, retrying with ≤${maxTokens} tokens ` +
375:               `(batch=${req.texts.length}, longest≈${Math.max(...req.texts.map((t) => t.length))} chars)`,
376:           );
377:         }
378:       }
379:     }
380: 
381:     // All retries exhausted — report the last error.
382:     throw lastError ?? new Error("ONNX OOM retries exhausted");
383:   } catch (err) {
384:     // Don't re-post init-error — it was already sent in ensurePipeline().
385:     if (!initFailed) {
386:       const raw = err instanceof Error ? err.message : ...

Edit applied successfully.

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
1: /**
2:  * Embedding worker thread — runs ONNX inference via @huggingface/transformers
3:  * off the main thread.
4:  *
5:  * This file is the entry point for a `node:worker_threads` Worker spawned by
6:  * `LocalProvider` in `embedding.ts`. It owns the transformers.js pipeline
7:  * and processes embed requests sequentially from a priority queue. Moving
8:  * inference here keeps the main thread's event loop free — HTTP requests,
9:  * SSE streams, and session APIs are no longer blocked during embedding.
10:  *
11:  * Communication uses `parentPort` message passing with structured clone.
12:  * Float32Array vectors are sent back directly (Bun preserves identity).
13:  *
14:  * The worker applies Nomic's recommended post-processing:
15:  *   1. Mean pooling (via pipeline option)
16:  *   2. Layer normalization
17:  *   3. ...

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
327: async function processEmbed(req: EmbedRequest): Promise<void> {
328:   inflight++;
329:   try {
330:     await ensurePipeline();
331: 
332:     // Try inference at full length first. On ONNX OOM, retry with
333:     // progressively halved token limits using the real tokenizer.
334:     // This preserves maximum semantic content for normal texts while
335:     // handling dense-token content (code, CJK, base64) adaptively.
336:     //
337:     // attempt 0 = original texts (no truncation)
338:     // attempt 1 = truncated to 4096 tokens
339:     // attempt 2 = truncated to 2048 tokens
340:     // attempt 3 = truncated to 1024 tokens
341:     let texts = req.texts;
342:     let lastError: Error | undefined;
343: 
344:     for (let attempt = 0; attempt <= OOM_MAX_RETRIES; attempt++) {
345:       try {
346:         const vectors = await runInference(texts);
347:         post({ ...

packages/core/eval/harness.ts(218,46): error TS2339: Property 'port' does not exist on type 'Promise<{ stop: () => void; port: number; hosts: string[]; ready: Promise<void>; }>'.
packages/core/eval/harness.ts(237,14): error TS2339: Property 'stop' does not exist on type 'Promise<{ stop: () => void; port: number; hosts: string[]; ready: Promise<void>; }>'.
packages/core/eval/lore-harness.ts(86,46): error TS2339: Property 'port' does not exist on type 'Promise<{ stop: () => void; port: number; hosts: string[]; ready: Promise<void>; }>'.
packages/core/eval/lore-harness.ts(106,14): error TS2339: Property 'stop' does not exist on type 'Promise<{ stop: () => void; port: number; hosts: string[]; ready: Promise<void>; }>'.
packages/core/eval/run.ts(125,17): error TS2339: Property 'dir' does not exist on type 'ImportMeta'.
packages/core/eval/scenarios/mega-session.ts(21,37): error TS2339: Property 'dir' does not exist on type 'ImportMeta'.
packages/core/eval/scenarios/mega-session.ts(296,3): ...

(no output)

error: unsupported reporter format 'verbose'. Available options: 'junit' (for XML test results), 'dots'

error: unsupported reporter format 'verbose'. Available options: 'junit' (for XML test results), 'dots'
bun test v1.3.13 (bf2e2cec)

packages/core/test/embedding.test.ts:
1019 |     if (process.env.NODE_ENV === "test") {
1020 |       throw new Error(
1021 |         "LORE_DB_PATH is not set but NODE_ENV=test. " +
1022 |           "Run tests via `bun test` from the repo root, or set " +
1023 |           "LORE_DB_PATH to a temp path to avoid polluting the production DB.",
1024 |       );
             ^
error: LORE_DB_PATH is not set but NODE_ENV=test. Run tests via `bun test` from the repo root, or set LORE_DB_PATH to a temp path to avoid polluting the production DB.
      at db (/home/byk/Code/opencode-lore/packages/core/src/db.ts:1024:7)
      at <anonymous> (/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts:268:5)
(fail) vectorSearch > returns entries sorted by similarity descending
1019 |     if (process.env.NODE_ENV === "test") {
1020 |       throw new Error(
1021 |  ...

diff --git a/packages/core/src/embedding-worker.ts b/packages/core/src/embedding-worker.ts
index 66a5e73..1443926 100644
--- a/packages/core/src/embedding-worker.ts
+++ b/packages/core/src/embedding-worker.ts
@@ -325,6 +325,7 @@ async function runInference(texts: string[]): Promise<Float32Array[]> {
 }
 
 async function processEmbed(req: EmbedRequest): Promise<void> {
+  inflight++;
   try {
     await ensurePipeline();
 
@@ -407,13 +408,25 @@ async function processEmbed(req: EmbedRequest): Promise<void> {
         : raw;
       post({ type: "error", id: req.id, error: msg });
     }
+  } finally {
+    inflight--;
+    maybeExit();
   }
 }
 
 // ---------------------------------------------------------------------------
-// Message handling
+// Shutdown handling
 // ---------------------------------------------------------------------------
 
+let inflight = 0;
+let shutdownRequested = false;
+
+function maybeExit(): void {
+  if (shutdownRequested && inflight === 0) {
+    ...

<path>/home/byk/Code/opencode-lore/.opencode/plans/1780865688932-sunny-comet.md</path>
<type>file</type>
<content>
1: # Fix: Embedding worker init fails in vitest (Node.js ESM extensionless imports)
2: 
3: Closes [#606](https://github.com/BYK/loreai/issues/606).
4: 
5: ## Root cause
6: 
7: `packages/core/src/embedding-worker.ts` imports from `./embedding-worker-types`
8: with no extension. This works in Bun and esbuild (which resolve extensionless
9: `.ts` imports transparently) but fails with `ERR_MODULE_NOT_FOUND` when the
10: worker is spawned from TS source under vitest. The vitest config uses
11: `pool: "threads"`, which spawns the embedding worker as a plain Node.js ESM
12: process — and Node's runtime resolver requires an explicit extension.
13: 
14: The issue's recommended fix (adding `.js` extension) was tested and does NOT
15: work in Node.js v24: Node's experimental TypeScript support loads `.ts` files
16: but does not map internal `.js` imports back to `.ts` source files. ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
200: }
201: 
202: /** Tracks whether the local provider has been probed and found unavailable.
203:  *  Set to true after the first worker init failure so subsequent calls
204:  *  to `isAvailable()` short-circuit. */
205: let localProviderKnownBroken = false;
206: let localProviderErrorLogged = false;
207: 
208: /** For tests: reset the local provider probe state. */
209: export function _resetLocalProviderProbe(): void {
210:   localProviderKnownBroken = false;
211:   localProviderErrorLogged = false;
212: }
213: 
214: /** For tests: simulate the local provider being unavailable, without
215:  *  actually spawning a worker. After this call, `isAvailable()` returns
216:  *  false for the local provider. ...

The arguments provided to the tool are invalid: Model tried to call unavailable tool 'reduce'. Available tools: bash, beeper_archive_chat, beeper_clear_chat_reminder, beeper_focus_app, beeper_get_accounts, beeper_get_chat, beeper_list_messages, beeper_search, beeper_search_chats, beeper_search_docs, beeper_search_messages, beeper_send_message, beeper_set_chat_reminder, edit, glob, grep, invalid, question, read, Readwise_reader_add_tags_to_document, Readwise_reader_add_tags_to_highlight, Readwise_reader_bulk_edit_document_metadata, Readwise_reader_create_document, Readwise_reader_create_highlight, Readwise_reader_export_documents, Readwise_reader_get_document_details, Readwise_reader_get_document_highlights, Readwise_reader_get_export_documents_status, Readwise_reader_list_documents, Readwise_reader_list_tags, Readwise_reader_move_documents, Readwise_reader_remove_tags_from_document, Readwise_reader_remove_tags_from_highlight, Readwise_reader_search_documents, ...

Found 92 matches
/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts:
  Line 12: import { LOCAL_MODEL_PATH_ENV } from "../src/embedding-vendor";

  Line 29: } from "../src/embedding";

  Line 265:   const PROJECT = "/test/embedding/vectorsearch";

  Line 281:         "INSERT INTO knowledge (id, project_id, category, title, content, confidence, created_at, updated_at, embedding) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)",

  Line 296:         "INSERT INTO knowledge (id, project_id, category, title, content, confidence, created_at, updated_at, embedding) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)",

  Line 311:         "INSERT INTO knowledge (id, project_id, category, title, content, confidence, created_at, updated_at, embedding) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)",

  Line 345:           "INSERT INTO knowledge (id, project_id, category, title, content, confidence, created_at, updated_at, embedding) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?)",

  Line 365:   test("skips entries without ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
450:     });
451: 
452:     return this.initPromise;
453:   }
454: 
455:   /** Keep the worker ref'd while requests are in flight so the event loop
456:    *  doesn't exit before responses arrive. When the pending map drains,
457:    *  unref again so the worker doesn't prevent graceful process exit. */
458:   private updateWorkerRef(): void {
459:     if (!this.worker) return;
460:     if (this.pendingRequests.size > 0) {
461:       this.worker.ref();
462:     } else {
463:       this.worker.unref();
464:     }
465:   }
466: 
467:   async embed(
468:     texts: string[],
469:     inputType: "document" | "query",
470:   ): Promise<Float32Array[]> {
471:     await this.ensureWorker();
472: 
473:     // Pre-truncate texts that exceed the safe ONNX inference limit.
474:     // This prevents OOM on single inputs near the model's 8192-token max.
475:     const truncated = ...

Found 25 matches
/home/byk/Code/opencode-lore/packages/core/src/embedding.ts:
  Line 205: let localProviderKnownBroken = false;

  Line 206: let localProviderErrorLogged = false;

  Line 210:   localProviderKnownBroken = false;

  Line 211:   localProviderErrorLogged = false;

  Line 218:   localProviderKnownBroken = true;

  Line 219:   localProviderErrorLogged = true; // suppress the info log in tests

  Line 223: function localProviderKnownUnavailable(): boolean {

  Line 224:   return localProviderKnownBroken;

  Line 282:       throw new LocalProviderUnavailableError(this.workerInitError);

  Line 287:       if (localProviderKnownBroken) throw new LocalProviderUnavailableError();

  Line 373:                 localProviderKnownBroken = true;

  Line 374:                 pending.reject(new LocalProviderUnavailableError(msg.error));

  Line 388:             localProviderKnownBroken = true;

  Line 389:             if (!localProviderErrorLogged) {

  Line 390:               ...

Found 2 matches
/home/byk/Code/opencode-lore/packages/core/test/distillation.test.ts:
  Line 154:   test("embedded literal [tool:<id>] inside a payload does NOT fabricate a split (former F3 known limitation 2)", () => {

  Line 409:       "[tool:bash] embedded literal that could fabricate pre-F3b",

Found 8 matches
/home/byk/Code/opencode-lore/packages/core/src/distillation.ts:
  Line 5: import * as embedding from "./embedding";

  Line 275: // (trailing-text swallow + embedded-envelope fabrication); both are

  Line 746: // vector recall (`embedding.ts`) skips them via `WHERE archived = 0`. This

  Line 1077:   if (embedding.isAvailable() && config().knowledge.enabled) {

  Line 1087:   } else if (embedding.isAvailable()) {

  Line 1088:     embedding.embedDistillation(distillId, result.observations);

  Line 1306:   if (embedding.isAvailable()) {

  Line 1307:     embedding.embedDistillation(metaId, result.observations);

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
475:       .query(
476:         "INSERT INTO entities (id, project_id, entity_type, canonical_name, cross_project, created_at, updated_at) VALUES ('ent-novec', ?, 'tool', 'No vec', 0, ?, ?)",
477:       )
478:       .run(pid, now, now);
479: 
480:     const results = vectorSearchEntities(new Float32Array([1, 0, 0]), 1);
481:     expect(results.length).toBe(1);
482:     expect(results[0].id).toBe("ent-x");
483:   });
484: });
485: 
486: function assertLocalModelAvailable(): void {
487:   const path = process.env[LOCAL_MODEL_PATH_ENV];
488:   if (!path) {
489:     throw new Error(
490:       `Local embedding model not available: ${LOCAL_MODEL_PATH_ENV} is not set. ` +
491:         `Set it to the vendored model cache root (e.g. .vendor-build/.model-cache) ` +
492:         `to run end-to-end embedding tests. See packages/core/src/embedding-vendor.ts.`,
493:     );
494:   }
495:   if ...

Found 2 matches
/home/byk/Code/opencode-lore/packages/core/src/embedding.ts:
  Line 732: export function isAvailable(): boolean {

  Line 1030: export function embedDistillation(id: string, observations: string): void {

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
570:   return envKey ? process.env[envKey] : undefined;
571: }
572: 
573: let cachedProvider: EmbeddingProvider | null | undefined;
574: 
575: function getProvider(): EmbeddingProvider | null {
576:   if (cachedProvider !== undefined) return cachedProvider;
577: 
578:   const cfg = config().search.embeddings;
579:   if (cfg.enabled === false) {
580:     cachedProvider = null;
581:     return null;
582:   }
583: 
584:   const providerName = cfg.provider;
585:   const model = cfg.model;
586: 
587:   switch (providerName) {
588:     case "local": {
589:       // Construct the provider optimistically — the ONNX model init
590:       // happens lazily in the worker thread on first `embed()` call.
591:       // If it fails, `LocalProviderUnavailableError` marks the provider
592:       // as broken and callers degrade to FTS-only search. ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
725: /** Returns true if embedding is available.
726:  *  Active when the configured provider's API key is set, unless explicitly
727:  *  disabled via `search.embeddings.enabled: false` in .lore.json.
728:  *
729:  *  For the `local` provider, also returns false once the worker has reported
730:  *  an init failure — callers (recall, ltm, distillation) use this gate to
731:  *  skip embedding work and fall back to FTS-only search. */
732: export function isAvailable(): boolean {
733:   const provider = getProvider();
734:   if (!provider) return false;
735:   if (provider instanceof LocalProvider && localProviderKnownUnavailable()) {
736:     // One-time log so the user knows why vector search is degraded.
737:     if (!localProviderErrorLogged) {
738:       localProviderErrorLogged = true;
739:       log.info(
740:         "local embedding provider unavailable — recall will use ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
1025: /**
1026:  * Embed a distillation and store the result in the DB.
1027:  * Fire-and-forget — errors are logged, never thrown.
1028:  * The distillation remains searchable via FTS even if embedding fails.
1029:  */
1030: export function embedDistillation(id: string, observations: string): void {
1031:   if (!isAvailable()) return;
1032:   embed([observations], "document")
1033:     .then(([vec]) => {
1034:       db()
1035:         .query("UPDATE distillations SET embedding = ? WHERE id = ?")
1036:         .run(toBlob(vec), id);
1037:     })
1038:     .catch((err) => {
1039:       log.error("embedding failed for distillation", id, ":", err);
1040:     });
1041: }
1042: 
1043: /**
1044:  * Embed a temporal message and store the result in the DB.
1045:  * Fire-and-forget — errors are logged, never thrown. ...

No files found

(no output)

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
1: /**
2:  * Embedding worker thread — runs ONNX inference via @huggingface/transformers
3:  * off the main thread.
4:  *
5:  * This file is the entry point for a `node:worker_threads` Worker spawned by
6:  * `LocalProvider` in `embedding.ts`. It owns the transformers.js pipeline
7:  * and processes embed requests sequentially from a priority queue. Moving
8:  * inference here keeps the main thread's event loop free — HTTP requests,
9:  * SSE streams, and session APIs are no longer blocked during embedding.
10:  *
11:  * Communication uses `parentPort` message passing with structured clone.
12:  * Float32Array vectors are sent back directly (Bun preserves identity).
13:  *
14:  * The worker applies Nomic's recommended post-processing:
15:  *   1. Mean pooling (via pipeline option)
16:  *   2. Layer normalization
17:  *   3. ...

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
23: import { parentPort, workerData } from "node:worker_threads";
24: import type {
25:   WorkerInbound,
26:   WorkerOutbound,
27:   WorkerInitData,
28:   EmbedRequest,
29: } from "./embedding-worker-types.js";
30: 
31: // ---------------------------------------------------------------------------
32: // workerData
33: // ---------------------------------------------------------------------------
34: 
35: // This module is only ever loaded as a worker thread entry point, so
36: // `parentPort` is always present. Capture it into a non-null local and fail
37: // fast otherwise.
38: if (!parentPort) {
39:   throw new Error("embedding-worker must be run as a worker thread");
40: }
41: const port = parentPort;
42: 
43: const { modelId, dimensions, vendorModel } = workerData as WorkerInitData;
44: 
45: /**
46:  * Token ceiling used when retrying after an ONNX OOM. ...

diff --git a/packages/core/src/embedding-worker.ts b/packages/core/src/embedding-worker.ts
index 66a5e73..83fc10f 100644
--- a/packages/core/src/embedding-worker.ts
+++ b/packages/core/src/embedding-worker.ts
@@ -26,7 +26,7 @@ import type {
   WorkerOutbound,
   WorkerInitData,
   EmbedRequest,
-} from "./embedding-worker-types";
+} from "./embedding-worker-types.js";
 
 // ---------------------------------------------------------------------------
 // workerData
@@ -325,6 +325,7 @@ async function runInference(texts: string[]): Promise<Float32Array[]> {
 }
 
 async function processEmbed(req: EmbedRequest): Promise<void> {
+  inflight++;
   try {
     await ensurePipeline();
 
@@ -407,13 +408,25 @@ async function processEmbed(req: EmbedRequest): Promise<void> {
         : raw;
       post({ type: "error", id: req.id, error: msg });
     }
+  } finally {
+    inflight--;
+    maybeExit();
   }
 }
 
 // ---------------------------------------------------------------------------
-// ...

      at ensureProject (/home/byk/Code/opencode-lore/packages/core/src/db.ts:1397:5)
      at <anonymous> (/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts:635:17)
(fail) checkConfigChange > first call stores fingerprint and returns true
1392 |   // to the default production path, but that's not a realistic scenario.
1393 |   if (!process.env.LORE_DB_PATH && /^\/test\//.test(path)) {
1394 |     throw new Error(
1395 |       `Refusing to create project with test path "${path}" in the production DB. ` +
1396 |         `Set LORE_DB_PATH to a temp path, or run tests via \`bun test\` from the repo root.`,
1397 |     );
           ^
error: Refusing to create project with test path "/test/embedding/configchange" in the production DB. Set LORE_DB_PATH to a temp path, or run tests via `bun test` from the repo root.
      at ensureProject (/home/byk/Code/opencode-lore/packages/core/src/db.ts:1397:5)
      at <anonymous> ...

No type errors in embedding files

<path>/home/byk/Code/opencode-lore/.opencode/plans/1780865688932-sunny-comet.md</path>
<type>file</type>
<content>
1: # Fix: Embedding worker init fails in vitest (Node.js ESM extensionless imports)
2: 
3: Closes [#606](https://github.com/BYK/loreai/issues/606).
4: 
5: ## Root cause
6: 
7: `packages/core/src/embedding-worker.ts` imports from `./embedding-worker-types`
8: with no extension. This works in Bun and esbuild (which resolve extensionless
9: `.ts` imports transparently) but fails with `ERR_MODULE_NOT_FOUND` when the
10: worker is spawned from TS source under vitest. The vitest config uses
11: `pool: "threads"`, which spawns the embedding worker as a plain Node.js ESM
12: process — and Node's runtime resolver requires an explicit extension.
13: 
14: The issue's recommended fix (adding `.js` extension) was tested and does NOT
15: work in Node.js v24: Node's experimental TypeScript support loads `.ts` files
16: but does not map internal `.js` imports back to `.ts` source files. ...

Wrote file successfully.

On branch fix/issue-606-embedding-worker
Your branch is up to date with 'origin/fix/issue-606-embedding-worker'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
	modified:   packages/core/src/embedding-worker.ts

no changes added to commit (use "git add" and/or "git commit -a")
---
24d554b ci: re-run tests
71b0ed1 fix(core): inline embedding worker classifiers to fix vitest init
164f7a1 fix(gateway): use fossilize programmatic API instead of impl-* glob dance (#609)
92b58a0 fix(gateway): remove cache fields from ZERO_USAGE and consolidate SSE extraction (#611)
dc6de76 ci: add actionlint to catch workflow YAML errors (#612)

The arguments provided to the tool are invalid: Model tried to call unavailable tool 'jj-guide'. Available tools: bash, beeper_archive_chat, beeper_clear_chat_reminder, beeper_focus_app, beeper_get_accounts, beeper_get_chat, beeper_list_messages, beeper_search, beeper_search_chats, beeper_search_docs, beeper_search_messages, beeper_send_message, beeper_set_chat_reminder, edit, glob, grep, invalid, question, read, Readwise_reader_add_tags_to_document, Readwise_reader_add_tags_to_highlight, Readwise_reader_bulk_edit_document_metadata, Readwise_reader_create_document, Readwise_reader_create_highlight, Readwise_reader_export_documents, Readwise_reader_get_document_details, Readwise_reader_get_document_highlights, Readwise_reader_get_export_documents_status, Readwise_reader_list_documents, Readwise_reader_list_tags, Readwise_reader_move_documents, Readwise_reader_remove_tags_from_document, Readwise_reader_remove_tags_from_highlight, Readwise_reader_search_documents, ...

<skill_content name="jj-guide">
# Skill: jj-guide

# jj Guide for AI Agents

Jujutsu (jj) is a Git-compatible VCS with mutable commits, automatic snapshotting, no staging area, and first-class conflicts. This skill teaches you how to use it safely from a non-interactive agent environment.

If `.jj/` exists in the repo root, this is a jj repo. **Use `jj` commands, not `git`.** In a colocated repo (`.jj/` *and* `.git/`), git tools can read the state, but mutations should go through `jj` so the operation log stays consistent.

## Critical Rules

- **NEVER** use interactive flags (`-i`, `--interactive`). TUI prompts hang in agent environments. This applies to `jj split -i`, `jj squash -i`, `jj commit -i`, `jj resolve`, `jj diffedit`, etc.
- **ALWAYS** pass `-m "msg"` when describing/committing. Without `-m`, an editor opens and hangs.
- **VERIFY** mutations with `jj st` and `jj log` after `squash`, `abandon`, `rebase`, `restore`, `commit`. ...

Reset the working copy parent to the new Git HEAD.
Done importing changes from the underlying Git repo.
Working copy changes:
M packages/core/src/embedding-worker.ts
Working copy  (@) : tqotpkup e051abc8 (no description set)
Parent commit (@-): ymzypnpu 24d554b7 fix/issue-606-embedding-worker fix/issue-606-embedding-worker@origin | (empty) ci: re-run tests
Warning: These bookmarks have conflicts:
  fix-metadata-query-perf
  fix/fossilize-variadic-platforms
Hint: Use `jj bookmark list` to see details. Use `jj bookmark set <name> -r <rev>` to resolve.

Modified regular file packages/core/src/embedding-worker.ts:
    ...
  26   26:   WorkerOutbound,
  27   27:   WorkerInitData,
  28   28:   EmbedRequest,
  29   29: } from "./embedding-worker-types.js";
  30   30: 
  31   31: // ---------------------------------------------------------------------------
  32   32: // workerData
    ...
 325  325: }
 326  326: 
 327  327: async function processEmbed(req: EmbedRequest): Promise<void> {
      328:   inflight++;
 328  329:   try {
 329  330:     await ensurePipeline();
 330  331: 
    ...
 407  408:         : raw;
 408  409:       post({ type: "error", id: req.id, error: msg });
 409  410:     }
      411:   } finally {
      412:     inflight--;
      413:     maybeExit();
 410  414:   }
 411  415: }
 412  416: 
 413  417: // ---------------------------------------------------------------------------
 414  418: // MessageShutdown handling
 415  419: // ---------------------------------------------------------------------------
 416  420: ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding-worker.ts</path>
<type>file</type>
<content>
430: function post(msg: WorkerOutbound): void {
431:   port.postMessage(msg);
432: }
433: 
434: port.on("message", (msg: WorkerInbound) => {
435:   switch (msg.type) {
436:     case "embed":
437:       if (!shutdownRequested) {
438:         enqueue(msg);
439:       }
440:       break;
441:     case "shutdown":
442:       shutdownRequested = true;
443:       maybeExit();
444:       break;
445:   }
446: });

(End of file - total 446 lines)
</content>

      break;
    case "shutdown":
      shutdownRequested = true;
      maybeExit();
      break;
  }
});

Working copy  (@) now at: tqotpkup d46ab71c fix(worker): graceful drain + .js extension for vitest compat
Parent commit (@-)      : ymzypnpu 24d554b7 fix/issue-606-embedding-worker fix/issue-606-embedding-worker@origin | (empty) ci: re-run tests
Working copy changes:
M packages/core/src/embedding-worker.ts
Working copy  (@) : tqotpkup d46ab71c fix(worker): graceful drain + .js extension for vitest compat
Parent commit (@-): ymzypnpu 24d554b7 fix/issue-606-embedding-worker fix/issue-606-embedding-worker@origin | (empty) ci: re-run tests
Warning: These bookmarks have conflicts:
  fix-metadata-query-perf
  fix/fossilize-variadic-platforms
Hint: Use `jj bookmark list` to see details. Use `jj bookmark set <name> -r <rev>` to resolve.

Moved 1 bookmarks to tqotpkup d46ab71c fix/issue-606-embedding-worker* | fix(worker): graceful drain + .js extension for vitest compat

Error: Non-tracking remote bookmark fix/issue-606-embedding-worker@origin exists
Hint: Run `jj bookmark track fix/issue-606-embedding-worker --remote=origin` to import the remote bookmark.

Started tracking 1 remote bookmarks.
Changes to push to origin:
  bookmark: fix/issue-606-embedding-worker [move forward from 24d554b79a10 to d46ab71c6c94]
remote: 
remote: GitHub found 1 vulnerability on BYK/loreai's default branch (1 moderate). To find out more, visit:        
remote:      https://github.com/BYK/loreai/security/dependabot/2        
remote: 

[{"createdAt":"2026-06-07T22:30:21Z","databaseId":27106764452,"name":"Docs Preview","status":"completed"},{"createdAt":"2026-06-07T22:30:21Z","databaseId":27106764464,"name":"CI","status":"completed"},{"createdAt":"2026-06-07T22:17:43Z","databaseId":27106479108,"name":"Docs Preview","status":"completed"},{"createdAt":"2026-06-07T22:17:43Z","databaseId":27106479104,"name":"CI","status":"completed"},{"createdAt":"2026-06-07T22:12:47Z","databaseId":27106368528,"name":".github/workflows/eval.yml","status":"completed"}]

[{"createdAt":"2026-06-07T23:22:11Z","databaseId":27107923132,"name":"Docs Preview","status":"in_progress"},{"createdAt":"2026-06-07T23:22:11Z","databaseId":27107923131,"name":"CI","status":"in_progress"},{"createdAt":"2026-06-07T22:30:21Z","databaseId":27106764452,"name":"Docs Preview","status":"completed"}]

Refreshing run status every 3 seconds. Press Ctrl+C to quit.

* fix/issue-606-embedding-worker CI BYK/loreai#613 · 27107923131
Triggered via pull_request less than a minute ago

JOBS
✓ actionlint in 4s (ID 80000292651)
  ✓ Set up job
  ✓ Run actions/checkout@v6
  ✓ Install actionlint
  ✓ Lint workflow files
  ✓ Post Run actions/checkout@v6
  ✓ Complete job
✓ changes in 5s (ID 80000292653)
  ✓ Set up job
  ✓ Run actions/checkout@v6
  ✓ Run dorny/paths-filter@v4
  - Force full CI on main/release push
  ✓ Post Run actions/checkout@v6
  ✓ Complete job
* test (ID 80000300579)
  ✓ Set up job
  ✓ Run actions/checkout@v6
  ✓ Run pnpm/action-setup@v4
  ✓ Run actions/setup-node@v6
  * Run pnpm install --frozen-lockfile
  * Run pnpm run build
  * Restore vendor staging
  * Populate vendor staging (cache miss)
  * Typecheck
  * Lint
  * Test
  * Fetch commits since last release
  * Install Craft CLI
  * Compute nightly version
  * Build npm bundle (CJS)
  * Smoke-test npm bundle under Node.js
  * ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
260:       resolve: (vectors: Float32Array[]) => void;
261:       reject: (error: Error) => void;
262:     }
263:   >();
264:   private nextRequestId = 0;
265:   private initPromise: Promise<void> | null = null;
266:   private modelId: string;
267:   private dimensions: number;
268: 
269:   constructor(modelId: string, dimensions: number) {
270:     this.modelId = modelId;
271:     this.dimensions = dimensions;
272:   }
273: 
274:   /**
275:    * Ensure the worker thread is running. Worker startup failure is
276:    * surfaced as `LocalProviderUnavailableError` to mark the provider as
277:    * broken and degrade to FTS-only search.
278:    */
279:   private async ensureWorker(): Promise<void> {
280:     if (this.workerReady) return;
281:     if (this.workerInitError)
282:       throw new LocalProviderUnavailableError(this.workerInitError);
283:     if (this.initPromise) return ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
329:         if (selfUrl) {
330:           workerUrl = new URL(
331:             `./embedding-worker${selfUrl.endsWith(".ts") ? ".ts" : ".js"}`,
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           workerUrl = new URL(
337:             "./embedding-worker.cjs",
338:             pathToFileURL(__filename),
339:           );
340:         }
341:         this.worker = new Worker(workerUrl, {
342:           workerData: workerInitData,
343:         });
344:       }
345: 
346:       // Don't let the worker prevent process exit.
347:       this.worker.unref();
348: 
349:       // Wire up response handler.
350:       this.worker.on("message", (msg: WorkerOutbound) => {
351:         switch (msg.type) {
352:           case "result": {
353:             const pending = ...

<path>/home/byk/Code/opencode-lore/packages/core/script/build.ts</path>
<type>file</type>
<content>
1: /**
2:  * Build @loreai/core into publishable ESM bundles.
3:  *
4:  * Two targets:
5:  * - dist/node/index.js — uses node:sqlite (for Pi extension, ACP server, etc.)
6:  * - dist/bun/index.js  — uses bun:sqlite  (for OpenCode plugin)
7:  *
8:  * esbuild resolves the `#db/driver` subpath import map per target via
9:  * `conditions: ["node"]` or `conditions: ["bun"]`.
10:  *
11:  * TypeScript declarations (.d.ts) are emitted separately by `tsc` below.
12:  * esbuild alone can't produce declarations.
13:  *
14:  * Runs under either Bun (during `bun run build`) or Node; the build itself is
15:  * runtime-agnostic (esbuild is a plain npm package). ...

no vitest config

<path>/home/byk/Code/opencode-lore/packages/core/package.json</path>
<type>file</type>
<content>
1: {
2:   "name": "@loreai/core",
3:   "version": "0.24.1",
4:   "type": "module",
5:   "license": "FSL-1.1-Apache-2.0",
6:   "description": "Shared memory engine for Lore — three-tier storage, distillation, gradient context management",
7:   "main": "./dist/node/index.js",
8:   "types": "./dist/node/index.d.ts",
9:   "exports": {
10:     ".": {

(Showing lines 1-10 of 64. Use offset=11 to continue.)
</content>

/home/byk/Code/opencode-lore/.github/workflows/publish.yml
/home/byk/Code/opencode-lore/.github/workflows/eval.yml
/home/byk/Code/opencode-lore/.github/workflows/ci.yml
/home/byk/Code/opencode-lore/.github/workflows/cch-seed-check.yml
/home/byk/Code/opencode-lore/.github/workflows/docs-preview.yml
/home/byk/Code/opencode-lore/.github/workflows/release.yml
/home/byk/Code/opencode-lore/.github/workflows/cleanup-nightlies.yml

task_id: ses_15b97bfa8ffey7Gl3P8TY2kgrd (for resuming to continue this task if needed)

<task_result>

</task_result>

N/A

{
  "typecheck": "pnpm -r run typecheck",
  "test": "vitest run",
  "pretest": "pnpm --filter @loreai/gateway run bundle",
  "build": "pnpm -r run build",
  "site:dev": "pnpm --filter '@loreai/website' dev",
  "site:build": "pnpm --filter '@loreai/website' build",
  "site:preview": "pnpm --filter '@loreai/website' preview",
  "lint": "biome check .",
  "lint:fix": "biome check --write .",
  "format": "biome format --write .",
  "evals": "vitest run --config vitest.evals.config.ts",
  "postinstall": "pnpm --filter @loreai/gateway run build"
}

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
322:         };
323:         this.worker = new Worker(workerSource, opts);
324:       } else {
325:         // npm bundle / dev path: point at a sibling worker file.
326:         let workerUrl: string | URL;
327:         const selfUrl =
328:           typeof import.meta.url === "string" ? import.meta.url : undefined;
329:         if (selfUrl) {
330:           workerUrl = new URL(
331:             `./embedding-worker${selfUrl.endsWith(".ts") ? ".ts" : ".js"}`,
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           workerUrl = new URL(
337:             "./embedding-worker.cjs",
338:             pathToFileURL(__filename),
339:           );
340:         }
341:         this.worker = new Worker(workerUrl, {

(Showing lines 322-341 of 1554. Use offset=342 to continue.)
</content>

/home/byk/Code/opencode-lore/vitest.config.ts
/home/byk/Code/opencode-lore/vitest.evals.config.ts

<path>/home/byk/Code/opencode-lore/vitest.config.ts</path>
<type>file</type>
<content>
1: import { defineConfig } from "vitest/config";
2: import path from "node:path";
3: 
4: export default defineConfig({
5:   test: {
6:     // Run all packages' tests
7:     include: [
8:       "packages/core/test/**/*.test.ts",
9:       "packages/gateway/test/**/*.test.ts",
10:       "packages/opencode/test/**/*.test.ts",
11:     ],
12:     // Preload test setup for DB isolation
13:     setupFiles: ["./packages/core/test/setup.ts"],
14:     // Environment
15:     environment: "node",
16:     pool: "threads",
17:     // Timeouts — generous for gateway startup and LLM operations
18:     testTimeout: 300_000, // 5 min per test
19:     hookTimeout: 300_000,
20:     // Environment variables for test isolation
21:     env: {
22:       NODE_ENV: "test",
23:       SENTRY_ENABLED: "0",
24:       LORE_DEBUG: "0",
25:     },
26:     // Coverage is optional and run separately
27:     coverage: {
28:       ...

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
480:     const results = vectorSearchEntities(new Float32Array([1, 0, 0]), 1);
481:     expect(results.length).toBe(1);
482:     expect(results[0].id).toBe("ent-x");
483:   });
484: });
485: 
486: function assertLocalModelAvailable(): void {
487:   const path = process.env[LOCAL_MODEL_PATH_ENV];
488:   if (!path) {
489:     throw new Error(
490:       `Local embedding model not available: ${LOCAL_MODEL_PATH_ENV} is not set. ` +
491:         `Set it to the vendored model cache root (e.g. .vendor-build/.model-cache) ` +
492:         `to run end-to-end embedding tests. See packages/core/src/embedding-vendor.ts.`,
493:     );
494:   }
495:   if (!existsSync(path)) {
496:     throw new Error(
497:       `Local embedding model not available: ${LOCAL_MODEL_PATH_ENV}="${path}" ` +
498:         `does not exist. Vendor the model or unset the env var.`,
499:     );
500:   }
501: }
502: ...

<path>/home/byk/Code/opencode-lore/packages/core/test/embedding.test.ts</path>
<type>file</type>
<content>
520:     // Vector should not be all zeros
521:     const norm = Array.from(vec).reduce((sum, v) => sum + v * v, 0);
522:     expect(norm).toBeGreaterThan(0);
523:   }, 60_000);
524: 
525:   test("query and document embeddings have reasonable similarity", async () => {
526:     const { embed, cosineSimilarity } = await import("../src/embedding");
527:     const [queryVec] = await embed(["database migration"], "query");
528:     const [docVec] = await embed(
529:       ["PostgreSQL database schema migration tool"],
530:       "document",
531:     );
532:     const [unrelatedVec] = await embed(
533:       ["chocolate cake recipe with frosting"],
534:       "document",
535:     );
536: 
537:     const relevantSim = cosineSimilarity(queryVec, docVec);
538:     const unrelatedSim = cosineSimilarity(queryVec, unrelatedVec);
539: 
540:     // Relevant doc should have higher similarity ...

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
325:         // npm bundle / dev path: point at a sibling worker file.
326:         let workerUrl: string | URL;
327:         const selfUrl =
328:           typeof import.meta.url === "string" ? import.meta.url : undefined;
329:         if (selfUrl) {
330:           workerUrl = new URL(
331:             `./embedding-worker${selfUrl.endsWith(".ts") ? ".ts" : ".js"}`,
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           workerUrl = new URL(
337:             "./embedding-worker.cjs",
338:             pathToFileURL(__filename),
339:           );
340:         }
341:         this.worker = new Worker(workerUrl, {
342:           workerData: workerInitData,
343:         });
344:       }

(Showing lines 325-344 of 1554. Use offset=345 to continue.)
</content>

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
322:         };
323:         this.worker = new Worker(workerSource, opts);
324:       } else {
325:         // npm bundle / dev path: point at a sibling worker file.
326:         let workerUrl: string | URL;
327:         const selfUrl =
328:           typeof import.meta.url === "string" ? import.meta.url : undefined;
329:         if (selfUrl) {
330:           workerUrl = new URL(
331:             `./embedding-worker${selfUrl.endsWith(".ts") ? ".ts" : ".js"}`,
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           workerUrl = new URL(
337:             "./embedding-worker.cjs",
338:             pathToFileURL(__filename),
339:           );
340:         }
341:         this.worker = new Worker(workerUrl, {
342:           workerData: workerInitData,
343:         });
344:       }
345: 
346:       // ...

Edit applied successfully.

<path>/home/byk/Code/opencode-lore/packages/core/src/embedding.ts</path>
<type>file</type>
<content>
332:             selfUrl,
333:           );
334:         } else {
335:           const { pathToFileURL } = await import("node:url");
336:           const workerExt = __filename.endsWith(".ts") ? ".ts" : ".js";
337:           workerUrl = new URL(
338:             `./embedding-worker${workerExt}`,
339:             pathToFileURL(__filename),
340:           );
341:         }
342:         this.worker = new Worker(workerUrl, {
343:           workerData: workerInitData,
344:         });
345:       }
346: 
347:       // Don't let the worker prevent process exit.
348:       this.worker.unref();
349: 
350:       // Wire up response handler.
351:       this.worker.on("message", (msg: WorkerOutbound) => {

(Showing lines 332-351 of 1555. Use offset=352 to continue.)
</content>