Distillation

Date: Sep 16, 2026

• 🔴 (11:07) User’s Responses failure-handling invariant: failed output is never authoritative and must not reach accounting hooks.
• 🔴 (11:07) User’s Responses accounting invariant: failed usage/accounting never depends on client demand.
• 🔴 (11:07) In packages/gateway/src/stream/openai-responses.ts, restoreResponsesAccState(state, snapshot) deletes state keys absent from the snapshot and then restores the snapshot with Object.assign(state, snapshot) (lines 588–596).
• 🔴 (11:07) In packages/gateway/src/stream/openai-responses.ts, PUBLIC_GATEWAY_ERROR is "Gateway request failed"; sanitizeResponsesProviderFailureTerminal(...) constructs the only provider-failure payload allowed across the gateway boundary, keeping provider diagnostics and failed output private while retaining stable protocol fields needed to close the response lifecycle.
• 🔴 (11:07) Provider-failure work is organized as 6 successive commits: 1. d385b39653b0085833e281b6347b15071cee6801 / change prpmozzzqvktqmyxkmyprklpmqxwktkv, fix(responses): sanitize provider failures; 2. 29dee093d7ceed38b0ed823c9d5b26f8c1ba3d7c / change qnlnmzlxyynvkvssnkusztrzyxzylkzo, fix(responses): bind sanitized failures to trusted state; 3. b1bc7cd46c4eb09f23a7a5c6db257c380401ca02 / change xqmskzvmnqkrnvmyrznrxkxsxtwyurvu, fix(responses): complete provider failure sanitization; 4. 01a6e06b08ba1b54f42c5b4c757ec449eb8e8490 / change skwrwnvkvulpwztqsvprtnrozswvtptx, fix(responses): make provider failure settlement atomic; 5. a1020a45be1382893a183e2ff39506e78a08fb76 / change plzxzousrzuvukvvtzlvvynqpokuptqu, fix(responses): preserve trusted failure metadata; 6. 24880457763b6f10831856d01c41bd72d62ddc28 / change wswlsmrnuzlqtxyskqotksrlqtzplrkl, fix(responses): reject non-monotonic provider failures.
• 🔴 (11:07) Commit 24880457763b6f10831856d01c41bd72d62ddc28 is bookmarked fix/responses-provider-failures and fix/responses-provider-failures@git; it changes packages/gateway/src/pipeline.ts (19 additions), packages/gateway/src/stream/openai-responses.ts (35 changed lines), and packages/gateway/test/openai-responses-recall-aware-stream.test.ts (233 additions), totaling 275 insertions and 12 deletions across 3 files.
• 🔴 (11:07) Commit a1020a45be1382893a183e2ff39506e78a08fb76 changes packages/gateway/src/stream/openai-responses.ts and the tests packages/gateway/test/openai-responses-recall-aware-stream.test.ts and packages/gateway/test/openai-responses-stream.test.ts, totaling 210 insertions and 10 deletions across 3 files.
• 🔴 (11:08) Commit d385b39653b0085833e281b6347b15071cee6801 changes packages/gateway/src/pipeline.ts, packages/gateway/src/stream/openai-responses.ts, packages/gateway/test/openai-responses-recall-aware-stream.test.ts, packages/gateway/test/openai-responses-stream.test.ts, packages/gateway/test/pipeline-streaming.test.ts, and packages/gateway/test/recall-codex-stream.test.ts, totaling 313 insertions and 63 deletions across 6 files.
• 🔴 (11:08) Commit 29dee093d7ceed38b0ed823c9d5b26f8c1ba3d7c changes packages/gateway/src/pipeline.ts, packages/gateway/src/stream/openai-responses.ts, packages/gateway/test/openai-responses-recall-aware-stream.test.ts, and packages/gateway/test/openai-responses-stream.test.ts, totaling 301 insertions and 23 deletions across 4 files.
• 🔴 (11:08) Commit b1bc7cd46c4eb09f23a7a5c6db257c380401ca02 changes packages/gateway/src/pipeline.ts, packages/gateway/src/stream/openai-responses.ts, packages/gateway/test/openai-responses-recall-aware-stream.test.ts, and packages/gateway/test/openai-responses-stream.test.ts, totaling 316 insertions and 12 deletions across 4 files.
• 🔴 (11:08) Commit 01a6e06b08ba1b54f42c5b4c757ec449eb8e8490 changes packages/gateway/src/pipeline.ts, packages/gateway/src/stream/openai-responses.ts, packages/gateway/test/openai-responses-recall-aware-stream.test.ts, packages/gateway/test/openai-responses-stream.test.ts, and packages/gateway/test/pipeline-streaming.test.ts, totaling 1,742 insertions and 476 deletions across 5 files.
• 🔴 (11:08) All 6 provider-failure commits list author Burak Yigit Kaya <ben@byk.im> and were committed by Burak Yigit Kaya on Sep 16, 2026; the first 5 were committed at 10:18:43, while 24880457763b6f10831856d01c41bd72d62ddc28 was committed at 10:39:21.
• 🔴 (11:08) packages/gateway/src/pipeline.ts contains 13 referenceIdentities matches at lines 7884, 8459, 8582, 9483, 9488, 9547, 9561, 10785, 11301, 11302, 11303, 11548, and 11761; uses include initialization as new Set<string>(), duplicate/identity checks, additions, snapshot cloning into referenceIdentities: new Set(referenceIdentities), and clearing/restoring from continuationRetryBaseline.referenceIdentities.