Distillation

Date: Sep 16, 2026

• 🟡 (12:26) Tool result reported a clean/empty diff: 0 files changed, 0 insertions(+), 0 deletions(-) with SHA-256 e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855.
• 🟡 (12:29) A template parse failed because keyword commit_id does not exist in commit_id ++ " " ++ description.first_line() ++ "\n"; the tool suggested commit.
• 🟡 (12:32) Repository history showed commit 1512d486 with description fix(responses): unify provider failure handling, authored by ben@byk.im at 2026-09-16 11:49:37, on top of hidden empty commit e19ee1c7; associated operation IDs were 58a2b9a6dcc9 and 9c44ffd239ad.
• 🔴 (12:34) User-provided invariant in packages/gateway/src/stream/openai-responses.ts around lines 12255-12262: when content parsing fails before usage validation, parsing may be retried on only usage and usageMetadata to retain numeric/cache consistency checks; invalid usage still throws, and the projection is “never returned as success.”
• 🔴 (12:34) parseResponsesNonStreamEnvelope() accepts statuses completed and incomplete for completion-shape validation, but accumulateNonStreamResponse() throws ResponsesTerminalError whenever the parsed status is not completed.
• 🔴 (12:34) accumulateResponsesNonStreamJSON() excludes item_reference entries from replayable output, rejects duplicate or missing response-item identities with malformed Responses response item identity, and rejects duplicate or missing tool identities with malformed Responses response tool identity.
• 🔴 (12:34) Responses non-stream parsing maps incomplete_details.reason === "content_filter" to stop reason content_filter; other incomplete responses map to max_tokens; a response containing tool_use changes end_turn to tool_use.
• 🔴 (12:34) Responses usage parsing prefers input_tokens_details and falls back to prompt_tokens_details; it reports cached_tokens as cacheReadInputTokens and cache_write_tokens as cacheCreationInputTokens.
• 🔴 (12:34) accountUnsuccessfulResponse() records validated nonzero provider usage through accountConversationUsage(), optionally marks state dirty, adds GenAI usage attributes, then sets span status code 2 with message upstream response did not complete and ends the span.
• 🔴 (12:34) captureUnsuccessfulResponses() converts a ResponsesTerminalError with status incomplete into { response, successful: false }; other terminal statuses yield undefined. The non-stream path returns HTTP 502 for no captured response or when an unsuccessful incomplete response contains recall tool use; otherwise it emits the incomplete response without treating it as successful.
• 🔴 (12:36) Meta/side-channel passthrough preserves non-OK provider responses as ordinary HTTP responses via preserveUpstreamErrorResponse() rather than running 4xx/429 bodies through an SSE validator that could turn them into status 200 or a synthetic stream failure.
• 🔴 (12:36) Passthrough routing treats Vertex as wire-equivalent to Anthropic (vertex → anthropic), allowing same-wire Anthropic clients to stream unchanged; cross-protocol buffering/re-emission is reserved for genuinely different wire protocols.
• 🔴 (12:36) Provisional session routing resolves and validates route intent once but keeps it private until a complete response and client EOF confirm the provisional identity.
• 🔴 (12:36) User-provided security directive for provisional identity requests: provider diagnostics must “never expose them while proving a session identity.” Non-OK upstream bodies are cancelled and returned through sanitizedUpstreamErrorResponse().
• 🔴 (12:36) Prompt-overflow handling recognizes HTTP 400 bodies containing prompt is too long, context_length_exceeded, or maximum context length; it computes overshootRatio = actual/max, defaults unparseable errors to 1.3, and escalates to compression layer 3 when the ratio is at least 1.2, otherwise layer 2.
• 🔴 (12:36) finalizeWithRecall() intercepts gateway-injected recall tool use before client delivery and supports multiple recall calls, including drill-down into t:<id> source citations; resource, progress, and time budgets normally stop the chain before its emergency ceiling.