runtime: HTTP replies truncated to fs_read's file length — Content-Length lied, onboarding trapped #78

Closed

tim.lingo wants to merge 2 commits from fix/http-fs-read-len into main

Author	SHA1	Message	Date
Tim Lingo	f34270d63d	runtime: fs_read length hint must be paired with its buffer — fixes truncated HTTP responses El SDK Release / build-and-release (pull_request) Failing after 25s Details The binary-safe fs_read length (_tl_fs_read_len) was consumed by the HTTP response path for ANY body, even when the handler wrapped the file into a larger reply. Content-Length then lied AND the send stopped short: the safety-contact routes returned 178 of 208/218 bytes, cut mid-'set_at' — unparseable JSON. The desktop app read that as failure: fresh installs trapped at 'Set your safety contact' (POST reply mangled) and configured users saw the gate re-appear every launch (GET reply mangled). Worse, a stale hint LARGER than a later body would over-read heap memory out the socket. Fix: pair the hint with the exact buffer pointer it describes; consume it only when the response IS that buffer (binary file serving keeps working, the hint follows the worker's copy); reset both at request start. Also ports engram_get_node_by_label (from releases/v1.0.0) needed by soul.el session continuity in local mode — not-found returns "" (matches shipped behavior; '{}' flips the truthiness check upstream). Verified: genesis boot + byte-math E2E on :7797 sandbox — safety-contact GET/POST/GET all Content-Length==body, json-parse clean; /health, /api/config regressions match. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>	2026-07-17 18:25:21 -05:00
Tim Lingo	f76ccc0590	engram: ranked BM25+recency search replaces storage-order substring; URL-decode GET query params Measured on the live container mind (pinned 40-query eval, judged): substring 2/40=5% hit@5 -> ranked 35/40=88%. Multi-word queries stop returning zero; new memories stop losing to storage order (created_at tiebreak). Transparent-layer identity filter preserved in both passes; jb_finish (#64) tail preserved. query_param now url_decode()s values - %XX arrived literal before (pre-existing GET defect, masked while multi-word substring returned nothing anyway). E2E-verified in Tim's container deployment 2026-07-14/15; eval harness: docs repo research-archive/p0-prototypes/eval_pinned_40q_20260715.py. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>	2026-07-15 07:48:09 -05:00

Author

SHA1

Message

Date

Tim Lingo

f34270d63d

runtime: fs_read length hint must be paired with its buffer — fixes truncated HTTP responses

El SDK Release / build-and-release (pull_request) Failing after 25s

Details

The binary-safe fs_read length (_tl_fs_read_len) was consumed by the HTTP
response path for ANY body, even when the handler wrapped the file into a
larger reply. Content-Length then lied AND the send stopped short: the
safety-contact routes returned 178 of 208/218 bytes, cut mid-'set_at' —
unparseable JSON. The desktop app read that as failure: fresh installs
trapped at 'Set your safety contact' (POST reply mangled) and configured
users saw the gate re-appear every launch (GET reply mangled). Worse, a
stale hint LARGER than a later body would over-read heap memory out the
socket.

Fix: pair the hint with the exact buffer pointer it describes; consume it
only when the response IS that buffer (binary file serving keeps working,
the hint follows the worker's copy); reset both at request start. Also
ports engram_get_node_by_label (from releases/v1.0.0) needed by soul.el
session continuity in local mode — not-found returns "" (matches shipped
behavior; '{}' flips the truthiness check upstream).

Verified: genesis boot + byte-math E2E on :7797 sandbox — safety-contact
GET/POST/GET all Content-Length==body, json-parse clean; /health,
/api/config regressions match.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>

2026-07-17 18:25:21 -05:00

Tim Lingo

f76ccc0590

engram: ranked BM25+recency search replaces storage-order substring; URL-decode GET query params

Measured on the live container mind (pinned 40-query eval, judged): substring
2/40=5% hit@5 -> ranked 35/40=88%. Multi-word queries stop returning zero; new
memories stop losing to storage order (created_at tiebreak). Transparent-layer
identity filter preserved in both passes; jb_finish (#64) tail preserved.
query_param now url_decode()s values - %XX arrived literal before (pre-existing
GET defect, masked while multi-word substring returned nothing anyway).
E2E-verified in Tim's container deployment 2026-07-14/15; eval harness:
docs repo research-archive/p0-prototypes/eval_pinned_40q_20260715.py.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>

2026-07-15 07:48:09 -05:00

runtime: HTTP replies truncated to fs_read's file length — Content-Length lied, onboarding trapped #78

2 Commits