Files
el/engram/test/test_interoception_p2_chrono.c
T
bigmerge bacaf3d39c
El SDK CI - dev / build-and-test (pull_request) Failing after 4m49s
engram: reconcile M8 HNSW vindex (#109) onto current dev, restore 3 fixes the branch predated
Lands feat/reframe-region-setop (PR #109: native set-based reframe_region,
decorator-as-seam @route port, teacher-summon, and the M8.1 activate-latency
work — lazy-memoized cosq via eg_cosq_at + engram_vindex HNSW-accelerated
seed discovery + vindex_harvest_from_store/vindex_bench oracle) onto dev's
actual current HEAD, plus engram-tiered-storage's still-unique test suite.

RECONCILING #109 WITH engram-tiered-storage (M4-M10 HNSW/geometry/reason/
verify work): not a two-way merge. engram_vindex.c's HNSW core (search_layer/
select_neighbors/prune_links/insert) is BYTE-IDENTICAL between the two
branches; #109's copy is a strict superset (adds vindex_harvest_from_store,
used by vindex_bench.c's brute-force-vs-HNSW oracle). engram_reason.c and
engram_verify.c are also byte-identical. #109's own branch point already
carried engram-tiered-storage's M4-M10 lineage forward, so there was nothing
left to merge into #109 for those files. The one thing engram-tiered-storage
had that #109's tree dropped: its full test suite (test_vindex.c,
test_geometry.c, test_reason.c, test_verify.c, test_m7_traversal.c, the
interoception P0-P5 tests, bufpool/compaction tests, and their run_*.sh
harnesses) — ported over here unchanged.

WHY THIS NEEDED HAND RECONCILIATION, NOT A MECHANICAL MERGE: #109's branch
forked from dev on 2026-08-14 15:40 (before restructure-adjacent history
diverged the file's merge-base for `git merge` — it presented as an add/add
conflict). A straight two-dot diff (dev tip -> PR tip) applied cleanly, but
it silently reverted THREE dev fixes landed on 2026-08-14/15, after the
branch point, that the PR's diff had no way to know about:

  1. qgate rescale (2026-08-14 self-review): PR's lazy eg_cosq_at rewrite of
     the query-aware propagation gate dropped the shift-and-floor rescale
     about ENGRAM_EMBED_S0 (measured: unrelated-pair median 0.562->raw gate
     0.67, i.e. "a small tax, not a gate"). Restored the rescale, wrapped
     around the lazy accessor -- the PR's actual improvement (WHEN cosq[oi]
     is computed) is orthogonal to WHAT it gates on and both are kept.
  2. Eviction cause decomposition (2026-08-14 self-review): dev decomposes
     wm_evicted into evict_floor/evict_cap/evict_bll so WM churn is
     diagnosable (identity: evicted == floor+cap+bll+dup_wm+dup_wm_global).
     PR's tree predates this and dropped all three counters + their JSON
     stats fields. Restored declarations, all 4 direct increment sites, the
     eg_wm_carry_over bll increment, and the act-stats JSON fields --
     alongside (not instead of) the PR's own P4 afferent / API-reshape
     counters already in that same struct/JSON.
  3. Hebbian link-formation selection (2026-08-15 self-review, TODAY): dev
     selects the STRONGEST qualifying candidate for consolidation each call;
     PR's tree predates this and reverted to hash-slot order (arbitrary wrt
     association strength) for edge formation -- the one path that writes
     PERMANENT structure. Restored the strongest-candidate while-loop,
     keeping the PR's own genuine improvement at that site
     (engram_adj_on_edge_added incremental-index append instead of a bare
     adj_dirty=1 full-rebuild flag).

engram/src/server.el's 3-way conflicts (autoconnect_on/ise_offgraph_on env
flags, /api/nodes connected-count in responses) were pure additive: dev's
side was empty, PR's side added the feature. Took PR's side whole.

VERIFIED (nsbx sandbox only, live :8742/:7770 never touched):
  - cc -std=c11 -O2, clean link against the real engram/src/server.el via
    elc, zero errors.
  - vindex_bench (built standalone, read-only harvest) against the real
    production store clone (13,671 embedded nodes, 768-dim nomic-embed-text):
    recall@10 = 1.0000 at ef 64/128/200; HNSW search 0.28-0.79ms/query vs
    2.03ms/query brute-force oracle (2.6x-7.2x). HNSW build itself: 46.5s
    for the full 13,671-node set -- see the flagged risk below.
  - Booted the reconciled binary in an isolated nsbx sandbox (:8905, cloned
    snapshot of the live store, 13,424 nodes / 37,656 edges) and called
    /api/activate for real: first call after boot 41.5s (pays the one-time
    HNSW build inline -- matches the standalone bench), second/third calls
    356ms/605ms, no crash, correct results, act-stats JSON (including the
    restored evict_floor/cap/bll fields) reads correctly.

KNOWN RISK TO FLAG BEFORE ANY LIVE CUTOVER (not fixed here; out of scope for
this dev-only land per instructions not to touch :8742/:7770): eg_vindex_sync
builds the HNSW index synchronously, inline, on the first engram_activate()
call after every process start (or index invalidation). On the real node
count that is a ~46s blocking stall on a single-threaded server -- the first
request after every restart (or its concurrent siblings) waits the full
build. Recommend a background/incremental build (or a bounded per-call build
budget) before this ever reaches the live daemon. See PR description / final
report for the fuller writeup.
2026-08-15 16:46:44 -05:00

96 lines
4.0 KiB
C

/* test_interoception_p2_chrono.c — M-INTEROCEPTION Priority 2.
* Chronoception: engram_age_field(delta_ms) + reboot catch-up
* (ENGRAM_CHRONOCEPTION, default OFF).
*
* Uses loaded snapshots with KNOWN working_memory_weight / background_activation
* so the field is deterministic without depending on activation. (engram_load
* halves WM on boot — the laundering step — so snapshot wm 1.0 -> 0.5 resident.)
*
* Modes:
* once <dir> <dt_ms> — age the field once by dt; save field.json.
* split <dir> <dt_ms> <N> — age by dt/N, N times; save field.json.
* (once vs split must match: scale-invariance.)
* catchup <dir> <gap_ms> — write a last-tick gap_ms in the past, then
* engram_age_field_catchup(); print MAGNITUDE.
* offcheck <dir> <dt_ms> — flag OFF: age returns 0 and field is untouched.
*/
#include "el_runtime.h"
#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <sys/time.h>
static el_val_t S(const char* s){ return EL_STR(s); }
static void write_seed(const char* dir){
char p[1024]; snprintf(p,sizeof p,"%s/seed.json",dir);
FILE* f=fopen(p,"w");
fprintf(f,"{\"nodes\":["
"{\"id\":\"f1\",\"content\":\"field node 1\",\"node_type\":\"Concept\",\"label\":\"f1\","
"\"salience\":0.9,\"confidence\":1.0,\"working_memory_weight\":1.0,\"background_activation\":0.5},"
"{\"id\":\"f2\",\"content\":\"field node 2\",\"node_type\":\"Concept\",\"label\":\"f2\","
"\"salience\":0.8,\"confidence\":1.0,\"working_memory_weight\":0.8,\"background_activation\":0.4},"
"{\"id\":\"f3\",\"content\":\"field node 3\",\"node_type\":\"Concept\",\"label\":\"f3\","
"\"salience\":0.7,\"confidence\":1.0,\"working_memory_weight\":0.6,\"background_activation\":0.3}"
"],\"edges\":[]}");
fclose(f);
}
static void load_seed(const char* dir){
char p[1024]; snprintf(p,sizeof p,"%s/seed.json",dir);
write_seed(dir);
if(!engram_load(S(p))){ fprintf(stderr,"load failed\n"); exit(2); }
}
static void save_field(const char* dir){
char p[1024]; snprintf(p,sizeof p,"%s/field.json",dir);
engram_save(S(p));
}
int main(int argc,char** argv){
if(argc<3){ fprintf(stderr,"usage: %s <once|split|catchup|offcheck> <dir> ...\n",argv[0]); return 2; }
const char* mode=argv[1];
const char* dir =argv[2];
if(!strcmp(mode,"once")){
double dt=atof(argv[3]);
load_seed(dir);
el_val_t mag=engram_age_field((el_val_t)(int64_t)dt);
printf("MAGNITUDE %.10f\n", el_to_float(mag));
save_field(dir);
return 0;
}
if(!strcmp(mode,"split")){
double dt=atof(argv[3]); int N=atoi(argv[4]); if(N<1)N=1;
load_seed(dir);
double sub=dt/(double)N;
for(int i=0;i<N;i++) engram_age_field((el_val_t)(int64_t)sub);
save_field(dir);
printf("SPLIT dt=%.0f N=%d sub=%.4f\n", dt, N, sub);
return 0;
}
if(!strcmp(mode,"catchup")){
double gap=atof(argv[3]);
load_seed(dir);
/* Write a last-tick gap_ms in the past. ENGRAM_DATA_DIR is set == dir by
* the runner, so the sidecar the runtime reads is <dir>/chrono_last_tick. */
struct timeval tv; gettimeofday(&tv,NULL);
long long now_ms=(long long)tv.tv_sec*1000+tv.tv_usec/1000;
long long last=now_ms-(long long)gap;
char p[1200]; snprintf(p,sizeof p,"%s/chrono_last_tick",dir);
FILE* f=fopen(p,"w"); fprintf(f,"%lld\n",last); fclose(f);
el_val_t mag=engram_age_field_catchup();
printf("CATCHUP_MAGNITUDE %.10f\n", el_to_float(mag));
save_field(dir);
return 0;
}
if(!strcmp(mode,"offcheck")){
double dt=atof(argv[3]);
load_seed(dir);
el_val_t mag=engram_age_field((el_val_t)(int64_t)dt);
el_val_t magc=engram_age_field_catchup();
printf("OFF age_mag=%.10f catchup_mag=%.10f\n", el_to_float(mag), el_to_float(magc));
save_field(dir);
return 0;
}
fprintf(stderr,"unknown mode %s\n",mode); return 2;
}