torus overhead bench
Generated 2026-10-18T02:37:44.313Z
Model(s) zai/glm-5.3-flash, zai/glm-5.3
Engine node_modules/.bin/pi (pin 1.3.0)
torus 0.14.0 @ commit 8f4da67
Runs 3 measured per task × config, 1 warmup discarded, config order rotated per pass
Summary torus 0.14.0 vs stock per model: totals (sum of per-task medians), the overhead delta, and its movement since the model's prior sidecar run.
model field stock torus Δ overhead Δ change zai/glm-5.3-flash tokens in 8,195 11,899 +3,704 +2,797 vs torus 0.6.0 zai/glm-5.3-flash cache read 64,768 180,480 +115,712 -5,696 vs torus 0.6.0 zai/glm-5.3-flash cost $0.0039 $0.0084 +$0.0045 +$0.0007 vs torus 0.6.0 zai/glm-5.3-flash ms 72,276 ms 96,867 ms +24,591 -31,036 vs torus 0.6.0 zai/glm-5.3 tokens in 25,053 14,730 -10,323 -664 vs torus 0.6.0 zai/glm-5.3 cache read 56,768 146,048 +89,280 -1,408 vs torus 0.6.0 zai/glm-5.3 cost $0.0569 $0.0646 +$0.0077 -$0.0028 vs torus 0.6.0 zai/glm-5.3 ms 61,132 ms 89,135 ms +28,003 -10,581 vs torus 0.6.0
Run history Δ = torus − stock totals (sum of per-task medians) per model and run; history accumulates in the JSON sidecar.
run model Δ tokens in Δ cache read Δ cost Δ ms 2026-10-07 · torus 0.6.0 · 1c7256e · engine 1.0.4 zai/glm-5.3-flash +907 +121,408 +$0.0038 +55,627 2026-10-07 · torus 0.6.0 · 1c7256e · engine 1.0.4 zai/glm-5.3 -9,659 +90,688 +$0.0105 +38,584 2026-10-18 · torus 0.14.0 · 8f4da67 · engine 1.3.0 zai/glm-5.3-flash +3,704 +115,712 +$0.0045 +24,591 2026-10-18 · torus 0.14.0 · 8f4da67 · engine 1.3.0 zai/glm-5.3 -10,323 +89,280 +$0.0077 +28,003
zai/glm-5.3-flash
turns
stock torus readme-name 2 2 agents-doc-headings 2 2 register-tool-count 2 2 skills-inventory 2 2 extension-registration 3 ±1 3 ±1 engine-pin-report 3 ±0 3 ±0
tokens in
stock torus readme-name 685 ±1,088 1,156 ±2,889 agents-doc-headings 2,406 ±1,104 3,038 ±3,043 register-tool-count 81 ±20 143 ±9 skills-inventory 134 ±1 195 ±2 extension-registration 3,857 ±1,409 5,847 ±2,467 engine-pin-report 1,032 ±72 1,520 ±289
tokens out
stock torus readme-name 92 ±5 85 ±3 agents-doc-headings 400 ±5 467 ±8 register-tool-count 77 ±28 92 ±20 skills-inventory 114 ±6 117 ±8 extension-registration 683 ±23 660 ±115 engine-pin-report 141 ±5 136 ±25
cache read
stock torus readme-name 8,704 ±1,088 24,320 ±2,848 agents-doc-headings 8,640 ±1,104 24,320 ±3,040 register-tool-count 8,704 24,320 skills-inventory 8,704 24,320 extension-registration 16,448 ±3,344 45,824 ±8,976 engine-pin-report 13,568 ±1,200 37,376 ±3,408
cache write
stock torus readme-name 0 0 agents-doc-headings 0 0 register-tool-count 0 0 skills-inventory 0 0 extension-registration 0 0 engine-pin-report 0 0
cost
stock torus readme-name $0.0004 ±$0.0001 $0.0009 ±$0.0003 agents-doc-headings $0.0008 ±$0.0001 $0.0014 ±$0.0004 register-tool-count $0.0003 ±$0.0000 $0.0008 ±$0.0000 skills-inventory $0.0003 ±$0.0000 $0.0008 ±$0.0000 extension-registration $0.0014 ±$0.0003 $0.0029 ±$0.0004 engine-pin-report $0.0006 ±$0.0000 $0.0015 ±$0.0001
ms
stock torus readme-name 11,426 ms ±1,298 ms 12,841 ms ±191 ms agents-doc-headings 12,280 ms ±812 ms 17,303 ms ±133 ms register-tool-count 8,035 ms ±529 ms 12,539 ms ±708 ms skills-inventory 11,177 ms ±3,618 ms 13,136 ms ±892 ms extension-registration 18,151 ms ±2,182 ms 24,919 ms ±3,558 ms engine-pin-report 11,207 ms ±5,445 ms 16,129 ms ±1,538 ms
Δ torus − stock vs noise task field Δ med noise (IQR) verdict readme-name turns 0 0 flat readme-name tokens in +471 5,777 within noise readme-name tokens out -7 10 within noise readme-name cache read +15,616 5,696 signal readme-name cache write 0 0 flat readme-name cost +$0.0005 $0.0007 within noise readme-name ms +1,415 2,595 ms within noise agents-doc-headings turns 0 0 flat agents-doc-headings tokens in +632 6,087 within noise agents-doc-headings tokens out +67 16 signal agents-doc-headings cache read +15,680 6,080 signal agents-doc-headings cache write 0 0 flat agents-doc-headings cost +$0.0006 $0.0007 within noise agents-doc-headings ms +5,023 1,623 ms signal register-tool-count turns 0 0 flat register-tool-count tokens in +62 41 signal register-tool-count tokens out +15 56 within noise register-tool-count cache read +15,616 0 signal register-tool-count cache write 0 0 flat register-tool-count cost +$0.0005 $0.0000 signal register-tool-count ms +4,504 1,416 ms signal skills-inventory turns 0 0 flat skills-inventory tokens in +61 4 signal skills-inventory tokens out +3 16 within noise skills-inventory cache read +15,616 0 signal skills-inventory cache write 0 0 flat skills-inventory cost +$0.0005 $0.0000 signal skills-inventory ms +1,959 7,236 ms within noise extension-registration turns 0 1 within noise extension-registration tokens in +1,990 4,934 within noise extension-registration tokens out -23 231 within noise extension-registration cache read +29,376 17,952 signal extension-registration cache write 0 0 flat extension-registration cost +$0.0015 $0.0009 signal extension-registration ms +6,768 7,115 ms within noise engine-pin-report turns 0 1 within noise engine-pin-report tokens in +488 579 within noise engine-pin-report tokens out -5 50 within noise engine-pin-report cache read +23,808 6,816 signal engine-pin-report cache write 0 0 flat engine-pin-report cost +$0.0009 $0.0002 signal engine-pin-report ms +4,922 10,889 ms within noise
zai/glm-5.3
turns
stock torus readme-name 2 2 agents-doc-headings 3 ±0 2 register-tool-count 2 2 skills-inventory 2 2 extension-registration 2 2 engine-pin-report 2 2
tokens in
stock torus readme-name 666 ±35 960 ±34 agents-doc-headings 2,586 ±675 3,008 ±1 register-tool-count 104 ±9 168 ±9 skills-inventory 146 ±4 192 ±33 extension-registration 20,705 ±5,169 8,958 ±17 engine-pin-report 846 ±35 1,444 ±4
tokens out
stock torus readme-name 68 ±1 74 ±7 agents-doc-headings 459 ±39 268 ±64 register-tool-count 117 ±10 104 ±2 skills-inventory 155 ±9 138 ±2 extension-registration 953 ±67 716 ±13 engine-pin-report 105 ±2 104 ±5
cache read
stock torus readme-name 8,640 24,320 agents-doc-headings 13,312 ±1,088 24,320 register-tool-count 8,704 24,320 skills-inventory 8,704 24,320 ±32 extension-registration 8,704 ±5,168 24,384 ±16 engine-pin-report 8,704 ±16 24,384
cache write
stock torus readme-name 0 0 agents-doc-headings 0 0 register-tool-count 0 0 skills-inventory 0 0 extension-registration 0 0 engine-pin-report 0 0
cost
stock torus readme-name $0.0035 ±$0.0001 $0.0079 ±$0.0000 agents-doc-headings $0.0091 ±$0.0011 $0.0117 ±$0.0003 register-tool-count $0.0029 ±$0.0001 $0.0070 ±$0.0000 skills-inventory $0.0031 ±$0.0000 $0.0072 ±$0.0000 extension-registration $0.0344 ±$0.0059 $0.0220 ±$0.0000 engine-pin-report $0.0039 ±$0.0000 $0.0088 ±$0.0000
ms
stock torus readme-name 5,616 ms ±859 ms 12,400 ms ±589 ms agents-doc-headings 11,020 ms ±243 ms 14,598 ms ±575 ms register-tool-count 6,014 ms ±696 ms 12,227 ms ±563 ms skills-inventory 8,704 ms ±1,383 ms 17,675 ms ±1,887 ms extension-registration 16,342 ms ±2,280 ms 19,717 ms ±1,603 ms engine-pin-report 13,436 ms ±2,515 ms 12,518 ms ±1,838 ms
Δ torus − stock vs noise task field Δ med noise (IQR) verdict readme-name turns 0 0 flat readme-name tokens in +294 70 signal readme-name tokens out +6 14 within noise readme-name cache read +15,680 0 signal readme-name cache write 0 0 flat readme-name cost +$0.0044 $0.0001 signal readme-name ms +6,784 1,719 ms signal agents-doc-headings turns -1 1 signal agents-doc-headings tokens in +422 1,351 within noise agents-doc-headings tokens out -191 127 signal agents-doc-headings cache read +11,008 2,176 signal agents-doc-headings cache write 0 0 flat agents-doc-headings cost +$0.0026 $0.0021 signal agents-doc-headings ms +3,578 1,149 ms signal register-tool-count turns 0 0 flat register-tool-count tokens in +64 19 signal register-tool-count tokens out -13 21 within noise register-tool-count cache read +15,616 0 signal register-tool-count cache write 0 0 flat register-tool-count cost +$0.0041 $0.0001 signal register-tool-count ms +6,213 1,391 ms signal skills-inventory turns 0 0 flat skills-inventory tokens in +46 66 within noise skills-inventory tokens out -17 18 within noise skills-inventory cache read +15,616 64 signal skills-inventory cache write 0 0 flat skills-inventory cost +$0.0040 $0.0001 signal skills-inventory ms +8,971 3,774 ms signal extension-registration turns 0 0 flat extension-registration tokens in -11,747 10,339 signal extension-registration tokens out -237 135 signal extension-registration cache read +15,680 10,336 signal extension-registration cache write 0 0 flat extension-registration cost -$0.0123 $0.0118 signal extension-registration ms +3,375 4,560 ms within noise engine-pin-report turns 0 0 flat engine-pin-report tokens in +598 69 signal engine-pin-report tokens out -1 10 within noise engine-pin-report cache read +15,680 32 signal engine-pin-report cache write 0 0 flat engine-pin-report cost +$0.0049 $0.0001 signal engine-pin-report ms -918 5,029 ms within noise
Method
Fixed, read-only, repo-local task set in three difficulty tiers (trivial / aggregate / reason); identical prompts run through both configs, so any delta comes from the harness layer.
Two configs : stock (bare engine, JSON mode) vs torus (same argv plus the canonical child extension set — byte-for-byte the spawn a delegation receives).
Warmup discarded : one warmup run per task × config runs first and is excluded from statistics (steady-state prompt cache, warm extension load path).
Interleaved rotation : measured passes alternate config order (stock, torus / torus, stock / …) so provider-side prompt-cache drift cancels across configs.
Medians with spread : cells are medians ± half the interquartile range over measured runs; a delta is labeled signal only when it exceeds the larger config's IQR.
Shared reducer : usage and cost fold out of the JSON event stream via the production reduceEngineEvent pipeline.
Caveats. Cache read/write deltas remain indicative: provider prompt caches can survive between runs, and torus's larger declaration surface inflates fresh-cache writes by construction. Tokens-in and cost deltas are the stable signals. Wall-clock includes extension loading at spawn. Numbers are self-reported by the engine per run.
Self-contained report — no external assets. Raw per-run records ship in the JSON sidecar.