Andrew Fribush
fig. 2.2.1 · the setup cost of a faster query, and the repeat that pays it back.
CUMULATIVE TIME, MS · DENSE VS AUTO ROUTE · RTX 4090 · 50,000 ROWS05001,0001,5002,00015152025309REPEATS OF THE SAME QUERY ON ONE PREPARED OBJECTDRAG THE AXIS FOR YOUR OWN COUNTAUTO STARTS 288 MS BEHINDAND SAVES 38 MS A QUERYDENSEAUTOAUTO AHEADFROM QUERY 9EXISTING ARXIV 0.9, Q9HOLDOUT ARXIV 0.925, Q8HOLDOUT COCO 0.85, Q24

existing arXiv 0.9: 288.07 ms extra setup ÷ 38.23 ms saved a query = 7.54, so auto is ahead in total from query 9. A job that builds the graph once pays the setup and never collects.

First use is timed after route warmup and excludes cold context and JIT startup, so the real crossing is later than this one, not earlier.

source: gpu-threshold-join benchmarks/preserved/portfolio-selector-2026-09-18 summary.md · setupCost.data.ts

All figures

Andrew Fribush, software and computer engineer in Austin. I build consequential systems where software meets institutions: finance, healthcare, commerce, government data, and the mechanisms that govern AI agents. Taking new engagements: hello@andrewfribush.com.