Dev.to · Weio
1w ago
We measured a week of inference. Routing by task difficulty cuts our cost per call roughly 48x — and flips which users are profitable.
We did the thing everyone building on LLMs does. We defaulted to a strong frontier model, because the demo has to be good and nobody gets fired for picking the