Dev.to · Jason Duke
2mo ago
Stop Paying Frontier Prices for Tasks a Local Model Handles Fine
Small LLMs got good. Here's an open-source Go proxy that auto-classifies prompts and routes to the cheapest capable model, with a quality validation safety net.