▶ Videos →

📰 Dev.to · deharoalexandre-cyber

1 article · Updated every 3 hours · View all reads

All Articles 121,436 Blog Posts 128,060 Tech Tutorials 31,113 Research Papers 24,281 News 17,495 ⚡ AI Lessons

I built an Ollama alternative with TurboQuant, model groups, and multi-GPU support

Dev.to · deharoalexandre-cyber 📐 ML Fundamentals ⚡ AI Lesson 3mo ago

I built an Ollama alternative with TurboQuant, model groups, and multi-GPU support

EIE is a policy-driven multi-model GGUF inference server. TurboQuant-native KV cache, CUDA + ROCm, parallel/sequential model groups, Apache 2.0.