📰 Dev.to · aldielshala

1 article · Updated every 3 hours · View all reads

All Articles 95,256 Blog Posts 111,879 Tech Tutorials 24,009 Research Papers 20,249 News 15,274 ⚡ AI Lessons

llm.sql - Run a 640MB LLM on SQLite, with 210MB peak RSS and 7.4 tok/s

Dev.to · aldielshala 2mo ago

llm.sql - Run a 640MB LLM on SQLite, with 210MB peak RSS and 7.4 tok/s

I built llm.sql, an LLM inference framework that reimagines the LLM execution pipeline as a series of...