▶ Videos →

📰 Dev.to · SomeOddCodeGuy

3 articles · Updated every 3 hours · View all reads

All Articles 164,362 Blog Posts 157,925 Tech Tutorials 43,543 Research Papers 31,766 News 21,160 ⚡ AI Lessons

Llama.cpp's New MTP on MacOS

Dev.to · SomeOddCodeGuy 🧠 Large Language Models ⚡ AI Lesson 3mo ago

Llama.cpp's New MTP on MacOS

MTP So I decided to test out the new MTP in llama.cpp on Metal using my M2 Ultra, and...

Building and Running Llama.cpp on an Air-Gapped Mac

Dev.to · SomeOddCodeGuy 🧠 Large Language Models ⚡ AI Lesson 3mo ago

Building and Running Llama.cpp on an Air-Gapped Mac

If you ever tried to run Llama.cpp on a MacOS device that doesn't have internet on it, you've...

A Quick Note on Gemma 4 Image Settings in Llama.cpp

Dev.to · SomeOddCodeGuy 🧠 Large Language Models ⚡ AI Lesson 4mo ago

A Quick Note on Gemma 4 Image Settings in Llama.cpp

In my last post, I mentioned using --image-min-tokens to increase the quality of image responses from...