📰 Dev.to · SomeOddCodeGuy

5 articles · Updated every 3 hours · View all reads

All Articles 78,881 Blog Posts 103,809 Tech Tutorials 19,237 Research Papers 17,244 News 13,548 ⚡ AI Lessons

Llama.cpp's New MTP on MacOS

Dev.to · SomeOddCodeGuy 3w ago

Llama.cpp's New MTP on MacOS

MTP So I decided to test out the new MTP in llama.cpp on Metal using my M2 Ultra, and...

Building and Running Llama.cpp on an Air-Gapped Mac

Dev.to · SomeOddCodeGuy 3w ago

Building and Running Llama.cpp on an Air-Gapped Mac

If you ever tried to run Llama.cpp on a MacOS device that doesn't have internet on it, you've...

Wilmer Tool Calling

Dev.to · SomeOddCodeGuy 1mo ago

Wilmer Tool Calling

So some year and a half after the request was made for me to put tool calling into Wilmer, I've...

A Quick Note on Gemma 4 Image Settings in Llama.cpp

Dev.to · SomeOddCodeGuy 2mo ago

A Quick Note on Gemma 4 Image Settings in Llama.cpp

In my last post, I mentioned using --image-min-tokens to increase the quality of image responses from...

An Analogy to Help Understand Mixture of Experts

Dev.to · SomeOddCodeGuy 3mo ago

An Analogy to Help Understand Mixture of Experts

If you're having a hard time understanding MoE strength vs dense models, and roughly where they might...