▶ Videos →

📰 Dev.to · SomeOddCodeGuy

6 articles · Updated every 3 hours · View all reads

All Articles 134,300 Blog Posts 138,686 Tech Tutorials 34,877 Research Papers 25,959 News 18,908 ⚡ AI Lessons

Using the System Prompt / Preferences Field

Dev.to · SomeOddCodeGuy ⚡ AI Lesson 1mo ago

Using the System Prompt / Preferences Field

This is one of those "Obvious, but not everyone does it" things that I wanted to call out: the...

Llama.cpp's New MTP on MacOS

Dev.to · SomeOddCodeGuy 2mo ago

Llama.cpp's New MTP on MacOS

MTP So I decided to test out the new MTP in llama.cpp on Metal using my M2 Ultra, and...

Building and Running Llama.cpp on an Air-Gapped Mac

Dev.to · SomeOddCodeGuy 2mo ago

Building and Running Llama.cpp on an Air-Gapped Mac

If you ever tried to run Llama.cpp on a MacOS device that doesn't have internet on it, you've...

Wilmer Tool Calling

Dev.to · SomeOddCodeGuy 3mo ago

Wilmer Tool Calling

So some year and a half after the request was made for me to put tool calling into Wilmer, I've...

A Quick Note on Gemma 4 Image Settings in Llama.cpp

Dev.to · SomeOddCodeGuy 3mo ago

A Quick Note on Gemma 4 Image Settings in Llama.cpp

In my last post, I mentioned using --image-min-tokens to increase the quality of image responses from...

An Analogy to Help Understand Mixture of Experts

Dev.to · SomeOddCodeGuy 📐 ML Fundamentals ⚡ AI Lesson 5mo ago

An Analogy to Help Understand Mixture of Experts

If you're having a hard time understanding MoE strength vs dense models, and roughly where they might...