✕ Clear all filters
4 articles
▶ Videos →

📰 Dev.to · Tech_Nuggets

4 articles · Updated every 3 hours · View all reads

All Articles 134,300Blog Posts 138,686Tech Tutorials 34,877Research Papers 25,959News 18,908 ⚡ AI Lessons
KV cache and PagedAttention: what they do and why they matter
Dev.to · Tech_Nuggets 🧠 Large Language Models ⚡ AI Lesson 1mo ago
KV cache and PagedAttention: what they do and why they matter
An explanation of the KV cache memory problem in production LLM serving and how PagedAttention (the technique behind vLLM) solves it with OS-inspired virtual me
View lesson → + Playlist
The Model Context Protocol (MCP): what it is and how to build a server
Dev.to · Tech_Nuggets 🧠 Large Language Models ⚡ AI Lesson 1mo ago
The Model Context Protocol (MCP): what it is and how to build a server
A practical walkthrough of the Model Context Protocol — what it is, how JSON-RPC 2.0 transports work, and how to build an MCP server in Python with FastMCP.
View lesson → + Playlist
Quantization formats compared: GGUF vs GPTQ vs AWQ vs NF4
Dev.to · Tech_Nuggets 🧠 Large Language Models ⚡ AI Lesson 1mo ago
Quantization formats compared: GGUF vs GPTQ vs AWQ vs NF4
A practical comparison of the four major LLM weight quantization formats — which one to use for CPU, GPU serving, and fine-tuning, with current version numbers
View lesson → + Playlist
KV cache quantization: what FP8/INT8 K and V actually buy you, and where they break
Dev.to · Tech_Nuggets 🧠 Large Language Models ⚡ AI Lesson 1mo ago
KV cache quantization: what FP8/INT8 K and V actually buy you, and where they break
FP8 and INT8 KV caches cut attention state ~50%, but they shift the target model's logit distribution — and that can quietly halve the gains from speculative de
View lesson → + Playlist