All
Articles 168,126Blog Posts 160,039Tech Tutorials 44,639Research Papers 32,781News 21,449
⚡ AI Lessons
Dev.to · Wayne
🧠 Large Language Models
⚡ AI Lesson
3w ago
Measuring LLM Prefix Caching: The Cache Hit Rate Metric
Prefix caching is one of the biggest cost levers in LLM serving. vLLM, SGLang, TGI, and most hosted...
Dev.to · Wayne
🧠 Large Language Models
⚡ AI Lesson
3w ago
llmperf Is Archived: Alternatives for LLM Benchmarking
If you've been using ray-project/llmperf, you may have noticed it's now in archive mode. No new...
Dev.to · Wayne
☁️ DevOps & Cloud
4mo ago
Ansible at Home
Ansible automation for home environments.
Dev.to · Wayne
📊 Data Analytics & Business Intelligence
⚡ AI Lesson
4mo ago
Making Compression a Habit with zstd
A practical guide to using zstd compression for data processing, log management, and cost-effective file storage in Python and Linux.
Dev.to · Wayne
🧠 Large Language Models
⚡ AI Lesson
4mo ago
Using hf tokenizers in Rust
Master Rust tokenizers with Hugging Face's powerful library. Learn to implement text tokenization, encoding/decoding, and work with pretrained models like GPT-2
Dev.to · Wayne
☁️ DevOps & Cloud
⚡ AI Lesson
4mo ago
Setting Up Docker CI for Rust with cargo-dist
How to set up a Docker CI pipeline for Rust using cargo-dist and GitHub Actions, with multi-architecture amd64 and arm64 support using distroless images.
Dev.to · Wayne
🔧 Backend Engineering
⚡ AI Lesson
4mo ago
Learnings of the Poor
Practical techniques for optimizing Python code in resource-constrained environments, focusing on memory-efficient patterns like iterators and streaming pipelin
Dev.to · Wayne
🧠 Large Language Models
⚡ AI Lesson
4mo ago
How to Benchmark LLM Inference Performance: TTFT, ITL, and Throughput Metrics
When deploying large language models to production, measuring performance accurately is critical....
DeepCamp AI