✕ Clear all filters
13 articles
▶ Videos →

📰 Dev.to · NARESH-CN2

13 articles · Updated every 3 hours · View all reads

All Articles 130,816Blog Posts 135,899Tech Tutorials 33,887Research Papers 25,445News 18,593 ⚡ AI Lessons
What Building a 20GB CSV Validator Taught Me About mmap
Dev.to · NARESH-CN2 📐 ML Fundamentals ⚡ AI Lesson 2mo ago
What Building a 20GB CSV Validator Taught Me About mmap
The Problem: The Ingestion BottleneckMost data pipelines struggle with large-scale ingestion because...
View lesson → + Playlist
Fixing Floating-Point Drift While Speeding Up CSV Ingestion (7.75s 2.7s)
Dev.to · NARESH-CN2 📊 Data Analytics & Business Intelligence ⚡ AI Lesson 2mo ago
Fixing Floating-Point Drift While Speeding Up CSV Ingestion (7.75s 2.7s)
The Problem: The Hidden Cost of "Fast" IngestionMost discussions around data pipelines focus strictly...
View lesson → + Playlist
Case Study: Reducing Data Ingestion Latency by 96.4% (24.5x Speedup)
Dev.to · NARESH-CN2 📊 Data Analytics & Business Intelligence ⚡ AI Lesson 2mo ago
Case Study: Reducing Data Ingestion Latency by 96.4% (24.5x Speedup)
Most data pipelines don’t need more infrastructure. They need less overhead. I recently...
View lesson → + Playlist
🚀 Bypassing the Python GIL: How I Processed 10M Rows in 0.26s with C
Dev.to · NARESH-CN2 ⚡ AI Lesson 2mo ago
🚀 Bypassing the Python GIL: How I Processed 10M Rows in 0.26s with C
The "Abstraction Tax" is Real We love Python for its simplicity, but when we hit massive datasets,...
View lesson → + Playlist
Stop Paying the Abstraction Tax : How I Built a C-Engine 12x Faster than Pandas
Dev.to · NARESH-CN2 📊 Data Analytics & Business Intelligence ⚡ AI Lesson 2mo ago
Stop Paying the Abstraction Tax : How I Built a C-Engine 12x Faster than Pandas
Python is the king of data science, but it charges a heavy price for convenience. When you use...
View lesson → + Playlist
Hardening a 1P/3C Broadcast Engine: Achieving 33.92M records/s with C11 Atomics
Dev.to · NARESH-CN2 3mo ago
Hardening a 1P/3C Broadcast Engine: Achieving 33.92M records/s with C11 Atomics
Most high-volume data pipelines suffer from a hidden "Abstraction Tax." When you move telemetry...
Read article → + Playlist
7.22M Logs/Sec on a Laptop: Beating the "Abstraction Tax" with C11 Atomics
Dev.to · NARESH-CN2 3mo ago
7.22M Logs/Sec on a Laptop: Beating the "Abstraction Tax" with C11 Atomics
I’ve been obsessed with the "Abstraction Tax" lately—the massive performance hit we take when we...
Read article → + Playlist
Bypassing the "Pandas RAM Tax": Building a Zero-Copy CSV Extractor in C
Dev.to · NARESH-CN2 📊 Data Analytics & Business Intelligence ⚡ AI Lesson 3mo ago
Bypassing the "Pandas RAM Tax": Building a Zero-Copy CSV Extractor in C
The Convenience Penalty Python is a masterpiece of productivity, but for high-volume data ingestion,...
View lesson → + Playlist
Abolishing the "Python Tax": How I hit $3.06 \text{ GB/s}$ CSV Ingestion in C 🧱🔥
Dev.to · NARESH-CN2 ⚡ AI Lesson 3mo ago
Abolishing the "Python Tax": How I hit $3.06 \text{ GB/s}$ CSV Ingestion in C 🧱🔥
Standard Python data processing (Pandas/CSV) is often plagued by what I call the "Object Tax"—the...
View lesson → + Playlist
Stop Paying the "Python Object Tax": 10M Rows in 0.08s with C and Parallel mmap
Dev.to · NARESH-CN2 📐 ML Fundamentals ⚡ AI Lesson 3mo ago
Stop Paying the "Python Object Tax": 10M Rows in 0.08s with C and Parallel mmap
I was benchmarking some data ingestion pipelines on my Nitro 16 (Ryzen 7) and honestly got pretty...
View lesson → + Playlist
How to Bypass the Pandas "Object Tax": Building an 8x Faster CSV Engine in C
Dev.to · NARESH-CN2 📊 Data Analytics & Business Intelligence ⚡ AI Lesson 3mo ago
How to Bypass the Pandas "Object Tax": Building an 8x Faster CSV Engine in C
The Problem: The "Object Tax"If you’ve ever tried to load a 1GB CSV into a Pandas DataFrame, you’ve...
View lesson → + Playlist
How I cut Python JSON memory overhead from 1.9GB to ~0MB (11x Speedup)
Dev.to · NARESH-CN2 ⚡ AI Lesson 3mo ago
How I cut Python JSON memory overhead from 1.9GB to ~0MB (11x Speedup)
The Problem: The "PyObject" TaxWe all love Python for its developer velocity, but for high-scale data...
View lesson → + Playlist
Python was too slow for 10M rows—So I built a C-Bridge (and found the hidden data loss)
Dev.to · NARESH-CN2 📐 ML Fundamentals ⚡ AI Lesson 3mo ago
Python was too slow for 10M rows—So I built a C-Bridge (and found the hidden data loss)
The Challenge: The 1-Second Wall In high-volume data engineering, "fast enough" is a...
View lesson → + Playlist