📰 Dev.to · Pavan Madduri

Getting Started with HAMi: GPU Virtualization on Kubernetes Running multiple AI workloads...

I had three small models I wanted to serve: Phi-3-mini for general chat, CodeLlama-7B for code...

I had Prometheus + DCGM Exporter running on my OKE cluster. It gave me GPU utilization, memory usage,...

My GPU inference image was 8GB. Building it in GitHub Actions took 14 minutes on the free runner....

I was spending ~$3,300/month on three A10 GPU instances for a mix of staging inference, batch...

A colleague asked me to set up a private LLM endpoint their team could use for code review...

How we moved a production EKS fleet from Crossplane v1 claims/composites to v2 namespaced XRs with no resource recreation, no node rotation, and no downtime — p

I timed myself. Starting from an empty directory with a Go application idea, how fast could I get to...

Running GPU containers on Kubernetes is one of those things that works perfectly in tutorials and...

I have a rule: if I can't run the full stack on my laptop with docker compose up, the architecture is...

I was running all my containers on AMD64 shapes because that's what I'd always done. x86, Intel/AMD,...

Every GPU inference container has the same problem: Kubernetes HPA can't see the GPU. You scale on...

I wanted to deploy an LLM inference API without spending $1,200/month on AWS GPU instances. OCI...

I needed to run a container in the cloud. Not a microservices platform. Not a service mesh. Just one...

Deploying a Production-Ready K3s Cluster on OCI Always Free ARM Instances How I turned...

You merge the Pull Request. The CI/CD pipeline flashes green. ArgoCD reports that your application is...