KV Cache Is Why Your Model Fit Until It Did Not

The model loaded. The first prompt worked. Then longer prompts or multiple users showed up, and...