Compress your LLM's KV cache 33x with zero training

Running out of GPU memory at long context lengths? The KV cache grows linearly with sequence length —...