Sparse-K Attention in llama.cpp: Make Your LLMs Fly🚀

💭 Ever stared at your model decoding a long sequence and thought: "Why is this so slow?!" 🤯 ...