MLC-LLM: GPT/Llama on consumer-class GPUs and phones

MLC-LLM: GPT/Llama on consumer-class GPUs and phones. 106 comments, 303 points on Hacker News.