📰 Reddit r/LocalLLaMA

Bonsai-27B & Ternary-Bonsai-27B - Updates (on PRs)

ggml-zendnn : add Q8_0 quantization support by z-sachin · Pull Request #23414 · ggml-org/llama.cpp

OvisOCR2 (0.8B): first end-to-end model to top OmniDocBench - I threw 827 real scanned medical docs at it, here's everything I learned

GLM-5.2 fearmongering in the press

Need help building a rig / estimating performance for big LLMs to run when fully offline

Now brothers we know why we are so fucked up

[audio.cpp] What Does the Fox Say: 4 ASR models (Nemotron 3.5 ASR, Higgs Audio STT, VibeVoice ASR, and Hviske ASR) in native C++/GGML, init streaming support, and 327s of audio transcribed in 2.17s.

Which open models help the eco system more?

Qwen3.5 122B is the best?

What GUI-first coding tool tool are you pairing your local LLMs with? Opencode isn't it for me.

4-bit GLM-5.2 (753B MoE) on 4× DGX Spark: 70.8% on Terminal-Bench 2.1 vs 81.0% for the full model

Complete local model asset generation pipeline

AI has completely revolutionized how I play RPGs

I created a 140 GB IQ2_XXS REAP quant of GLM 5.2 for coding. Looking for testers.

HF Viewer tons of new features!

Seasonic PSU calculator now mentions RTX 5080 SUPER (24GB), RTX 5070 Ti SUPER (24GB) and RTX 5070 SUPER (18GB)

Qwen3.6-27b does not understand software architechure.

QLLM, no transformer, no mamba and new noval architecture with O(1) inference is finally out as model

Döner Bench round 2: Quant compare

Can you trust local models to answer accurately?

China’s MiniMax Plans to Launch 2.7-Trillion Parameter Model

Best Local VLMs - July 2026

What's in your RAG?

My reasons to run local models