Run Local LLMs on Hardware from $50 to $50,000 - We Test and Compare!

Name: Run Local LLMs on Hardware from $50 to $50,000 - We Test and Compare!
Uploaded: 2024-09-29T12:39:36Z
Duration: 15 min 5 s
Channel: Dave's Garage
Description: Dave tests llama3.1 and llama3.2 using Ollama on a Raspberry Pi, a Herk Orion Mini PC, a 3970X, an M2 Mac Pro, and a ...

Dave's Garage · Intermediate ·🧠 Large Language Models ·15:05 ·1y ago

Dave tests llama3.1 and llama3.2 using Ollama on a Raspberry Pi, a Herk Orion Mini PC, a 3970X, an M2 Mac Pro, and a ...

Watch on YouTube ↗ (saves to browser)

Next Up

5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems

Dave Ebbelaar (LLM Eng)

Run Local LLMs on Hardware from $50 to $50,000 - We Test and Compare!

Lesson complete!