Local LLMs with llamafile

External: Coursera Courses ↗ · Coursera

Open Course on External: Coursera

Free to audit · Opens on External: Coursera

Local LLMs with llamafile

Coursera · Beginner ·📊 Data Analytics & Business Intelligence ·3mo ago

Key Takeaways

Packages open-source AI models into portable llamafile executables and deploys them locally across Windows, macOS, and Linux

Original Description

In this 1-hour project-based course, you will learn to: * Package open-source AI models into portable llamafile executables * Deploy llamafiles locally across Windows, macOS and Linux * Monitor system metrics like GPU usage when running models * Query llamafile APIs with Python to process generated text * Experience real-time inference through hands-on examples
Watch on External: Coursera ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Related Reads

Up next
How to Prompt Your LLM Directly from SQL
Ian Wootten
Watch →