Topic Modeling with Llama 2
In this video, you'll learn how to use Llama 2 for Topic Modeling in Python.
Llama 2 is an incredible open-source Large Language Model that can perform on par with GPT-3.5. We will use BERTopic to create base topics and leverage Llama 2 to create natural labels.
Timeline
0:00 Introduction
0:36 How does BERTopic work?
2:44 Installing Dependencies
3:14 Data
4:38 Llama 2
6:19 Optimization & Quantization
10:23 Prompt Engineering
16:17 BERTopic - Preparing the sub-models
20:08 BERTopic - Training + Output
25:27 Visualization
💬 BERTopic: https://github.com/MaartenGr/bertopic
📒 Google Colab notebook https://colab.research.google.com/drive/1QCERSMUjqGetGGujdrvv_6_EeoIcd_9M?usp=sharing
🛠️ Tutorial blog on using Llama 2 for Topic Modeling https://maartengrootendorst.substack.com/p/topic-modeling-with-llama-2
🦙 Llama 2 model (7B) on HuggingFace https://huggingface.co/meta-llama/Llama-2-7b-chat-hf
Support my work:
👪 Join as Channel Member:
/ @maartengrootendorst
✉️ Newsletter https://maartengrootendorst.substack.com/
📖 Join Medium to Read my Blogs https://medium.com/@maartengrootendorst
I'm writing a book!
📚 Hands-On Large Language Models https://www.oreilly.com/library/view/hands-on-large-language/9781098150952/
#datascience #machinelearning #ai
Watch on YouTube ↗
(saves to browser)
Sign in to unlock AI tutor explanation · ⚡30
More on: LLM Foundations
View skill →Related AI Lessons
Chapters (10)
Introduction
0:36
How does BERTopic work?
2:44
Installing Dependencies
3:14
Data
4:38
Llama 2
6:19
Optimization & Quantization
10:23
Prompt Engineering
16:17
BERTopic - Preparing the sub-models
20:08
BERTopic - Training + Output
25:27
Visualization
🎓
Tutor Explanation
DeepCamp AI