Financial Sentiment Analysis with FinBERT & HuggingFace + Analyzing Model Predictions w/ W&B Tables
Skills:
Fine-tuning LLMs90%LLM Foundations80%Supervised Learning80%Prompt Craft70%ML Maths Basics60%
๐Hey everyone, and in this video we'll be looking at financial sentiment analysis with FinBERT!
To be more specific, we will perform inference on a Kaggle dataset made up of stock market news headlines using a FinBERT (Financial BERT) NLP model implemented with HuggingFace. The model will output activations for three classes: positive, negative or neutral. Those relate to how a given headline is likely to affect a given company's stock price according to the FinBERT model.
Then, after performing inference on the dataset on Google Colab, we will log the predictions to Weights & Biases and analyze them using W&B Tables, a tool for visually exploring tabular data. We'll perform general analysis of the natural language processing model predictions and look at whether certain words bias FinBERT to always output certain predictions.
---
Links
๐ FinBERT x W&B Google Colab Notebook: http://wandb.me/finbert-colab
๐ Blogpost version of the video: http://wandb.me/finbert-report
๐ My dashboard with the W&B Table from the video: https://wandb.ai/ivangoncharov/FinBERT_Stock_Sentiment_Analysis
๐ Tables docs: https://docs.wandb.ai/guides/data-vis/tables-quickstart
๐ Kaggle dataset: https://www.kaggle.com/miguelaenlle/massive-stock-news-analysis-db-for-nlpbacktests
---
โณ Timestamps โณ
00:00 Intro
1:04 What is FinBERT?
1:38 Google Colab notebook
2:37 Analyzing model predictions w/ W&B Tables
3:35 Checking if a certain word biases the FinBERT model
6:17 Plotting FinBERT model predictions
10:00 Outro
---
Follow Ivan:
๐ Twitter: https://twitter.com/Ivangrov
๐ YouTube: https://www.youtube.com/c/IvanGoncharovAI
Get started with W&B: http://wandb.me/intro
Follow us:
Twitter: http://twitter.com/weights_biases
Linkedin: https://www.linkedin.com/company/weights-biases
Thanks for watching! If you have any questions, please don't hesitate to ask! If you have any suggestions, please don't hesitate either! We love hearing from the community and look forward to seeing you
Watch on YouTube โ
(saves to browser)
Sign in to unlock AI tutor explanation ยท โก30
Playlist
Uploads from Weights & Biases ยท Weights & Biases ยท 0 of 60
โ Previous
Next โ
1
2
3
4
5
6
7
8
9
10
![6. Recurrent Neural Networks [RNNs]](https://i.ytimg.com/vi/8lbGjKhrJOo/mqdefault.jpg)
11
12
13
![9. Hybrid LSTMs [Long Short-Term Memory]](https://i.ytimg.com/vi/NysY9FN9Uac/mqdefault.jpg)
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
0. What is machine learning?
Weights & Biases
1. Build Your First Machine Learning Model
Weights & Biases
Intro to ML: Course Overview
Weights & Biases
2. Multi-Layer Perceptrons
Weights & Biases
3. Convolutional Neural Networks
Weights & Biases
Weights & Biases at OpenAI
Weights & Biases
Why Experiment Tracking is Crucial to OpenAI
Weights & Biases
4. Autoencoders
Weights & Biases
5. Sentiment Analysis
Weights & Biases
6. Recurrent Neural Networks [RNNs]
Weights & Biases
7. Text Generation using LSTMs and GRUs
Weights & Biases
8. Text Classification Using Convolutional Neural Networks
Weights & Biases
9. Hybrid LSTMs [Long Short-Term Memory]
Weights & Biases
Toyota Research Institute on Experiment Tracking with Weights & Biases
Weights & Biases
Weights and Biases - Developer Tools for Deep Learning
Weights & Biases
Introducing Weights & Biases
Weights & Biases
10. Seq2Seq Models
Weights & Biases
11. Transfer Learning for Domain-Specific Image Classification with Small Datasets
Weights & Biases
12. One-shot learning for teaching neural networks to classify objects never seen before
Weights & Biases
13. Speech Recognition with Convolutional Neural Networks in Keras/TensorFlow
Weights & Biases
14. Data Augmentation | Keras
Weights & Biases
15. Batch Size and Learning Rate in CNNs
Weights & Biases
Applied Deep Learning Fellowship Overview and Project Selection with Josh Tobin (2019)
Weights & Biases
Grading Rubric for AI Applications with Sergey Karayev (2019)
Weights & Biases
16. Video Frame Prediction using CNNs and LSTMs (2019)
Weights & Biases
Image to LaTeX - Applied Deep Learning Fellowship (2019)
Weights & Biases
17. Build and Deploy an Emotion Classifier (2019)
Weights & Biases
Applied Deep Learning - Data Management with Josh Tobin (2019)
Weights & Biases
Snorkel: Programming Training Data with Paroma Varma of Stanford University (2019)
Weights & Biases
Applied Deep Learning - Troubleshooting and Debugging with Josh Tobin (2019)
Weights & Biases
Troubleshooting and Iterating ML Models with Lee Redden (2019)
Weights & Biases
Designing a Machine Learning Project with Neal Khosla (2019)
Weights & Biases
Lukas Beiwald on ML Tools and Experiment Management (2019)
Weights & Biases
Building Machine Learning Teams with Josh Tobin (2019)
Weights & Biases
Pieter Abeel on Potential Deep Learning Research Directions (2019)
Weights & Biases
Testing and Deployment of Deep Learning Models with Josh Tobin (2019)
Weights & Biases
Five Lessons for Team-Oriented Research with Peter Welder (2019)
Weights & Biases
Applied Deep Learning - Rosanne Liu on AI Research (2019)
Weights & Biases
Making the Mid-career Leap from Urban Design to Deep Learning/Data Science
Weights & Biases
Organizing ML projects โ W&B walkthrough (2020)
Weights & Biases
Brandon Rohrer โ Machine Learning in Production for Robots
Weights & Biases
Nicolas Koumchatzky โ Machine Learning in Production for Self-Driving Cars
Weights & Biases
My experiments with Reinforcement Learning with Jariullah Safi
Weights & Biases
Applications of Machine Learning to COVID-19 Research with Isaac Godfried
Weights & Biases
Testing Machine Learning Models with Eric Schles
Weights & Biases
How Linear Algebra is not like Algebra with Charles Frye
Weights & Biases
Predicting Protein Structures using Deep Learning with Jonathan King
Weights & Biases
Rachael Tatman โ Conversational AI and Linguistics
Weights & Biases
Reformer by Han Lee
Weights & Biases
Sequence Models with Pujaa Rajan
Weights & Biases
GitHub Actions & Machine Learning Workflows with Hamel Husain
Weights & Biases
Look Mom, No Indices! Vector Calculus with the Frรฉchet Derivative by Charles Frye
Weights & Biases
Jack Clark โ Building Trustworthy AI Systems
Weights & Biases
Surprising Utility of Surprise: Why ML Uses Negative Log Probabilities - Charles Frye
Weights & Biases
Track your machine learning experiments locally, with W&B Local - Chris Van Pelt
Weights & Biases
Antipatterns in open source research code with Jariullah Safi
Weights & Biases
Attention for time series forecasting & COVID predictions - Isaac Godfried
Weights & Biases
Made with ML - Goku Mohandas
Weights & Biases
Angela & Danielle โ Designing ML Models for Millions of Consumer Robots
Weights & Biases
Deep Learning Salon by Weights & Biases
Weights & Biases
More on: Fine-tuning LLMs
View skill โ
Related AI Lessons
โก
โก
โก
โก
The AI Winter Has Started.
Medium ยท AI
5 Critical Mistakes to Avoid When Implementing AI Demand Forecasting
Dev.to AI
DeepSeek cuts V4-Pro prices by 75% and slashes cache costs across its entire API to a tenth
The Next Web AI
The Massive AI Shakeup: Appleโs CEO Steps Down, Anthropic Hits $1 Trillion, and Metaโs Shocking 10%โฆ
Medium ยท Machine Learning
Chapters (7)
Intro
1:04
What is FinBERT?
1:38
Google Colab notebook
2:37
Analyzing model predictions w/ W&B Tables
3:35
Checking if a certain word biases the FinBERT model
6:17
Plotting FinBERT model predictions
10:00
Outro
๐
Tutor Explanation
DeepCamp AI