Fireside Chat #16: Building ML and AI systems in 2024 and beyond

Outerbounds · Beginner ·🧠 Large Language Models ·2y ago
In this holiday special of our Fireside Chat series, Hugo is joined by Ville Tuulos, co-founder and CEO of Outerbounds and ex-leader of ML infrastructure at Netflix. They’ll recap what’s happened this year in AI and ML infrastructure but, more importantly, they’ll look to the future and discuss how products and services of the future will be shaped by ML and AI from the developer’s point of view. ​In his recent presentations, Ville has been sharing a vision of the future where most products will include elements of data, AI, and ML. In this talk, we will chat why this might be the case, what the ramifications of it will be, who will be building these systems, and how. These prognostications don’t come from thin air: We will chat how previous macrotrends in tech have panned out and what we can learn from them. ​If you are planning to develop systems involving ML and AI, you should find this fireside chat useful and entertaining! 00:00 Prelude 01:25 The Fireside chat begins! 04:58 How will AI change the nature of online products? 14:00 GenAI in e-commerce, an illustrative example 20:30 GenAI, LLMs, and the media landscape 27:45 ML Infrastructure, AI, data, and compute! 36:00 Are all workloads actually GPU-intensive? 38:35 Is everything AI forever now? Or what remains? 42:59 Will GenAI displace AI engineers? 51:15 The future of Metaflow wrt AI and ML 59:15 What's on the Outerbounds roadmap?
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Playlist UU5h8Ji6Lm1RyAZopnCpDq7Q · Outerbounds · 0 of 60

← Previous Next →
1 Metaflow GUI for monitoring machine learning workflows
Metaflow GUI for monitoring machine learning workflows
Outerbounds
 2 Metaflow Cards [no sound]
Metaflow Cards [no sound]
Outerbounds
 3 Fireside chat #1: How to Produce Sustainable Business Value with Machine Learning
Fireside chat #1: How to Produce Sustainable Business Value with Machine Learning
Outerbounds
 4 Fireside chat #2: MadeWithML.com -- Teaching Practical Machine Learning
Fireside chat #2: MadeWithML.com -- Teaching Practical Machine Learning
Outerbounds
 5 Metaflow on Kubernetes and Argo Workflows [no sound]
Metaflow on Kubernetes and Argo Workflows [no sound]
Outerbounds
 6 Fireside chat #3: Reasonable Scale Machine Learning -- You're not Google and it's totally OK
Fireside chat #3: Reasonable Scale Machine Learning -- You're not Google and it's totally OK
Outerbounds
 7 Metaflow Tags: Programmatic Tagging
Metaflow Tags: Programmatic Tagging
Outerbounds
 8 Metaflow Tags: Basic Tagging
Metaflow Tags: Basic Tagging
Outerbounds
 9 Metaflow Tags: Tags in CI/CD
Metaflow Tags: Tags in CI/CD
Outerbounds
 10 Metaflow Tags: Tags and Namespaces
Metaflow Tags: Tags and Namespaces
Outerbounds
 11 Metaflow Tags: Tags and Continuous Training
Metaflow Tags: Tags and Continuous Training
Outerbounds
 12 Fireside chat #4: Machine Learning and User Experience -- Building ML Products for People
Fireside chat #4: Machine Learning and User Experience -- Building ML Products for People
Outerbounds
 13 Fireside Chat #5: Machine Learning + Infrastructure for Humans
Fireside Chat #5: Machine Learning + Infrastructure for Humans
Outerbounds
 14 Metaflow Sandbox Demo: Free Data Science Infrastructure In the Browser
Metaflow Sandbox Demo: Free Data Science Infrastructure In the Browser
Outerbounds
 15 Metaflow on Azure
Metaflow on Azure
Outerbounds
 16 Fireside Chat #6: Operationalizing ML -- Patterns and Pain Points from MLOps Practitioners
Fireside Chat #6: Operationalizing ML -- Patterns and Pain Points from MLOps Practitioners
Outerbounds
 17 ML engineering vs traditional software engineering: similarities and differences
ML engineering vs traditional software engineering: similarities and differences
Outerbounds
 18 Why data scientists love and hate notebooks: velocity and validation
Why data scientists love and hate notebooks: velocity and validation
Outerbounds
 19 What even is a 10x ML engineer?
What even is a 10x ML engineer?
Outerbounds
 20 The 4 main tasks in the production ML lifecycle
The 4 main tasks in the production ML lifecycle
Outerbounds
 21 Is the premise of data-centric AI flawed?
Is the premise of data-centric AI flawed?
Outerbounds
 22 The 3 factors that Determine the success of ML projects
The 3 factors that Determine the success of ML projects
Outerbounds
 23 Fireside Chat #7: How to Build an Enterprise Machine Learning Platform from Scratch
Fireside Chat #7: How to Build an Enterprise Machine Learning Platform from Scratch
Outerbounds
 24 Run Metaflow on any cloud: Google Cloud, Azure, or AWS [no sound]
Run Metaflow on any cloud: Google Cloud, Azure, or AWS [no sound]
Outerbounds
 25 Metaflow on GCP
Metaflow on GCP
Outerbounds
 26 Fireside Chat #8: Navigating the Full Stack of Machine Learning
Fireside Chat #8: Navigating the Full Stack of Machine Learning
Outerbounds
 27 How to Build a Full-Stack Recommender System
How to Build a Full-Stack Recommender System
Outerbounds
 28 Modernize your Airflow deployments with Metaflow - zero-cost migration [no sound]
Modernize your Airflow deployments with Metaflow - zero-cost migration [no sound]
Outerbounds
 29 Easy Airflow DAGs for ML and data science with Metaflow [no sound]
Easy Airflow DAGs for ML and data science with Metaflow [no sound]
Outerbounds
 30 Fireside chat #9: Language Processing: From Prototype to Production
Fireside chat #9: Language Processing: From Prototype to Production
Outerbounds
 31 How to build end-to-end recommender systems at reasonable scale
How to build end-to-end recommender systems at reasonable scale
Outerbounds
 32 Full-Stack Machine Learning with Metaflow on CoRise
Full-Stack Machine Learning with Metaflow on CoRise
Outerbounds
 33 Natural Language Processing meets MLOps
Natural Language Processing meets MLOps
Outerbounds
 34 Fireside Chat #10: Large Language Models: Beyond Proofs of Concept
Fireside Chat #10: Large Language Models: Beyond Proofs of Concept
Outerbounds
 35 What even are Large Language Models?
What even are Large Language Models?
Outerbounds
 36 How to get started with LLMs today
How to get started with LLMs today
Outerbounds
 37 LLMs in production
LLMs in production
Outerbounds
 38 Accessing secrets securely in Metaflow [no audio]
Accessing secrets securely in Metaflow [no audio]
Outerbounds
 39 Fireside Chat #11: The Open-Source Modern Data Stack
Fireside Chat #11: The Open-Source Modern Data Stack
Outerbounds
 40 Fireside chat #12: Kubernetes for Data Scientists
Fireside chat #12: Kubernetes for Data Scientists
Outerbounds
 41 Behind the Screen: How Amazon Prime Video ships RecSys models 4x faster
Behind the Screen: How Amazon Prime Video ships RecSys models 4x faster
Outerbounds
 42 Fireside chat #13: Supply Chain Security in Machine Learning
Fireside chat #13: Supply Chain Security in Machine Learning
Outerbounds
 43 Quick Delivery, Quicker ML: DeliveryHero's Metaflow Story
Quick Delivery, Quicker ML: DeliveryHero's Metaflow Story
Outerbounds
 44 Crafting General Intelligence: LLM Fine-tuning with Metaflow at Adept.ai
Crafting General Intelligence: LLM Fine-tuning with Metaflow at Adept.ai
Outerbounds
 45 Fuelling Decisions: How DTN Powers Gas Pricing and Data Science Collaboration
Fuelling Decisions: How DTN Powers Gas Pricing and Data Science Collaboration
Outerbounds
 46 From Kitchen to Doorstep: Optimizing Data Science Velocity at Deliveroo
From Kitchen to Doorstep: Optimizing Data Science Velocity at Deliveroo
Outerbounds
 47 Building a GenAI Ready ML Platform with Metaflow at Autodesk
Building a GenAI Ready ML Platform with Metaflow at Autodesk
Outerbounds
 48 Media Transcoding for 10 Million users and beyond with Metaflow at Epignosis
Media Transcoding for 10 Million users and beyond with Metaflow at Epignosis
Outerbounds
 49 Telematics with Metaflow: How Nirvana Insurance built a large-scale Risk Estimation platform
Telematics with Metaflow: How Nirvana Insurance built a large-scale Risk Estimation platform
Outerbounds
 50 Fireside chat #14: Generative AI and Machine Learning for Film, TV, and Gaming
Fireside chat #14: Generative AI and Machine Learning for Film, TV, and Gaming
Outerbounds
 51 The Past, Present, and Future of Generative AI
The Past, Present, and Future of Generative AI
Outerbounds
 52 Building Production Systems with Generative AI, Machine Learning, and Data
Building Production Systems with Generative AI, Machine Learning, and Data
Outerbounds
 53 A Custom Fine-Tuned LLM in Action (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 5)
A Custom Fine-Tuned LLM in Action (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 5)
Outerbounds
 54 Building Live Production Systems with RAG (LLMs & RAG: An Interactive Guided Tour Part 4)
Building Live Production Systems with RAG (LLMs & RAG: An Interactive Guided Tour Part 4)
Outerbounds
 55 Better Relevancy with RAG (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 3)
Better Relevancy with RAG (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 3)
Outerbounds
 56 Working with OSS LLMs (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 2)
Working with OSS LLMs (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 2)
Outerbounds
 57 Hitting OpenAI and Other Vendor APIs (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 1)
Hitting OpenAI and Other Vendor APIs (LLMs, RAG, and Fine-Tuning: An Interactive Guided Tour Part 1)
Outerbounds
 58 Production Systems with Generative AI (LLMs, RAG, & Fine-Tuning: An Interactive Guided Tour Part 0)
Production Systems with Generative AI (LLMs, RAG, & Fine-Tuning: An Interactive Guided Tour Part 0)
Outerbounds
 59 LLMs in Practice: A Guide to Recent Trends and Techniques
LLMs in Practice: A Guide to Recent Trends and Techniques
Outerbounds
 60 Metaflow for distributed high-performance computing and large-scale AI training
Metaflow for distributed high-performance computing and large-scale AI training
Outerbounds

Related AI Lessons

⚡
How to Deploy Llama 3.1 405B on a $48/Month DigitalOcean GPU Droplet: Multi-GPU Inference Setup
Deploy Llama 3.1 405B on a $48/month DigitalOcean GPU Droplet for multi-GPU inference setup and save on token costs
Dev.to AI
 ⚡
How We Log LLM Requests at Sub-50ms Latency Using ClickHouse
Learn how to log LLM requests at sub-50ms latency using ClickHouse, a powerful database management system, and improve your backend infrastructure for AI applications.
Dev.to AI
 ⚡
How to Use ChatGPT for Your Job Hunt (Without Sounding Like a Robot)
Learn how to leverage ChatGPT for your job hunt without sounding robotic, by using it to tailor your resume, write cover letters, and practice mock interviews
Dev.to AI
 ⚡
Building an LLM Tool Calling Workflow with DigitalOcean and Connected Databases
Learn to build an LLM tool calling workflow with DigitalOcean and connected databases to streamline AI model deployment
Dev.to · DigitalOcean

Chapters (11)

Prelude
1:25 The Fireside chat begins!
4:58 How will AI change the nature of online products?
14:00 GenAI in e-commerce, an illustrative example
20:30 GenAI, LLMs, and the media landscape
27:45 ML Infrastructure, AI, data, and compute!
36:00 Are all workloads actually GPU-intensive?
38:35 Is everything AI forever now? Or what remains?
42:59 Will GenAI displace AI engineers?
51:15 The future of Metaflow wrt AI and ML
59:15 What's on the Outerbounds roadmap?
Up next
5 Levels of AI Agents - From Simple LLM Calls to Multi-Agent Systems
Dave Ebbelaar (LLM Eng)
Watch →