AI Weekly Update - May 26th, 2021 (#32!)

Connor Shorten · Beginner ·📰 AI News & Updates ·4y ago
Thank you for watching! Please subscribe! Content Links: APPS: https://arxiv.org/pdf/2105.09938.pdf Improving Code Autocomplete: https://arxiv.org/pdf/2105.05991.pdf DeepDebug: https://arxiv.org/pdf/2105.09352.pdf The Simplicity Bias: https://arxiv.org/pdf/2105.05612.pdf Rethinking "Batch" in BatchNorm: https://arxiv.org/pdf/2105.07576.pdf Divide and Contrast: https://arxiv.org/pdf/2105.08054.pdf Ethan Perez on True Few-Shot Learning: https://twitter.com/EthanJPerez/status/1397015129506541570 KELM: https://ai.googleblog.com/2021/05/kelm-integrating-knowledge-graphs-with.html Are Larger Pretrained Language Models Uniformly Better? https://arxiv.org/pdf/2105.06020.pdf Pay Attention to MLPs: https://arxiv.org/pdf/2105.08050.pdf Are CNNs or Transformers more like human vision? https://arxiv.org/pdf/2105.07197.pdf FLUTE: https://arxiv.org/pdf/2105.07029.pdf Keras Code Examples - Modern MLP Models: https://keras.io/examples/vision/mlp_image_classification/ Keras Code Examples - Node Classification: https://keras.io/examples/graph/gnn_citations/ BioMed Explorer: https://sites.research.google/biomedexplorer/ BookSum: https://arxiv.org/pdf/2105.08209.pdf Chapters 0:00 Introduction 10:59 APPS 13:27 More Code Deep Learning 15:14 The Simplicity Bias 17:31 Rethinking “Batch” in BatchNorm 20:05 Divide and Contrast 23:01 True Few-Shot Learning 24:20 KELM 25:47 Larger Pretrained Models - Uniformly Better? 26:30 Pay Attention to MLPs 29:47 CNNs or Transformers more like human vision? 31:39 FLUTE 32:51 Pathdreamer 33:50 Keras Code Examples 34:45 Biomedical Explorer 35:23 BookSum
Watch on YouTube ↗ (saves to browser)
Sign in to unlock AI tutor explanation · ⚡30

Playlist

Uploads from Connor Shorten · Connor Shorten · 0 of 60

← Previous Next →
1 DenseNets
DenseNets
Connor Shorten
2 DeepWalk Explained
DeepWalk Explained
Connor Shorten
3 Inception Network Explained
Inception Network Explained
Connor Shorten
4 StackGAN
StackGAN
Connor Shorten
5 StyleGAN
StyleGAN
Connor Shorten
6 Progressive Growing of GANs Explained
Progressive Growing of GANs Explained
Connor Shorten
7 Improved Techniques for Training GANs
Improved Techniques for Training GANs
Connor Shorten
8 Word2Vec Explained
Word2Vec Explained
Connor Shorten
9 Must Read Papers on GANs
Must Read Papers on GANs
Connor Shorten
10 Unsupervised Feature Learning
Unsupervised Feature Learning
Connor Shorten
11 Self-Supervised GANs
Self-Supervised GANs
Connor Shorten
12 Embedding Graphs with Deep Learning
Embedding Graphs with Deep Learning
Connor Shorten
13 Transfer Learning in GANs
Transfer Learning in GANs
Connor Shorten
14 ReLU Activation Function
ReLU Activation Function
Connor Shorten
15 AC-GAN Explained
AC-GAN Explained
Connor Shorten
16 SimGAN Explained
SimGAN Explained
Connor Shorten
17 DC-GAN Explained!
DC-GAN Explained!
Connor Shorten
18 ResNet Explained!
ResNet Explained!
Connor Shorten
19 Graph Convolutional Networks
Graph Convolutional Networks
Connor Shorten
20 Neural Architecture Search
Neural Architecture Search
Connor Shorten
21 Henry AI Labs
Henry AI Labs
Connor Shorten
22 Video Classification with Deep Learning
Video Classification with Deep Learning
Connor Shorten
23 BigGANs in Data Augmentation
BigGANs in Data Augmentation
Connor Shorten
24 Introduction to Deep Learning
Introduction to Deep Learning
Connor Shorten
25 EfficientNet Explained!
EfficientNet Explained!
Connor Shorten
26 Self-Attention GAN
Self-Attention GAN
Connor Shorten
27 Curriculum Learning in Deep Neural Networks
Curriculum Learning in Deep Neural Networks
Connor Shorten
28 Deep Learning Podcast #1 | Edward Dixon | Stochastic Weight Averaging
Deep Learning Podcast #1 | Edward Dixon | Stochastic Weight Averaging
Connor Shorten
29 Deep Compression
Deep Compression
Connor Shorten
30 Skin Cancer Classification with Deep Learning
Skin Cancer Classification with Deep Learning
Connor Shorten
31 Deep Learning Podcast #2 | Edward Peake | Deep Learning in Medical Imaging
Deep Learning Podcast #2 | Edward Peake | Deep Learning in Medical Imaging
Connor Shorten
32 The Lottery Ticket Hypothesis Explained!
The Lottery Ticket Hypothesis Explained!
Connor Shorten
33 SqueezeNet
SqueezeNet
Connor Shorten
34 GauGAN Explained!
GauGAN Explained!
Connor Shorten
35 AutoML with Hyperband
AutoML with Hyperband
Connor Shorten
36 DL Podcast #3 | Yannic Kilcher | Population-Based Search
DL Podcast #3 | Yannic Kilcher | Population-Based Search
Connor Shorten
37 Weakly Supervised Pretraining
Weakly Supervised Pretraining
Connor Shorten
38 Image Data Augmentation for Deep Learning
Image Data Augmentation for Deep Learning
Connor Shorten
39 Unsupervised Data Augmentation
Unsupervised Data Augmentation
Connor Shorten
40 Wide ResNet Explained!
Wide ResNet Explained!
Connor Shorten
41 RevNet: Backpropagation without Storing Activations
RevNet: Backpropagation without Storing Activations
Connor Shorten
42 GANs with Fewer Labels
GANs with Fewer Labels
Connor Shorten
43 BigBiGAN Unsupervised Learning!
BigBiGAN Unsupervised Learning!
Connor Shorten
44 Self-Supervised Learning
Self-Supervised Learning
Connor Shorten
45 Multi-Task Self-Supervised Learning
Multi-Task Self-Supervised Learning
Connor Shorten
46 Self-Supervised GANs
Self-Supervised GANs
Connor Shorten
47 Population Based Training
Population Based Training
Connor Shorten
48 Show, Attend and Tell
Show, Attend and Tell
Connor Shorten
49 Siamese Neural Networks
Siamese Neural Networks
Connor Shorten
50 WaveGAN Explained!
WaveGAN Explained!
Connor Shorten
51 VAE-GAN Explained!
VAE-GAN Explained!
Connor Shorten
52 Evolution in Neural Architecture Search!
Evolution in Neural Architecture Search!
Connor Shorten
53 AI Research Weekly Update August 18th, 2019
AI Research Weekly Update August 18th, 2019
Connor Shorten
54 Weight Agnostic Neural Networks Explained!
Weight Agnostic Neural Networks Explained!
Connor Shorten
55 AI Research Weekly Update August 25th, 2019
AI Research Weekly Update August 25th, 2019
Connor Shorten
56 Neuroevolution of Augmenting Topologies (NEAT)
Neuroevolution of Augmenting Topologies (NEAT)
Connor Shorten
57 CoDeepNEAT
CoDeepNEAT
Connor Shorten
58 AI Research Weekly Update September 1st, 2019
AI Research Weekly Update September 1st, 2019
Connor Shorten
59 Randomly Wired Neural Networks
Randomly Wired Neural Networks
Connor Shorten
60 Genetic CNN
Genetic CNN
Connor Shorten

Related AI Lessons

Big Tech firms are accelerating AI investments and integration, while regulators and companies focus on safety and responsible adoption.
Big Tech firms are investing billions in AI infrastructure, driving growth and transformation in the field, with a focus on safety and responsible adoption
Dev.to AI
Musk V. Altman Isn’t About The Future Of AI
The Musk vs Altman lawsuit is not about the future of AI, despite headlines suggesting otherwise, and understanding the actual issues at stake is crucial for AI professionals and entrepreneurs
Forbes Innovation
AI vs Crypto Is the Wrong Debate. Smart Investors Are Watching Both in 2026
Investors should focus on both AI and crypto in 2026, rather than pitting them against each other
Medium · AI
Elon Musk Boosts New Yorker’s Sam Altman Exposé on X as Trial Begins
Elon Musk shares an exposé on X as his trial against OpenAI begins, revealing the complex dynamics between tech giants
Wired AI

Chapters (16)

Introduction
10:59 APPS
13:27 More Code Deep Learning
15:14 The Simplicity Bias
17:31 Rethinking “Batch” in BatchNorm
20:05 Divide and Contrast
23:01 True Few-Shot Learning
24:20 KELM
25:47 Larger Pretrained Models - Uniformly Better?
26:30 Pay Attention to MLPs
29:47 CNNs or Transformers more like human vision?
31:39 FLUTE
32:51 Pathdreamer
33:50 Keras Code Examples
34:45 Biomedical Explorer
35:23 BookSum
Up next
The Truth About AI Running Companies
My First Million Clips Official
Watch →