Perceiver for Cardiac Video Data Classification (AlphaCare: Episode 2)

DeepMind recently released a new type of Transformer called the Perceiver IO, which was able to achieve state of the art accuracy across multiple data types (text, images, point clouds, and more). In this episode of the AlphaCare series, I'll explain how Perceiver works, and how we used it to improve accuracy scores for Cardiac video data. The EchoNet dataset was recently made public by Stanford University, and it contains 10K privatized heart videos from patients. We'll also discuss why Transformer networks work so well, and how by using 2 key features (Cross attention & positional embeddings), the Perceiver improved on all variants of Transformers. Get hype! Big thanks to RapidAPI for sponsoring this video series: https://rapidapi.com/hub?utm_source=Siraj-Raval&utm_medium=DevRel&utm_campaign=DevRel Code & Coding Challenge: https://github.com/llSourcell/AlphaCare/tree/main/Perceiver Challenge Submission Link: https://forms.gle/2DJkYts4HAfHMKpm8 More Learning Resources: Perceiver explainer by Yannic Kilcher: https://www.youtube.com/watch?v=P_xeshTnPZg&t=1365s AlphaCare Episode 1 link: https://youtu.be/fGv6VmfGMLc Perceiver Explainer by AI Epiphany: https://www.youtube.com/watch?v=WJWBq4NZfvY MIT Video on CNNs: https://www.youtube.com/watch?v=iaSUYvmCekI Henry AI Labs Video on 3D CNNs: https://www.youtube.com/watch?v=rcnKGMNyVu4 ECG Time Series Classification Video in PyTorch: https://www.youtube.com/watch?v=qN3n0TM4Jno Awesome list of papers + code on ECG Classification: https://paperswithcode.com/task/ecg-classification List of awesome materials on Deep Learning in healthcare: https://github.com/XiaoleiZ/awesome-list-machine-learning-healthcare Free EdX course on ML in Healthcare: https://www.edx.org/course/machine-learning-for-healthcare Andrew Ng's Free Deep Learning courses: https://www.deeplearning.ai/ Dr David Sinclair at Harvard Medical's Book that inspired me: https://lifespanbook.com/ My Math of Intelligence Playlist: https://www.youtube.