AI Weekly Update - June 2nd 2021 (#33!)

Thanks for watching! Please Subscribe! Content Links: Project CodeNet: https://arxiv.org/pdf/2105.12655.pdf CoSQA: https://arxiv.org/pdf/2105.13239.pdf SSL Bug Detection and Repair: https://arxiv.org/pdf/2105.12787.pdf Reward is Enough: https://www.sciencedirect.com/science/article/pii/S0004370221000862 Reward is Enough (Yannic Kilcher's Video): https://www.youtube.com/watch?v=dmH1ZpcROMk AndroidEnv: https://arxiv.org/abs/2105.13231 CogView: https://arxiv.org/pdf/2105.13290.pdf Understanding VQ-VAE: https://ml.berkeley.edu/blog/posts/vq-vae/ Drawing Multiple Augmentation Samples: https://arxiv.org/pdf/2105.13343.pdf On the Bias Against Inductive Biases: https://arxiv.org/abs/2105.14077 Medically Aware GPT-3 as a Data Generator for Medical Dialogue Summarization: https://www.aclweb.org/anthology/2021.nlpmc-1.pdf#page=76 ByT5 (Colin Raffel's Twitter Thread): https://twitter.com/colinraffel/status/1399525871678103552 Knowledge Inheritance for Pre-trained Language Models: https://arxiv.org/pdf/2105.13880.pdf Keras Code Examples Seq2Seq NMT: https://keras.io/examples/nlp/neural_machine_translation_with_transformer Anthropic: https://www.anthropic.com/news/announcement OpenAI Startup Fund: https://openai.com/fund/ HF Newsletter: https://huggingface.curated.co/issues/9 PaperswithCode Dataset Loaders: https://paperswithcode.com/dataset/sst Chapters 0:00 Intro 8:43 Project CodeNet 10:37 CoSQA 13:34 SSL Bug Detection and Repair 15:05 Reward is Enough 17:52 AndroidEnv 19:27 CogView 23:47 Drawing Multiple Augmentations 25:15 On the Bias Against Inductive BIases 26:47 Medically-Aware GPT-3 29:59 ByT5 31:45 Knowledge Inheritance for LMs 33:00 KCE Seq2Seq NMT 34:11 Anthropic 34:48 OpenAI Startup Fund 35:58 HF Newsletter 37:58 Dataset Loaders