Transformers United V2

Since their introduction in 2017, Transformers have revolutionized Natural Language Processing (NLP). Now, Transformers are finding applications all over Deep Learning, be it Computer Vision (CV), Reinforcement Learning (RL), Generative Adversarial Networks (GANs), Speech or even Biology. Among other things, Transformers have enabled the creation of powerful language models like ChatGPT and were instrumental in DeepMind's recent AlphaTensor model for discovering novel math algorithms. In this seminar, we examine the details of how Transformers work, and dive deep into the different kinds of Transformers and how they're applied in various fields. We do this through a combination of instructor lectures, guest lectures, and classroom discussions. We will invite people at the forefront of Transformers research across different domains for guest lectures. Prerequisites: Basic knowledge of Deep Learning (must understand attention) or CS224N/ CS231N/ CS230. To apply, fill out this form: https://forms.gle/y7xAuBm2dLMqCfj5A