The Evolution of the Transformer

By Ed Rogers on 2024-03-14

Dive into the backstory of the most influential model in AI's history—the Transformer. This talk traces the lineage of ideas and models that influenced its design, showcasing how past challenges and solutions in machine learning, computer vision, and NLP contributed to the Transformer's groundbreaking approach. Ideal for software engineers and technology enthusiasts looking to understand the build-up to the current AI renaissance.

Ed Rogers is the Director of Data Science for Majesco, a global leader in cloud insurance software. He is also the organizer of MadPy, and a coordinating member of the organizing committee for SciPy Conference. Ed earned his PhD in Physics from the University of Illinois, where he deployed neural networks in the search for rare physics events at the largest US particle collider, Fermilab. Ed is a proud father of two, a devoted tea drinker, and can easily be drawn into long conversations about advanced analytics in baseball.