Abstract
This talk will provide a high level overview of a recently popular subquadratic alternative to the Transformer, the state space model (SSM). We will discuss ways to think about the characteristics of these models and the fundamental tradeoffs between SSMs and Transformers.