Anej Svete

Hey! I’m Anej.¹ I’m a first-year PhD fellow at the ETH AI Center, where I’m co-advised by prof. Ryan Cotterell and prof. Valentina Boeva.

My main research interests lie in the intersection of formal language theory and modern language models, where I’m trying to improve our understanding of the formal properties of architectures such as recurrent neural networks and transformers with weighted models of computation. For example, I’m working on characterizing what kinds of probability distributions over sentences can modern language models represent and what implications this has on the way we should think about language models. I’m also interested in representation learning and its interpretability—for example, I also work on methods for disentangling latent factors in learned representations.

Before starting my PhD, I obtained a master’s degree in data science at ETH Zürich after completing my bachelor’s studies in computer science and mathematics at the Univeristy of Ljubljana.

You can find my full CV here.