Data Skeptic

The Transformer

May 3, 2019 · 15 min · 12.9 MB
0:00-15:23

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

Kyle and Linhda discuss attention and the transformer - an encoder/decoder architecture that extends the basic ideas of vector embeddings like word2vec into a more contextual use case.