Argmax

Mixture of Experts

Oct 8, 2024 · 54 min · 39.5 MB
0:00-54:46

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

In this episode we talk about the paper "Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, Jeff Dean.