Data Skeptic

StrategyQA and Big Bench

Nov 18, 2022 · 41 min · 50.5 MB
0:00-41:56

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

Did Aristotle Use a Laptop? That's a question from the StrategyQA benchmark which highlights the stretch goals for current artificial intelligence systems. Answering a question like that requires several cognitive steps and reasoning. Constructing a dataset of similarly challenging questions is a major undertaking. On today's episode, Mor Geva returns to share details about the creation of StrategyQA and the larger Big Bench dataset it has been included in.