Boston Computation Club

04/04/25: Constrained Decoding for Code Language Models via Efficient Left and Right Quotienting of Context-Sensitive Grammars with Daniel Melcer

Apr 5, 2025 · 58 min · 56.2 MB
0:00-58:33

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

Today Daniel Melcer joined us to present Constrained Decoding for Code Language Models via Efficient Left and Right Quotienting of Context-Sensitive Grammars (https://arxiv.org/pdf/2402.17988). This is work he completed while at Amazon, and it's a really interesting project around how to constrain, guide, and check language models such that they generate valid code within a given context. We really appreciate that Daniel took the time to talk to us and hope you like the talk as much as we did!