Skip to content
Artwork for My Weird Prompts
My Weird Prompts · Yesterday · 20 min

Balancing Speech Training Data With Square Roots

Training a 600-million parameter Parakeet model on bilingual code-switching and technical vocabulary requires carefully balancing recording prompts. The underlying app doesn't use target percentages; instead, it runs a weighted raffle where tickets equal the square root of unread sentences multiplied by manual task weights. Meanwhile, mistaken dictation words jump the line entirely, entering a throttled queue that serves a three-card burst followed by one card every eight turns until reaching a twenty-take target. Episode 6266 — myweirdprompts.com/n/6266 (permanent short link: myweirdprompts.com/808611)

0:00 · Intro-20:46

transcript

No transcript — this publisher did not publish one.

show notes

Training a 600-million parameter Parakeet model on bilingual code-switching and technical vocabulary requires carefully balancing recording prompts. The underlying app doesn't use target percentages; instead, it runs a weighted raffle where tickets equal the square root of unread sentences multiplied by manual task weights. Meanwhile, mistaken dictation words jump the line entirely, entering a throttled queue that serves a three-card burst followed by one card every eight turns until reaching a twenty-take target.

Episode 6266 — myweirdprompts.com/n/6266 (permanent short link: myweirdprompts.com/808611)

chapters

6 chapters