Skip to content
Artwork for the localhost
the localhost · Yesterday · 37 min

the localhost:0002 | the $25 token is dead

Last week the conversation was cost vs. control. This week the cost floor fell out. Frontier models are getting dramatically cheaper, the models you can run on your own hardware are getting dramatically better — and Robert makes the case that within 18 months the only thing frontier labs will really be able to sell is speed. The crew gets into NVIDIA's reported interest in Hugging Face, a 170B+ parameter model coaxed onto a single consumer card, what Apple's latest silicon means for local AI, and the question underneath all of it: when intelligence becomes a commodity, where does the money go? Plus: an aerospace CEO in the back of an Uber who can't send his engineering IP to the cloud, and what happened when Robert turned on autopilot and walked away from his desk. the localhost is Frank Buchholz (independent), Jacob Rhoades, Robert Henry, Neil Misak, and Chauncey Larsen (Microsoft, opinions their own). Independent and unsponsored. New episodes weekly: https://thelocalhost.show There's no place like 127.0.0.1.

0:00 · If being smart gets cheap, what's left to charge for?-37:39

transcript

No transcript — this publisher did not publish one.

show notes

Last week the conversation was cost vs. control. This week the cost floor fell out. Frontier models are getting dramatically cheaper, the models you can run on your own hardware are getting dramatically better — and Robert makes the case that within 18 months the only thing frontier labs will really be able to sell is speed.

The crew gets into NVIDIA's reported interest in Hugging Face, a 170B+ parameter model coaxed onto a single consumer card, what Apple's latest silicon means for local AI, and the question underneath all of it: when intelligence becomes a commodity, where does the money go?

Plus: an aerospace CEO in the back of an Uber who can't send his engineering IP to the cloud, and what happened when Robert turned on autopilot and walked away from his desk.

the localhost is Frank Buchholz (independent), Jacob Rhoades, Robert Henry, Neil Misak, and Chauncey Larsen (Microsoft, opinions their own). Independent and unsponsored.

New episodes weekly: https://thelocalhost.show

There's no place like 127.0.0.1.

links1

chapters

28 chapters

more episodes

All episodes