Skip to content
Artwork for Beyond Coding
Beyond Coding · Wednesday · 37 min

Niantic Spatial CTO: How The Best Engineers Solve Problems Most Give Up On

Niantic Spatial CTO Brian McClendon on how the best engineers solve problems most give up on — from a 4D model of the world to shipping research in months. He built Google Earth and ran Google Maps for over a decade, and he's been there, done that. What he's building now is harder, and it's already live for customers. Along the way: who makes it on his team and who doesn't, and the one piece of advice he'd give every engineer using AI. In this video, we cover: - The 4D model of the world: visual positioning, change detection, and treating a pile of photos like a database - Gaussian splats and real-to-sim: capturing a room and loading it into Nvidia Isaac to train robots - Turning a research idea into a production service in six months - What Google Maps taught him about building for robots instead of humans - Designing problems AI can self-check, and why token maxing is a waste For engineers and engineering leaders who want to work on problems that don't have a known answer yet — and who want to know what a CTO who's built the definitive product in his field looks for in the people he hires. Recorded at the AI4 conference 2026. Timestamps: 00:00:00 - Google Earth? Been There, Done That 00:00:46 - Turning a Research Idea Into Production in 6 Months 00:02:37 - How Any Photo Gets Located Within Half a Meter 00:06:37 - The Long-Term Goal: A 4D Model of the World 00:08:37 - Treating a Pile of Photos Like a Database 00:11:58 - What Google Maps Taught Him About Training Robots 00:15:22 - Gaussian Splats Explained in Plain Terms 00:17:42 - The Unsolved Problem: Scale and Semantic Change 00:20:34 - Why Google Earth Is Good Enough 00:22:09 - Who Makes It on His Team and Who Doesn't 00:23:38 - Designing Problems AI Can Self-Check 00:26:03 - The Insights Hidden in the Physical World 00:28:18 - Digital Twins, Cities, and Ready Player One 00:31:35 - Visual Positioning When GPS Gets Spoofed 00:33:24 - Token Maxing Is Bullshit: Advice for Engineers Guest: Brian McClendon, CTO at Niantic Spatial. The engineer behind Google Earth; ran Google Maps for over a decade. https://www.linkedin.com/in/brianmcclendon #NianticSpatial #GoogleEarth #SoftwareEngineering

0:00-37:29

transcript

No transcript — this publisher did not publish one.

show notes

Niantic Spatial CTO Brian McClendon on how the best engineers solve problems most give up on — from a 4D model of the world to shipping research in months. He built Google Earth and ran Google Maps for over a decade, and he's been there, done that. What he's building now is harder, and it's already live for customers. Along the way: who makes it on his team and who doesn't, and the one piece of advice he'd give every engineer using AI.


In this video, we cover:

- The 4D model of the world: visual positioning, change detection, and treating a pile of photos like a database

- Gaussian splats and real-to-sim: capturing a room and loading it into Nvidia Isaac to train robots

- Turning a research idea into a production service in six months

- What Google Maps taught him about building for robots instead of humans

- Designing problems AI can self-check, and why token maxing is a waste


For engineers and engineering leaders who want to work on problems that don't have a known answer yet — and who want to know what a CTO who's built the definitive product in his field looks for in the people he hires.

Recorded at the AI4 conference 2026.


Timestamps:

00:00:00 - Google Earth? Been There, Done That
00:00:46 - Turning a Research Idea Into Production in 6 Months
00:02:37 - How Any Photo Gets Located Within Half a Meter
00:06:37 - The Long-Term Goal: A 4D Model of the World
00:08:37 - Treating a Pile of Photos Like a Database
00:11:58 - What Google Maps Taught Him About Training Robots
00:15:22 - Gaussian Splats Explained in Plain Terms
00:17:42 - The Unsolved Problem: Scale and Semantic Change
00:20:34 - Why Google Earth Is Good Enough
00:22:09 - Who Makes It on His Team and Who Doesn't
00:23:38 - Designing Problems AI Can Self-Check
00:26:03 - The Insights Hidden in the Physical World
00:28:18 - Digital Twins, Cities, and Ready Player One
00:31:35 - Visual Positioning When GPS Gets Spoofed
00:33:24 - Token Maxing Is Bullshit: Advice for Engineers


Guest: Brian McClendon, CTO at Niantic Spatial. The engineer behind Google Earth; ran Google Maps for over a decade.

https://www.linkedin.com/in/brianmcclendon


#NianticSpatial #GoogleEarth #SoftwareEngineering

links1