Skip to content
Artwork for Built 2 Scale
Built 2 Scale · August 26 · 38 min

B2S Operators — Structured AI | The 3D QA Agent

Structured AI is building an AI-native quality layer for construction: agents that can read complex drawing sets and 3D models, find design and coordination issues, and increasingly act inside Revit to help fix them. Their thesis is simple: QA/QC is still too manual, too inconsistent and too dependent on people catching everything under time pressure. In this episode, Raymond Zhao and Ben Remy unpack how Structured AI is approaching that problem technically — combining software engineers with experienced architects and engineers, tightly managing agent context, and embedding domain knowledge so the system understands not just that something is wrong, but why it is wrong and how it should be resolved. The conversation then moves beyond QA. Structured AI is already giving its Revit agent permission to make isolated changes to models, and sees a path from identifying errors, to fixing larger sub-problems, to eventually generating more of the building itself. In that future, the QA layer becomes even more important: if agents are designing and building, another agent still needs to verify the output. A discussion about the evolution from fragmented construction documentation toward agent-generated, machine-checked buildings — and what it takes to make AI genuinely useful in the physical world. Chapters: 0:00 Welcome — Ben & Raymond from Structured.ai 0:26 The mission: an AI quality layer for construction 2:25 Raymond’s path — architecture to Oxford stats 3:14 The fighter-jet origin story 6:05 Inside Y Combinator — solving the right problem 9:05 What is a forward-deployed engineer? 10:45 One of the great problems in construction 12:37 Under the hood: the giant vector soup 14:28 Context management is everything 17:47 The write side — fixing designs from first principles 20:42 Outcome as a Service 22:05 Who goes first on AI-generated design? 23:17 Productizing a messy industry 24:08 Biggest bottlenecks: scaling and talent 27:51 Should software set the standard? 29:36 Winning over the 40-year veterans 31:58 Agents checking agents — hallucination management 34:47 Closing thoughts + who should reach out Structured.ai → https://getstructured.ai Built to Scale is Scott Wilcox (W.) and Matt Perrott (BuildPass) building in public at the intersection of construction and AI. Follow Scott → https://www.linkedin.com/in/scott-wilcox-wilcoxbuilt/ Follow Matt → https://www.linkedin.com/in/mattperrott/

0:00-38:44

transcript

No transcript — this publisher did not publish one.

show notes

Structured AI is building an AI-native quality layer for construction: agents that can read complex drawing sets and 3D models, find design and coordination issues, and increasingly act inside Revit to help fix them. Their thesis is simple: QA/QC is still too manual, too inconsistent and too dependent on people catching everything under time pressure.

In this episode, Raymond Zhao and Ben Remy unpack how Structured AI is approaching that problem technically — combining software engineers with experienced architects and engineers, tightly managing agent context, and embedding domain knowledge so the system understands not just that something is wrong, but why it is wrong and how it should be resolved.

The conversation then moves beyond QA. Structured AI is already giving its Revit agent permission to make isolated changes to models, and sees a path from identifying errors, to fixing larger sub-problems, to eventually generating more of the building itself. In that future, the QA layer becomes even more important: if agents are designing and building, another agent still needs to verify the output.

A discussion about the evolution from fragmented construction documentation toward agent-generated, machine-checked buildings — and what it takes to make AI genuinely useful in the physical world.

Chapters:

0:00 Welcome — Ben & Raymond from Structured.ai

0:26 The mission: an AI quality layer for construction

2:25 Raymond’s path — architecture to Oxford stats

3:14 The fighter-jet origin story

6:05 Inside Y Combinator — solving the right problem

9:05 What is a forward-deployed engineer?

10:45 One of the great problems in construction

12:37 Under the hood: the giant vector soup

14:28 Context management is everything

17:47 The write side — fixing designs from first principles

20:42 Outcome as a Service

22:05 Who goes first on AI-generated design?

23:17 Productizing a messy industry

24:08 Biggest bottlenecks: scaling and talent

27:51 Should software set the standard?

29:36 Winning over the 40-year veterans

31:58 Agents checking agents — hallucination management

34:47 Closing thoughts + who should reach out

Structured.ai → https://getstructured.ai

Built to Scale is Scott Wilcox (W.) and Matt Perrott (BuildPass) building in public at the intersection of construction and AI.

Follow Scott → https://www.linkedin.com/in/scott-wilcox-wilcoxbuilt/

Follow Matt → https://www.linkedin.com/in/mattperrott/

links1