Skip to content
Artwork for My Weird Prompts
My Weird Prompts · Yesterday · 25 min

Self-Hosting an Analytical Stack Around Postgres

Running analytical data engines alongside PostgreSQL no longer requires rented cloud warehouses. While permissive open-source tools like ClickHouse, DuckDB, and DuckLake make the query and metadata layers surprisingly lightweight, building a self-hosted stack comes with hidden operational costs. Examining everything from Apache Iceberg catalogs to in-process querying via DuckDB reveals that the analytical engine is simple to self-host, but real-time change data capture pipelines remain full of tricky architectural traps. Key sources: • last push 2026-11-03, v26.10.2.103-stable (2026-10-24) — https://github.com/ClickHouse/ClickHouse • last push 2026-11-03, v2.0.0 Cyanoptera (2026-10-21) — https://github.com/duckdb/duckdb • last push 2026-11-03 — https://github.com/apache/datafusion Episode 6428 — myweirdprompts.com/n/6428 (permanent short link: myweirdprompts.com/759810) Listen on Android: MWP FM Player — myweirdprompts.com/apk

0:00 · Intro-25:53

transcript

No transcript — this publisher did not publish one.

show notes

Running analytical data engines alongside PostgreSQL no longer requires rented cloud warehouses. While permissive open-source tools like ClickHouse, DuckDB, and DuckLake make the query and metadata layers surprisingly lightweight, building a self-hosted stack comes with hidden operational costs. Examining everything from Apache Iceberg catalogs to in-process querying via DuckDB reveals that the analytical engine is simple to self-host, but real-time change data capture pipelines remain full of tricky architectural traps.

Key sources:
• last push 2026-11-03, v26.10.2.103-stable (2026-10-24) — https://github.com/ClickHouse/ClickHouse
• last push 2026-11-03, v2.0.0 Cyanoptera (2026-10-21) — https://github.com/duckdb/duckdb
• last push 2026-11-03 — https://github.com/apache/datafusion

Episode 6428 — myweirdprompts.com/n/6428 (permanent short link: myweirdprompts.com/759810)

Listen on Android: MWP FM Player — myweirdprompts.com/apk

chapters

7 chapters