
The Changelog: Software Development, Open Source
Let's archive the web (Interview)
Nov 27, 2024 · 1 hr 37 min · 82.2 MB
0:00-1:37:37
Streams straight from the publisher. PodNod never proxies or re-hosts episode audio.
Nick Sweeting joins Adam and Jerod to talk about the importance of archiving digital content, his work on ArchiveBox to make it easier, the challenges faced by Archive.org and the Wayback Machine, and the need for both centralized and distributed archiving solutions.
Changelog++ members get a bonus 5 minutes at the end of this episode and zero ads. Join today!
Sponsors:
- Fly.io – The home of Changelog.com — Deploy your apps close to your users — global Anycast load-balancing, zero-configuration private networking, hardware isolation, and instant WireGuard VPN connections. Push-button deployments that scale to thousands of instances. Check out the speedrun to get started in minutes.
- Timescale – Purpose-built performance for AI Build RAG, search, and AI agents on the cloud and with PostgreSQL and purpose-built extensions for AI: pgvector, pgvectorscale, and pgai.
- Wix Studio – Wix Sudio is for devs who build websites, sell apps, go headless, or manage clients. Integrate, extend and write custom scripts in a VS code-based IDE. Leverage zero set up dev, test and production environments. Ship faster with an AI code assistant. And work with Wix headless API’s on any tech stack.
- WorkOS – AuthKit offers 1,000,000 monthly active users (MAU) free — The world’s best login box, powered by WorkOS + Radix. Learn more and get started at WorkOS.com and AuthKit.com
Featuring:
- Nick Sweeting – Website, GitHub, LinkedIn, X
- Adam Stacoviak – Website, GitHub, LinkedIn, Mastodon, X
- Jerod Santo – Website, GitHub, LinkedIn, Mastodon, X
Show Notes:
- ArchiveBox
- ArchiveBox/abx-dl
- ArchiveBox/abx-pkg
- So you want to build a social network?
- The Internet Archive Loses Its Appeal of a Major Copyright Case
- Hachette v. Internet Archive | Electronic Frontier Foundation
- Fahrenheit 451 - Wikipedia
- Winamp Skin Museum
- Fiscal Sponsorship – Hack Club
- DigestBox
Something missing or broken? PRs welcome!
ArchiveBox
archivebox.ioJoin the discussion
changelog.zulipchat.comChangelog++
changelog.comFly.io
fly.ioCheck out the speedrun
fly.ioTimescale
timescale.comWix Studio
wix.comWorkOS
workos.comWorkOS.com
workos.comAuthKit.com
authkit.comWebsite
sweeting.meGitHub
github.comLinkedIn
linkedin.comX
x.comWebsite
adamstacoviak.comGitHub
github.comLinkedIn
linkedin.comMastodon
changelog.socialX
x.comWebsite
jerodsanto.netGitHub
github.comLinkedIn
linkedin.comMastodon
changelog.socialX
x.comArchiveBox/abx-dl
github.comArchiveBox/abx-pkg
github.comSo you want to build a social network?
docs.sweeting.meFahrenheit 451 - Wikipedia
en.wikipedia.orgWinamp Skin Museum
skins.webamp.orgFiscal Sponsorship – Hack Club
hackclub.comDigestBox
digestbox.ioPRs welcome!
github.com
- 0:00Software moves fast. So keep up.
- 1:06Sponsor: Fly.io
- 3:35Let's talk archiving
- 5:34Wayback Machine has had challenges
- 14:25Starting ArchiveBox
- 16:11Fahrenheit 451
- 22:47The internet is young
- 29:45The time unlock
- 33:00Sponsor: Timescale
- 35:17Sponsor: Wix
- 36:11Archiving for legacy
- 38:162070 headline
- 41:34How does it work?
- 44:28Dealing archive and file size
- 46:41Nick uses ZFS!!
- 48:12Going mainstream?
- 49:27Accessing credentialed stuff
- 51:54Single or multiplayer game?
- 54:47Running ArchiveBox
- 56:29abx-dl is cool
- 59:39Adam's confession
- 1:01:09This needs to become a thing
- 1:02:40Nick's personal archive
- 1:03:29Sponsor: WorkOS
- 1:06:19This video is no longer available
- 1:09:12Seriously using ArchiveBox
- 1:11:52Mostly cooking videos
- 1:15:27An internet on the internet
- 1:17:00Session replay for your archive
- 1:18:45An index worth sharing
- 1:21:18Adam is sold, Jerod is not.
- 1:22:01Thanks Hack Club Bank (HBC)
- 1:23:31Nick interviews Adam and Jerod
- 1:27:54You as a model
- 1:31:05Are we done?
- 1:31:53Closing thoughts and stuff
- 1:36:01++ Teaser