Programming Throwdown

169: HyperLogLog

Nov 27, 2023 · 1 hr 29 min · Episode 169 · 86.0 MB
0:00-1:29:33

Streams straight from the publisher. podnod never proxies or re-hosts episode audio.

Intro topic: Testing your car battery

News/Links:

Book of the Show

Patreon Plug https://www.patreon.com/programmingthrowdown?ty=h


Tool of the Show


Topic: HyperLogLog

  • Motivation
    • Cardinality Counting
  • LinearCounting
    • Hash + expectation of collision based on how full
    • Bloom Filter
  • LogLog
    • Use first N bits as bucket
    • Use max sequential 0s in each bucket
    • Average
  • HyperLogLog
    • Handle empty buckets
    • Use correction factor like linear counting for low counts (number of empty buckets) and high counts
  • Distributing

    • Transfer bucket counts

★ Support this podcast on Patreon ★