“An update on Generality Labs” by Justin Olive, James Mann

This is an update on what we’re doing at Generality Labs, and a quick introduction for those who aren’t familiar with our work Written by Justin Olive, co-founder & CEO Tl;dr I started Generality Labs because, when the time comes, I don’t think we’re going to be able to accurately measure the safety of dangerously capable AI systems. We're focused on AI evaluation, and our goal is to ensure that the best available tools and practices are adopted at the places where it matters most - AI safety labs, governments, 3rd party evaluators, frontier AI labs. We have 2 work streams: Services: Independent evaluation audits: we provide 3rd party audits for evaluation developers who want to catch flaws in their evals, and build trust with stakeholders through independent quality assurance Advising: we provide expert input into internal processes and standards relating to AI evaluation Research services: our forward deployed scientists & engineers help organisations run experiments that use our tools and infrastructure Tools/infra: Inspect Evals: our platform for sharing and running evals Inspect Auditor: runs experiments to stress-test an eval, and compiles findings into an audit report Here's how I see the next 1 to 2 years [...] --- Outline: (00:20) Tl;dr (02:11) Who are we? (03:06) Our plan to make AI safer (06:22) Why is this work necessary? --- First published: October 11th, 2026 Source: https://www.lesswrong.com/posts/mnWj4hSJxhSJY4N7N/an-update-on-generality-labs --- Narrated by TYPE III AUDIO.