Leverage Foundational Models for Black-Box Optimization

Where and how can we use foundation models in AutoML? Richard Song, researcher at Google DeepMind, has some answers. Starting off from his position paper on leveraging foundation models for optimization, we chat about what makes foundation models valuable for AutoML, how the next steps could look like, but also why the community is not currently embracing the topic as much as it could. Paper Link: https://arxiv.org/abs/2405.03547 Richard's website: https://xingyousong.github.io/