0:00-44:46
Streams straight from the publisher. podnod never proxies or re-hosts episode audio.
Todays paper: VICReg (https://arxiv.org/abs/2105.04906)
Summary of the paper
VICReg prevents representation collapse using a mixture of variance, invariance and covariance when calculating the loss. It does not require negative samples and achieves great performance on downstream tasks.
Highlights of discussion
- The VICReg architecture (Figure 1)
- Sensitivity to hyperparameters (Table 7)
- Top 5 metric usefulness
https://arxiv.org/abs/2105.04906
arxiv.org