Skip to content
Sign in
Artwork for PyTorch Developer Podcast
PyTorch Developer Podcast · Aug 4, 2024 · 16 min

Compiler collectives

Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935

0:00-16:33
Play in

transcript

No transcript — this publisher did not publish one.

show notes

Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935

links1

more episodes

All episodes