+ &jaRt0tRt^RIHt^RIHt^RIHt^RIH t ^RI t ^RI H t H t HtHtHt^RIHt/t]^k.ROt!R R] 4tR R ltR R ltRRlt]!R]4]!R]4RRltRRlt]RRl4tR#)z This is an experimental new API for PyTorch Distributed. This is actively in development and subject to change or deletion entirely. This is intended as a proving ground for more flexible and object oriented distributed APIs. ) Generator)contextmanager) timedelta)ProtocolN)_current_process_group_set_process_group ProcessGroupReduceOpStore) rendezvousProcessGroupFactoryc6a]tRt^$toRtV3RlRltRtVtR#)r z%Protocol for process group factories.cX<V^8dQhRS[RS[RS[RS[RS[PRS[RS[/#storerank world_sizetimeoutdevicekwargsreturnr intrtorchrobjectr)format __classdict__s"p/Users/jameslopez/projects/CWCArchive/cwc-podcast/.venv/lib/python3.14/site-packages/torch/distributed/_dist2.py __annotate__ ProcessGroupFactory.__annotate__'sU      c R#)N)selfrrrrrrs&&&&&&,r__call__ProcessGroupFactory.__call__'sr!r#N)__name__ __module__ __qualname____firstlineno____doc__r%__static_attributes____classdictcell__)rs@rr r $s/r!c4V^8dQhR\R\RR/#)rnamefuncrN)strr )rs"rrr2s"  3 &9 d r!cLV\9d\RV R24hV\V&R#)z Register a new process group backend. Args: name: The name of the backend. func: The function to create the process group. Backend z already registeredN) _BACKENDS ValueError)r/r0s&&rregister_backendr62s* y8D6)<=>>IdOr!cV^8dQhR\R\R\R\R\PR\ R\ /#rr)rs"rrr@sR    LL   r!c ~^RIHp\V4^8wd \R4hV!WW#4pVP 4\ WV4pVP \ PP4VPV\ PPV4VP\P!R4\ PPV4\PP4'd@VP\P!R4\ PPV4V#))ProcessGroupGlooz'Gloo backend received unexpected kwargscpucuda)torch.distributedr:lenAssertionError_set_sequence_number_for_groupr_set_default_backend BackendTypeGLOO_register_backendrrr< is_available) rrrrrrr: backend_classpgs &&&&&, r _gloo_factoryrH@s3 6{aFGG$U*FM002 e: .BL4499:!9!9!>!> N U\55::M zz    LL ,":":"?"?  Ir!cV^8dQhR\R\R\R\R\PR\ R\ /#rr)rs"rrr_sR    LL   r!c ^RIHpVP4pW7nVP 4F0wr\ Wx4'g\ RV 24h\WxV 4K2 V!WW'4p V P4V PV4\WV4p V P\PP4V PV\PPV 4V #)r9)ProcessGroupNCCLzUnknown option )r=rKOptions_timeoutitemshasattrKeyErrorsetattrr@eager_connect_single_devicerrArBNCCLrD) rrrrrrrKoptskvrFrGs &&&&&, r _nccl_factoryrW_s3  # # %DM t_QC01 1 %U*CM002--f5 e: .BL4499:!9!9!>!> N Ir!glooncclc ~V^8dQhR\R\R\\P,R\R\ /#)rbackendrrrr)r1rrrrr)rs"rrrsJRR R R %,, R R  Rr!c V\9d\RV R24h\P!V4p\ \ \ R444wrEpVPV4\V,!WEWaV3/VB#)a Create a new process group with the given backend and options. This group is independent and will not be globally registered and thus not usable via the standard torch.distributed.* APIs. Args: backend: The backend to use for the process group. timeout: The timeout for collective operations. device: The device to use for the process group. **kwargs: All remaining arguments are passed to the backend constructor. See the backend specific documentation for details. Returns: A new process group. r3z not registeredzenv://)r4r5rrnextiterr set_timeout)r[rrrrrrs&&&, r new_groupr`sn*i8G9O<== \\& !F"4 8(<#=>E g W e: Q& QQr!c$V^8dQhR\/#)rr)r)rs"rrrs$$|$r!c\4#)z^ Get the current process group. Thread local method. Returns: The current process group. )rr#r!rcurrent_process_grouprcs  " ##r!c>V^8dQhR\R\R,/#)rrGr)NNN)rr)rs"rrrs $ $l $y1A'B $r!c#x"\4p\V4Rx\V4R# \T4i;i5i)zc Context manager for process groups. Thread local method. Args: pg: The process group to use. N)rcr)rGprev_pgs& r process_grouprgs0$%Gr$ 7#7#s:* : 7:cZV^8dQh/^\9d\\R3,;R&#)rr r4)__conditional_annotations__dictr1)rs"rrrs),104** +0-r!)rr r r6r`rcrg)rir+collections.abcr contextlibrdatetimertypingrrtorch._C._distributed_c10drrrr r torch.distributed.rendezvousr r4__all__r r6rHrWr`rcrgr)ris@rrrs &% 4/1 0  (  >8''R@$ $ $r!