+ &j^RIt^RIt^RIHt^RIt.ROt^tRtRt Rt Rt RRlt R]RR3R lt R^]RR3R R/R R llltRR RlltRRRllt]RR3RRlltR#)N)Sequencecz\\PR4'g\P!R^R7R#\ 4pVFppVP 'dR#VP4'gR#VP'gR#VP4pW19dR#VPV4Kr R#)_nccl_all_reducez)PyTorch is not compiled with NCCL support stacklevelFT) hasattrtorch_Cwarningswarnset is_sparse is_contiguousis_cuda get_deviceadd)tensorsdevicestensordevices& g/Users/jameslopez/projects/CWCArchive/cwc-podcast/.venv/lib/python3.14/site-packages/torch/cuda/nccl.py is_availablers 588/ 0 0 AaPeG    ##%%~~~""$   F c\PP4pV^ , pV^, R,pVR,p\PP4P R4pVR8XdWV3#WW43#)a Returns the version of the NCCL. This function returns a tuple containing the major, minor, and patch version numbers of the NCCL. The suffix is also included in the tuple if a version suffix exists. Returns: tuple: The version information of the NCCL. izutf-8)r r _nccl_version_nccl_version_suffixdecode)vermajorminorpatchsuffixs rversionr$#sp (( "C 2IE BY% E %KE XX * * , 3 3G \PP4#N)r r _nccl_unique_idrr unique_idr)8s 88 # # %%rcB\PPWV4#r&)r r _nccl_init_rank) num_ranksuidranks&&&r init_rankr/<s 88 # #ID 99rc|V^8dQhR\P\\P,,RR/#)inputsreturnN)r Tensorr)formats"r __annotate__r6@s0DD0F!FD4Drc\V\PP4'd!\V\P 4'd \ R4hR#)z(Inputs should be a collection of tensorsN) isinstance collectionsabc Containerr r4 TypeError)r2s&r_check_sequence_typer=@sA fkoo77 8 8J ==BCC=rc\V4VfTp\V4\PPWW#V4R#r&)r=r r rr2outputsopstreamscommss&&&&&r all_reducerDGs2 ! HHfrEBrr@ctV^8dQhR\\P,R\P\\P,,R,R\R\R\\PP ,R,R\\P,R,RR/#) r1r2outputNrootrArBr@r3)rr r4intcudaStream)r5s"rr6r6Qs(E(E U\\ "(E LL8ELL1 1D 8(E (E (E ejj'' (4 / (Eell #d *(E (Erc\V4Ve6Ve \R4h\P!R\^R7Wb,pM~\ V\ P4'gQ\ V\PP4'd'\P!R\^R7W,pMVf W,MTp\ PPWW#WE4R#)Nz'output' and 'outputs' can not be both specified. 'outputs' is deprecated in favor of 'output', taking in a single output tensor. The signature of reduce is: reduce(inputs, output=None, root=0, op=SUM, streams=None, comms=None).z`nccl.reduce` with an output tensor list is deprecated. Please specify a single output tensor with argument 'output' instead instead.rz\nccl.reduce with an output tensor list is deprecated. Please specify a single output tensor.) r= ValueErrorr r FutureWarningr8r r4r9r:rr _nccl_reduce)r2rFrGrArBrCr@_outputs&&&&&&$ rreducerPQs   Y  MM`   mG  - -* ((33   5   ,"(.&,f HH&4WDrc^V^8dQhR\\P,R\RR/#)r1r2rGr3Nrr r4rH)r5s"rr6r6|s-;; U\\ ";*-; ;rc\\V4\PPWW#4R#r&)r=r r _nccl_broadcast)r2rGrBrCs&&&&r broadcastrU|s   HHV7:rcV^8dQhR\\P,R\\P,RR/#)r1r2r@r3N)rr r4)r5s"rr6r6s8?? U\\ "? ell #?  ?rcr\V4\V4\PPWW#4R#r&)r=r r _nccl_all_gather)r2r@rBrCs&&&&r all_gatherrYs(  ! HHfw>rcV^8dQhR\\P,R\\P,R\RR/#)r1r2r@rAr3NrR)r5s"rr6r6sH G G U\\ " G ell # G  G  Grct\V4\V4\PPWW#V4R#r&)r=r r _nccl_reduce_scatterr?s&&&&&rreduce_scatterr]s* ! HH!!&2Fr)rDrPrUrYr])rNN)NN)r9r collections.abcr torch.cudar __all__SUMrr$r)r/r=rDrPrUrYr]r(rrrbs$ P*-*&:D $TC<@26  (E.2(E(EV;?   G Gr