Commit graph

11 commits

Author SHA1 Message Date
lucasdelimanogueira
64f08a8963 multigpu training support v0.0.5 2024-06-03 15:37:57 -03:00
lucasdelimanogueira
c42d334599 fix allreduce distributed not working after 2nd iteration 2024-06-03 15:14:42 -03:00
lucasdelimanogueira
e590f57555 implemented distributed sampler 2024-05-25 10:53:09 -03:00
lucasdelimanogueira
0e9c4779a8 add argument src to broadcast distributed 2024-05-25 09:38:14 -03:00
lucasdelimanogueira
5283c1bc06 allreduce mean 2024-05-25 08:52:20 -03:00
lucasdelimanogueira
3ed877adbf fix distributed allreduce calling python 2024-05-24 20:16:08 -03:00
lucasdelimanogueira
6d8ff7f9af fix distributed allreduce calling python 2024-05-24 20:06:34 -03:00
lucasdelimanogueira
94b3582a46 test broadcast and all reduce 2024-05-24 18:31:59 -03:00
lucasdelimanogueira
55db13836b broadcast allreduce nccl 2024-05-24 18:19:39 -03:00
lucasdelimanogueira
e55c1195ec implemented mpi for distributed run 2024-05-24 15:12:53 -03:00
lucasdelimanogueira
b152ae2a1d first commit distributed module 2024-05-23 19:15:30 -03:00