Commit graph

264 commits

Author SHA1 Message Date
lucasdelimanogueira
bb88630608 fix import lib 2024-05-28 10:15:12 -03:00
lucasdelimanogueira
002287d832 remove print from cuda to cpu 2024-05-27 20:55:50 -03:00
lucasdelimanogueira
87bf2318ca test broadcast allreduce multi gpu 2024-05-27 15:15:53 -03:00
lucasdelimanogueira
6b450a87bf fix readme 2024-05-27 15:13:03 -03:00
lucasdelimanogueira
100799215f fix readme 2024-05-27 15:11:40 -03:00
lucasdelimanogueira
240e603c0c fix distributed dataloader 2024-05-27 15:09:07 -03:00
lucasdelimanogueira
e3bb882d3c fix distributed dataloader 2024-05-27 15:08:27 -03:00
lucasdelimanogueira
10a88fe8ca unit test dataloader and distributedsampler 2024-05-25 11:55:59 -03:00
lucasdelimanogueira
e590f57555 implemented distributed sampler 2024-05-25 10:53:09 -03:00
lucasdelimanogueira
56fff47001 fix import data module 2024-05-25 09:55:02 -03:00
lucasdelimanogueira
9d7417a531 distributed sampler 2024-05-25 09:48:32 -03:00
lucasdelimanogueira
a316dfd191 add argument src to broadcast distributed 2024-05-25 09:38:42 -03:00
lucasdelimanogueira
0e9c4779a8 add argument src to broadcast distributed 2024-05-25 09:38:14 -03:00
lucasdelimanogueira
c3c8fd7199 fix name module parallel 2024-05-25 09:10:34 -03:00
lucasdelimanogueira
1e0c408ffb fix import distributed nn 2024-05-25 08:57:35 -03:00
lucasdelimanogueira
5283c1bc06 allreduce mean 2024-05-25 08:52:20 -03:00
lucasdelimanogueira
7a3b0f276b v1 distributed data parallel 2024-05-24 22:17:22 -03:00
lucasdelimanogueira
01b93132bc fix setup.py installing 2024-05-24 20:31:31 -03:00
lucasdelimanogueira
3ed877adbf fix distributed allreduce calling python 2024-05-24 20:16:08 -03:00
lucasdelimanogueira
8654374a33 fix setup.py install nccl 2024-05-24 20:13:16 -03:00
lucasdelimanogueira
6d8ff7f9af fix distributed allreduce calling python 2024-05-24 20:06:34 -03:00
lucasdelimanogueira
b21c7e9f34 fix setup.py 2024-05-24 19:57:49 -03:00
lucasdelimanogueira
29ee569d04 fix import distributed 2024-05-24 19:55:19 -03:00
lucasdelimanogueira
33d4dc14d8 fix install nccl setup.py 2024-05-24 19:49:25 -03:00
lucasdelimanogueira
ef272b65ee fix install nccl setup.py 2024-05-24 19:48:37 -03:00
lucasdelimanogueira
b637c3e0f1 fix readme 2024-05-24 18:36:17 -03:00
lucasdelimanogueira
94b3582a46 test broadcast and all reduce 2024-05-24 18:31:59 -03:00
lucasdelimanogueira
55db13836b broadcast allreduce nccl 2024-05-24 18:19:39 -03:00
lucasdelimanogueira
e55c1195ec implemented mpi for distributed run 2024-05-24 15:12:53 -03:00
lucasdelimanogueira
b152ae2a1d first commit distributed module 2024-05-23 19:15:30 -03:00
lucasdelimanogueira
55fc1ac020 version 0.0.4 cuda running neural network 2024-05-23 12:28:46 -03:00
lucasdelimanogueira
8c5abb226c version 0.0.4 cuda running neural network 2024-05-23 12:28:17 -03:00
lucasdelimanogueira
77cabe41a2 fix cross entropy loss cuda 2024-05-23 12:19:32 -03:00
lucasdelimanogueira
4676a70d14 fix max min sum access elements autograd backward running on device 2024-05-23 12:16:07 -03:00
lucasdelimanogueira
9b49a07d2a fix max min sum access elements autograd backward running on device 2024-05-23 12:11:59 -03:00
lucasdelimanogueira
27feb8a366 fix autograd was not running on device 2024-05-23 12:07:17 -03:00
lucasdelimanogueira
472f3189c2 fix cross entropy loss send to device 2024-05-23 10:41:52 -03:00
lucasdelimanogueira
e8e0060955 fix cross entropy loss send to device 2024-05-23 10:35:55 -03:00
lucasdelimanogueira
8b19ac38c9 fix send module to device 2024-05-23 10:20:08 -03:00
lucasdelimanogueira
f13d22eb91 fix send to device unittest 2024-05-23 10:04:44 -03:00
lucasdelimanogueira
b1c28c4cea fix send to device 2024-05-23 10:00:48 -03:00
lucasdelimanogueira
d7a932f8ed fix send to device 2024-05-23 09:48:16 -03:00
lucasdelimanogueira
065e913b2d fix send to device 2024-05-23 09:46:35 -03:00
lucasdelimanogueira
a072b57b50 fix module send to cuda 2024-05-23 03:19:49 -03:00
lucasdelimanogueira
5946e6e1bd fix unittest test nn cuda 2024-05-23 03:01:27 -03:00
lucasdelimanogueira
d70e398773 fix autograd cuda unittests 2024-05-23 02:57:57 -03:00
lucasdelimanogueira
fb4f90b0cf small fix 3D transpose 2024-05-23 02:35:00 -03:00
lucasdelimanogueira
a0bfd6a0eb small fix 3D transpose 2024-05-23 02:34:38 -03:00
lucasdelimanogueira
38e629fc38 make contiguous cuda 2024-05-23 02:27:46 -03:00
lucasdelimanogueira
d2fc1e3617 make contiguous cuda 2024-05-23 02:27:30 -03:00