Commit graph

316 commits

Author SHA1 Message Date
lucasdelimanogueira
c3c8fd7199 fix name module parallel 2024-05-25 09:10:34 -03:00
lucasdelimanogueira
1e0c408ffb fix import distributed nn 2024-05-25 08:57:35 -03:00
lucasdelimanogueira
5283c1bc06 allreduce mean 2024-05-25 08:52:20 -03:00
lucasdelimanogueira
7a3b0f276b v1 distributed data parallel 2024-05-24 22:17:22 -03:00
lucasdelimanogueira
776aacabdd
Merge pull request #74 from lucasdelimanogueira/tmp
Tmp
2024-05-24 20:53:00 -03:00
lucasdelimanogueira
01b93132bc fix setup.py installing 2024-05-24 20:31:31 -03:00
lucasdelimanogueira
3ed877adbf fix distributed allreduce calling python 2024-05-24 20:16:08 -03:00
lucasdelimanogueira
8654374a33 fix setup.py install nccl 2024-05-24 20:13:16 -03:00
lucasdelimanogueira
6d8ff7f9af fix distributed allreduce calling python 2024-05-24 20:06:34 -03:00
lucasdelimanogueira
b21c7e9f34 fix setup.py 2024-05-24 19:57:49 -03:00
lucasdelimanogueira
5f92e6dc8c
Merge pull request #73 from lucasdelimanogueira/tmp
fix import distributed
2024-05-24 19:55:49 -03:00
lucasdelimanogueira
29ee569d04 fix import distributed 2024-05-24 19:55:19 -03:00
lucasdelimanogueira
2720f5c88c
Merge pull request #72 from lucasdelimanogueira/tmp
Tmp
2024-05-24 19:49:58 -03:00
lucasdelimanogueira
33d4dc14d8 fix install nccl setup.py 2024-05-24 19:49:25 -03:00
lucasdelimanogueira
ef272b65ee fix install nccl setup.py 2024-05-24 19:48:37 -03:00
lucasdelimanogueira
82b6aa245f
Merge pull request #71 from lucasdelimanogueira/tmp
fix readme
2024-05-24 18:37:11 -03:00
lucasdelimanogueira
b637c3e0f1 fix readme 2024-05-24 18:36:17 -03:00
lucasdelimanogueira
049a515e45
Merge pull request #70 from lucasdelimanogueira/tmp
Tmp
2024-05-24 18:35:30 -03:00
lucasdelimanogueira
94b3582a46 test broadcast and all reduce 2024-05-24 18:31:59 -03:00
lucasdelimanogueira
55db13836b broadcast allreduce nccl 2024-05-24 18:19:39 -03:00
lucasdelimanogueira
e55c1195ec implemented mpi for distributed run 2024-05-24 15:12:53 -03:00
lucasdelimanogueira
b152ae2a1d first commit distributed module 2024-05-23 19:15:30 -03:00
lucasdelimanogueira
15a817e295
Merge pull request #69 from lucasdelimanogueira/tmp
Tmp
2024-05-23 12:29:04 -03:00
lucasdelimanogueira
55fc1ac020 version 0.0.4 cuda running neural network 2024-05-23 12:28:46 -03:00
lucasdelimanogueira
8c5abb226c version 0.0.4 cuda running neural network 2024-05-23 12:28:17 -03:00
lucasdelimanogueira
77cabe41a2 fix cross entropy loss cuda 2024-05-23 12:19:32 -03:00
lucasdelimanogueira
4676a70d14 fix max min sum access elements autograd backward running on device 2024-05-23 12:16:07 -03:00
lucasdelimanogueira
9b49a07d2a fix max min sum access elements autograd backward running on device 2024-05-23 12:11:59 -03:00
lucasdelimanogueira
27feb8a366 fix autograd was not running on device 2024-05-23 12:07:17 -03:00
lucasdelimanogueira
472f3189c2 fix cross entropy loss send to device 2024-05-23 10:41:52 -03:00
lucasdelimanogueira
e8e0060955 fix cross entropy loss send to device 2024-05-23 10:35:55 -03:00
lucasdelimanogueira
8b19ac38c9 fix send module to device 2024-05-23 10:20:08 -03:00
lucasdelimanogueira
f13d22eb91 fix send to device unittest 2024-05-23 10:04:44 -03:00
lucasdelimanogueira
b1c28c4cea fix send to device 2024-05-23 10:00:48 -03:00
lucasdelimanogueira
d7a932f8ed fix send to device 2024-05-23 09:48:16 -03:00
lucasdelimanogueira
065e913b2d fix send to device 2024-05-23 09:46:35 -03:00
lucasdelimanogueira
a072b57b50 fix module send to cuda 2024-05-23 03:19:49 -03:00
lucasdelimanogueira
374792af81
Merge pull request #68 from lucasdelimanogueira/tmp
Tmp
2024-05-23 03:15:52 -03:00
lucasdelimanogueira
5946e6e1bd fix unittest test nn cuda 2024-05-23 03:01:27 -03:00
lucasdelimanogueira
d70e398773 fix autograd cuda unittests 2024-05-23 02:57:57 -03:00
lucasdelimanogueira
fb4f90b0cf small fix 3D transpose 2024-05-23 02:35:00 -03:00
lucasdelimanogueira
a0bfd6a0eb small fix 3D transpose 2024-05-23 02:34:38 -03:00
lucasdelimanogueira
38e629fc38 make contiguous cuda 2024-05-23 02:27:46 -03:00
lucasdelimanogueira
d2fc1e3617 make contiguous cuda 2024-05-23 02:27:30 -03:00
lucasdelimanogueira
702ebaf87c 1D, 2D and 3D transpose cuda 2024-05-23 02:09:32 -03:00
lucasdelimanogueira
fb6429aad6 min cuda and min cuda axis 2024-05-23 01:39:37 -03:00
lucasdelimanogueira
9708054ecd min cuda and min cuda axis 2024-05-23 01:36:04 -03:00
lucasdelimanogueira
223229fcd3 min cuda and min cuda axis 2024-05-23 01:35:45 -03:00
lucasdelimanogueira
e2a0262c4e small fix max cuda axis was setting init to 0 instead of -inf 2024-05-23 01:29:23 -03:00
lucasdelimanogueira
5882f1d801 max cuda and max cuda axis 2024-05-23 01:26:28 -03:00