lucasdelimanogueira
|
53983be40a
|
v0.0.7 improve memory usage
|
2024-06-05 21:07:07 -03:00 |
|
lucasdelimanogueira
|
70cbd45ae7
|
fix memory usage
|
2024-06-05 21:04:09 -03:00 |
|
lucasdelimanogueira
|
e6d58121f1
|
fix memory usage
|
2024-06-05 20:24:09 -03:00 |
|
lucasdelimanogueira
|
e670559fe4
|
fix memory issues del tensors
|
2024-06-05 15:43:19 -03:00 |
|
lucasdelimanogueira
|
6701179c22
|
del tensor free memory
|
2024-06-05 14:31:48 -03:00 |
|
lucasdelimanogueira
|
b56ed81cd7
|
add comment on reduce cuda
|
2024-06-04 11:21:56 -03:00 |
|
lucasdelimanogueira
|
64f08a8963
|
multigpu training support v0.0.5
|
2024-06-03 15:37:57 -03:00 |
|
lucasdelimanogueira
|
7691cbc2dc
|
fix allreduce distributed not working after 2nd iteration
|
2024-06-03 15:15:35 -03:00 |
|
lucasdelimanogueira
|
c42d334599
|
fix allreduce distributed not working after 2nd iteration
|
2024-06-03 15:14:42 -03:00 |
|
lucasdelimanogueira
|
e706b81007
|
fix broadcast and reduce gradients distributeddataparallel and tensor hooks
|
2024-06-03 11:40:05 -03:00 |
|
lucasdelimanogueira
|
ef84c08841
|
fix backward reduce distributed
|
2024-06-01 20:55:02 -03:00 |
|
lucasdelimanogueira
|
4b683a20e9
|
fix distributed ncclCommInitRank
|
2024-05-31 19:40:58 -03:00 |
|
lucasdelimanogueira
|
38a860eba1
|
fix send to other devices and compile on cloud
|
2024-05-29 17:48:37 -03:00 |
|
lucasdelimanogueira
|
bb88630608
|
fix import lib
|
2024-05-28 10:15:12 -03:00 |
|
lucasdelimanogueira
|
002287d832
|
remove print from cuda to cpu
|
2024-05-27 20:55:50 -03:00 |
|
lucasdelimanogueira
|
e3bb882d3c
|
fix distributed dataloader
|
2024-05-27 15:08:27 -03:00 |
|
lucasdelimanogueira
|
10a88fe8ca
|
unit test dataloader and distributedsampler
|
2024-05-25 11:55:59 -03:00 |
|
lucasdelimanogueira
|
e590f57555
|
implemented distributed sampler
|
2024-05-25 10:53:09 -03:00 |
|
lucasdelimanogueira
|
56fff47001
|
fix import data module
|
2024-05-25 09:55:02 -03:00 |
|
lucasdelimanogueira
|
9d7417a531
|
distributed sampler
|
2024-05-25 09:48:32 -03:00 |
|
lucasdelimanogueira
|
a316dfd191
|
add argument src to broadcast distributed
|
2024-05-25 09:38:42 -03:00 |
|
lucasdelimanogueira
|
0e9c4779a8
|
add argument src to broadcast distributed
|
2024-05-25 09:38:14 -03:00 |
|
lucasdelimanogueira
|
c3c8fd7199
|
fix name module parallel
|
2024-05-25 09:10:34 -03:00 |
|
lucasdelimanogueira
|
1e0c408ffb
|
fix import distributed nn
|
2024-05-25 08:57:35 -03:00 |
|
lucasdelimanogueira
|
5283c1bc06
|
allreduce mean
|
2024-05-25 08:52:20 -03:00 |
|
lucasdelimanogueira
|
7a3b0f276b
|
v1 distributed data parallel
|
2024-05-24 22:17:22 -03:00 |
|
lucasdelimanogueira
|
3ed877adbf
|
fix distributed allreduce calling python
|
2024-05-24 20:16:08 -03:00 |
|
lucasdelimanogueira
|
6d8ff7f9af
|
fix distributed allreduce calling python
|
2024-05-24 20:06:34 -03:00 |
|
lucasdelimanogueira
|
29ee569d04
|
fix import distributed
|
2024-05-24 19:55:19 -03:00 |
|
lucasdelimanogueira
|
94b3582a46
|
test broadcast and all reduce
|
2024-05-24 18:31:59 -03:00 |
|
lucasdelimanogueira
|
55db13836b
|
broadcast allreduce nccl
|
2024-05-24 18:19:39 -03:00 |
|
lucasdelimanogueira
|
e55c1195ec
|
implemented mpi for distributed run
|
2024-05-24 15:12:53 -03:00 |
|
lucasdelimanogueira
|
b152ae2a1d
|
first commit distributed module
|
2024-05-23 19:15:30 -03:00 |
|
lucasdelimanogueira
|
55fc1ac020
|
version 0.0.4 cuda running neural network
|
2024-05-23 12:28:46 -03:00 |
|
lucasdelimanogueira
|
8c5abb226c
|
version 0.0.4 cuda running neural network
|
2024-05-23 12:28:17 -03:00 |
|
lucasdelimanogueira
|
77cabe41a2
|
fix cross entropy loss cuda
|
2024-05-23 12:19:32 -03:00 |
|
lucasdelimanogueira
|
9b49a07d2a
|
fix max min sum access elements autograd backward running on device
|
2024-05-23 12:11:59 -03:00 |
|
lucasdelimanogueira
|
27feb8a366
|
fix autograd was not running on device
|
2024-05-23 12:07:17 -03:00 |
|
lucasdelimanogueira
|
472f3189c2
|
fix cross entropy loss send to device
|
2024-05-23 10:41:52 -03:00 |
|
lucasdelimanogueira
|
e8e0060955
|
fix cross entropy loss send to device
|
2024-05-23 10:35:55 -03:00 |
|
lucasdelimanogueira
|
8b19ac38c9
|
fix send module to device
|
2024-05-23 10:20:08 -03:00 |
|
lucasdelimanogueira
|
b1c28c4cea
|
fix send to device
|
2024-05-23 10:00:48 -03:00 |
|
lucasdelimanogueira
|
d7a932f8ed
|
fix send to device
|
2024-05-23 09:48:16 -03:00 |
|
lucasdelimanogueira
|
065e913b2d
|
fix send to device
|
2024-05-23 09:46:35 -03:00 |
|
lucasdelimanogueira
|
a072b57b50
|
fix module send to cuda
|
2024-05-23 03:19:49 -03:00 |
|
lucasdelimanogueira
|
fb4f90b0cf
|
small fix 3D transpose
|
2024-05-23 02:35:00 -03:00 |
|
lucasdelimanogueira
|
a0bfd6a0eb
|
small fix 3D transpose
|
2024-05-23 02:34:38 -03:00 |
|
lucasdelimanogueira
|
38e629fc38
|
make contiguous cuda
|
2024-05-23 02:27:46 -03:00 |
|
lucasdelimanogueira
|
702ebaf87c
|
1D, 2D and 3D transpose cuda
|
2024-05-23 02:09:32 -03:00 |
|
lucasdelimanogueira
|
fb6429aad6
|
min cuda and min cuda axis
|
2024-05-23 01:39:37 -03:00 |
|