Commit graph

38 commits

Author SHA1 Message Date
lucasdelimanogueira
e6d58121f1 fix memory usage 2024-06-05 20:24:09 -03:00
lucasdelimanogueira
7691cbc2dc fix allreduce distributed not working after 2nd iteration 2024-06-03 15:15:35 -03:00
lucasdelimanogueira
c42d334599 fix allreduce distributed not working after 2nd iteration 2024-06-03 15:14:42 -03:00
lucasdelimanogueira
e706b81007 fix broadcast and reduce gradients distributeddataparallel and tensor hooks 2024-06-03 11:40:05 -03:00
lucasdelimanogueira
ef84c08841 fix backward reduce distributed 2024-06-01 20:55:02 -03:00
lucasdelimanogueira
e590f57555 implemented distributed sampler 2024-05-25 10:53:09 -03:00
lucasdelimanogueira
c3c8fd7199 fix name module parallel 2024-05-25 09:10:34 -03:00
lucasdelimanogueira
1e0c408ffb fix import distributed nn 2024-05-25 08:57:35 -03:00
lucasdelimanogueira
7a3b0f276b v1 distributed data parallel 2024-05-24 22:17:22 -03:00
lucasdelimanogueira
8c5abb226c version 0.0.4 cuda running neural network 2024-05-23 12:28:17 -03:00
lucasdelimanogueira
77cabe41a2 fix cross entropy loss cuda 2024-05-23 12:19:32 -03:00
lucasdelimanogueira
472f3189c2 fix cross entropy loss send to device 2024-05-23 10:41:52 -03:00
lucasdelimanogueira
e8e0060955 fix cross entropy loss send to device 2024-05-23 10:35:55 -03:00
lucasdelimanogueira
8b19ac38c9 fix send module to device 2024-05-23 10:20:08 -03:00
lucasdelimanogueira
065e913b2d fix send to device 2024-05-23 09:46:35 -03:00
lucasdelimanogueira
a072b57b50 fix module send to cuda 2024-05-23 03:19:49 -03:00
lucasdelimanogueira
40a6bccab4 vision tranform, readme and example training 2024-05-22 14:25:02 -03:00
lucasdelimanogueira
cebf890165 sigmoid kernel avoid overflow 2024-05-22 13:24:01 -03:00
lucasdelimanogueira
0972a0873f small fix crossentropy 2024-05-22 10:34:16 -03:00
lucasdelimanogueira
34a762b666 fix shape one hot cross entropy 2024-05-21 19:50:17 -03:00
lucasdelimanogueira
9cfb1f622d softmax autograd 2024-05-21 13:52:05 -03:00
lucasdelimanogueira
d530f79a82 cross entropy loss 2024-05-21 12:16:12 -03:00
lucasdelimanogueira
a39bd59a3f softmax operation 2024-05-21 01:22:38 -03:00
lucasdelimanogueira
5e72fe57d3 softmax v1 need fix some erros yet 2024-05-20 20:16:41 -03:00
lucasdelimanogueira
cc483417dc max min and equal operations 2024-05-20 12:50:45 -03:00
lucasdelimanogueira
418bb20b29 fix add broadcasted backward grad wrong values 2024-05-18 15:08:31 -03:00
lucasdelimanogueira
eb49d8cae3 fixed sum axis with keepdim 2024-05-17 20:12:57 -03:00
lucasdelimanogueira
5dd3f3d202 implementing keepdim sum 2024-05-17 19:08:09 -03:00
lucasdelimanogueira
7e3100f796 unit test nn module mse loss and sigmoid 2024-05-07 17:44:59 -03:00
lucasdelimanogueira
2c2569d482 operations unit tests 2024-05-07 11:52:56 -03:00
lucasdelimanogueira
ef3868066e Fix long time step() detach 2024-05-07 01:30:45 -03:00
lucasdelimanogueira
1ccf9a6c8d some tests test.py 2024-05-07 01:00:08 -03:00
lucasdelimanogueira
ffe10e48c5 Fix grad update step! loss decreasing 2024-05-07 00:10:25 -03:00
lucasdelimanogueira
b034d86ec3 Fix recursion backward increasing a lot 2024-05-06 22:58:37 -03:00
lucasdelimanogueira
de6f2af637 fix upgrade grads reference to parameter 2024-05-06 20:40:06 -03:00
lucasdelimanogueira
e5819a4121 nn module v1 2024-05-06 19:47:27 -03:00
lucasdelimanogueira
1e00930c4e Fix nn.Module linear 2024-05-06 13:23:22 -03:00
lucasdelimanogueira
ca4a0f0dbc nn module, log, div, pow 2024-05-06 01:21:18 -03:00