Commit graph

82 commits

Author SHA1 Message Date
lucasdelimanogueira
70cbd45ae7 fix memory usage 2024-06-05 21:04:09 -03:00
lucasdelimanogueira
e6d58121f1 fix memory usage 2024-06-05 20:24:09 -03:00
lucasdelimanogueira
e670559fe4 fix memory issues del tensors 2024-06-05 15:43:19 -03:00
lucasdelimanogueira
6701179c22 del tensor free memory 2024-06-05 14:31:48 -03:00
lucasdelimanogueira
c42d334599 fix allreduce distributed not working after 2nd iteration 2024-06-03 15:14:42 -03:00
lucasdelimanogueira
e706b81007 fix broadcast and reduce gradients distributeddataparallel and tensor hooks 2024-06-03 11:40:05 -03:00
lucasdelimanogueira
e590f57555 implemented distributed sampler 2024-05-25 10:53:09 -03:00
lucasdelimanogueira
e55c1195ec implemented mpi for distributed run 2024-05-24 15:12:53 -03:00
lucasdelimanogueira
b152ae2a1d first commit distributed module 2024-05-23 19:15:30 -03:00
lucasdelimanogueira
77cabe41a2 fix cross entropy loss cuda 2024-05-23 12:19:32 -03:00
lucasdelimanogueira
8b19ac38c9 fix send module to device 2024-05-23 10:20:08 -03:00
lucasdelimanogueira
f25a060294 fix sum cuda axis with atomicAdd 2024-05-23 01:06:21 -03:00
lucasdelimanogueira
65dc86aaa4 broadcasted batched matmul cuda 2024-05-22 19:20:54 -03:00
lucasdelimanogueira
40a6bccab4 vision tranform, readme and example training 2024-05-22 14:25:02 -03:00
lucasdelimanogueira
cebf890165 sigmoid kernel avoid overflow 2024-05-22 13:24:01 -03:00
lucasdelimanogueira
0972a0873f small fix crossentropy 2024-05-22 10:34:16 -03:00
lucasdelimanogueira
ed05e57cf4 squeeze operation and autograd 2024-05-21 14:43:16 -03:00
lucasdelimanogueira
be4eef45ac unittest unsqueeze and unsqueeze neg 2024-05-21 14:32:14 -03:00
lucasdelimanogueira
db434ec197 unsqueeze operation 2024-05-21 14:21:35 -03:00
lucasdelimanogueira
a39bd59a3f softmax operation 2024-05-21 01:22:38 -03:00
lucasdelimanogueira
5e72fe57d3 softmax v1 need fix some erros yet 2024-05-20 20:16:41 -03:00
lucasdelimanogueira
cd57c39ff0 min max broadcasted autograd and small fix on add broadcasted 2024-05-20 18:44:43 -03:00
lucasdelimanogueira
b324b7e1fa broadcasted equal operation 2024-05-20 16:42:45 -03:00
lucasdelimanogueira
098ede5a6b min max autograd 2024-05-20 15:24:55 -03:00
lucasdelimanogueira
cc483417dc max min and equal operations 2024-05-20 12:50:45 -03:00
lucasdelimanogueira
c808a49a30 dataset, dataloader and mnist 2024-05-18 17:59:14 -03:00
lucasdelimanogueira
acb6c17cca fix subtraction broadcasted access memory wrong values 2024-05-18 09:01:42 -03:00
lucasdelimanogueira
13da54ca39 fix add broadcasted access memory wrong values 2024-05-18 08:54:03 -03:00
lucasdelimanogueira
eb49d8cae3 fixed sum axis with keepdim 2024-05-17 20:12:57 -03:00
lucasdelimanogueira
5dd3f3d202 implementing keepdim sum 2024-05-17 19:08:09 -03:00
lucasdelimanogueira
abcd17e679 fix test autograd sub broadcasted 2024-05-17 13:49:32 -03:00
lucasdelimanogueira
de72cd67ba sub broadcasted cuda 2024-05-17 13:15:33 -03:00
lucasdelimanogueira
64fb3f9edb fix sum axis autograd and reversed add broadcasted order 2024-05-17 11:39:26 -03:00
lucasdelimanogueira
156ec9e3e3 add new test matmul cases broadcasted and batched 2024-05-16 20:34:06 -03:00
lucasdelimanogueira
ddf04363d1 sub broadcasted cpu autograd 2024-05-16 17:03:09 -03:00
lucasdelimanogueira
3c8da6a245 sum axis cpu and broadcast forward 2024-05-16 16:35:55 -03:00
lucasdelimanogueira
a57d39c289 update readme 2024-05-11 02:02:55 -03:00
lucasdelimanogueira
a846d3aa3e Small fix for PiPy 2024-05-11 01:45:59 -03:00
lucasdelimanogueira
e6104e43c9 small changes 2024-05-10 20:12:15 -03:00
lucasdelimanogueira
68bee8b457 add example training 2024-05-10 02:01:09 -03:00
lucasdelimanogueira
6b08c10300 Cosine and sine operations with autograd 2024-05-09 22:32:36 -03:00
lucasdelimanogueira
7e3100f796 unit test nn module mse loss and sigmoid 2024-05-07 17:44:59 -03:00
lucasdelimanogueira
01b62a8c71 unit test autograd transpose reshape T 2024-05-07 16:29:32 -03:00
lucasdelimanogueira
c5a776f43d unit test autograd transpose, t and reshape then matmul 2024-05-07 13:39:18 -03:00
lucasdelimanogueira
708fc121d6 unit test autograd 2024-05-07 12:48:06 -03:00
lucasdelimanogueira
2c2569d482 operations unit tests 2024-05-07 11:52:56 -03:00
lucasdelimanogueira
838af9cf4c Fix long time step() detach 2024-05-07 01:19:12 -03:00
lucasdelimanogueira
1ccf9a6c8d some tests test.py 2024-05-07 01:00:08 -03:00
lucasdelimanogueira
ffe10e48c5 Fix grad update step! loss decreasing 2024-05-07 00:10:25 -03:00
lucasdelimanogueira
b034d86ec3 Fix recursion backward increasing a lot 2024-05-06 22:58:37 -03:00