Commit graph

76 commits

Author SHA1 Message Date
lucasdelimanogueira
70cbd45ae7 fix memory usage 2024-06-05 21:04:09 -03:00
lucasdelimanogueira
e6d58121f1 fix memory usage 2024-06-05 20:24:09 -03:00
lucasdelimanogueira
e670559fe4 fix memory issues del tensors 2024-06-05 15:43:19 -03:00
lucasdelimanogueira
6701179c22 del tensor free memory 2024-06-05 14:31:48 -03:00
lucasdelimanogueira
e706b81007 fix broadcast and reduce gradients distributeddataparallel and tensor hooks 2024-06-03 11:40:05 -03:00
lucasdelimanogueira
b152ae2a1d first commit distributed module 2024-05-23 19:15:30 -03:00
lucasdelimanogueira
27feb8a366 fix autograd was not running on device 2024-05-23 12:07:17 -03:00
lucasdelimanogueira
b1c28c4cea fix send to device 2024-05-23 10:00:48 -03:00
lucasdelimanogueira
d7a932f8ed fix send to device 2024-05-23 09:48:16 -03:00
lucasdelimanogueira
065e913b2d fix send to device 2024-05-23 09:46:35 -03:00
lucasdelimanogueira
718a4c9823 sum axis cuda version 2 2024-05-22 19:55:00 -03:00
lucasdelimanogueira
cebf890165 sigmoid kernel avoid overflow 2024-05-22 13:24:01 -03:00
lucasdelimanogueira
0972a0873f small fix crossentropy 2024-05-22 10:34:16 -03:00
lucasdelimanogueira
ed05e57cf4 squeeze operation and autograd 2024-05-21 14:43:16 -03:00
lucasdelimanogueira
be4eef45ac unittest unsqueeze and unsqueeze neg 2024-05-21 14:32:14 -03:00
lucasdelimanogueira
db434ec197 unsqueeze operation 2024-05-21 14:21:35 -03:00
lucasdelimanogueira
a39bd59a3f softmax operation 2024-05-21 01:22:38 -03:00
lucasdelimanogueira
5e72fe57d3 softmax v1 need fix some erros yet 2024-05-20 20:16:41 -03:00
lucasdelimanogueira
cd57c39ff0 min max broadcasted autograd and small fix on add broadcasted 2024-05-20 18:44:43 -03:00
lucasdelimanogueira
b324b7e1fa broadcasted equal operation 2024-05-20 16:42:45 -03:00
lucasdelimanogueira
098ede5a6b min max autograd 2024-05-20 15:24:55 -03:00
lucasdelimanogueira
cc483417dc max min and equal operations 2024-05-20 12:50:45 -03:00
lucasdelimanogueira
c808a49a30 dataset, dataloader and mnist 2024-05-18 17:59:14 -03:00
lucasdelimanogueira
acb6c17cca fix subtraction broadcasted access memory wrong values 2024-05-18 09:01:42 -03:00
lucasdelimanogueira
1094a9c1cd fix subtraction broadcasted access memory wrong values 2024-05-18 08:54:43 -03:00
lucasdelimanogueira
13da54ca39 fix add broadcasted access memory wrong values 2024-05-18 08:54:03 -03:00
lucasdelimanogueira
5dd3f3d202 implementing keepdim sum 2024-05-17 19:08:09 -03:00
lucasdelimanogueira
64fb3f9edb fix sum axis autograd and reversed add broadcasted order 2024-05-17 11:39:26 -03:00
lucasdelimanogueira
96a9ed57ff fix transpose cuda 2024-05-16 19:11:15 -03:00
lucasdelimanogueira
c11cfd7f22 fix transpose cuda 2024-05-16 19:10:22 -03:00
lucasdelimanogueira
ddf04363d1 sub broadcasted cpu autograd 2024-05-16 17:03:09 -03:00
lucasdelimanogueira
3c8da6a245 sum axis cpu and broadcast forward 2024-05-16 16:35:55 -03:00
lucasdelimanogueira
a846d3aa3e Small fix for PiPy 2024-05-11 01:45:59 -03:00
lucasdelimanogueira
e6104e43c9 small changes 2024-05-10 20:12:15 -03:00
lucasdelimanogueira
68bee8b457 add example training 2024-05-10 02:01:09 -03:00
lucasdelimanogueira
6b08c10300 Cosine and sine operations with autograd 2024-05-09 22:32:36 -03:00
lucasdelimanogueira
7e3100f796 unit test nn module mse loss and sigmoid 2024-05-07 17:44:59 -03:00
lucasdelimanogueira
708fc121d6 unit test autograd 2024-05-07 12:48:06 -03:00
lucasdelimanogueira
2c2569d482 operations unit tests 2024-05-07 11:52:56 -03:00
lucasdelimanogueira
838af9cf4c Fix long time step() detach 2024-05-07 01:19:12 -03:00
lucasdelimanogueira
1ccf9a6c8d some tests test.py 2024-05-07 01:00:08 -03:00
lucasdelimanogueira
ffe10e48c5 Fix grad update step! loss decreasing 2024-05-07 00:10:25 -03:00
lucasdelimanogueira
b034d86ec3 Fix recursion backward increasing a lot 2024-05-06 22:58:37 -03:00
lucasdelimanogueira
1e00930c4e Fix nn.Module linear 2024-05-06 13:23:22 -03:00
lucasdelimanogueira
6445563268 Fix radd rsub 2024-05-06 10:24:43 -03:00
lucasdelimanogueira
065c6a0f29 fix pow, div, log operations 2024-05-06 10:18:12 -03:00
lucasdelimanogueira
ca4a0f0dbc nn module, log, div, pow 2024-05-06 01:21:18 -03:00
lucasdelimanogueira
bd1e62d895 Add transpose autograd 2024-05-04 13:47:20 -03:00
lucasdelimanogueira
a92b991776 Fix transpose axis and make contigous 2024-05-04 13:37:18 -03:00
lucasdelimanogueira
8449575e70 small fix reshape return 2024-05-03 13:18:37 -03:00