lucasdelimanogueira
|
70cbd45ae7
|
fix memory usage
|
2024-06-05 21:04:09 -03:00 |
|
lucasdelimanogueira
|
e6d58121f1
|
fix memory usage
|
2024-06-05 20:24:09 -03:00 |
|
lucasdelimanogueira
|
e670559fe4
|
fix memory issues del tensors
|
2024-06-05 15:43:19 -03:00 |
|
lucasdelimanogueira
|
6701179c22
|
del tensor free memory
|
2024-06-05 14:31:48 -03:00 |
|
lucasdelimanogueira
|
64f08a8963
|
multigpu training support v0.0.5
|
2024-06-03 15:37:57 -03:00 |
|
lucasdelimanogueira
|
e706b81007
|
fix broadcast and reduce gradients distributeddataparallel and tensor hooks
|
2024-06-03 11:40:05 -03:00 |
|
lucasdelimanogueira
|
4b683a20e9
|
fix distributed ncclCommInitRank
|
2024-05-31 19:40:58 -03:00 |
|
lucasdelimanogueira
|
38a860eba1
|
fix send to other devices and compile on cloud
|
2024-05-29 17:48:37 -03:00 |
|
lucasdelimanogueira
|
a316dfd191
|
add argument src to broadcast distributed
|
2024-05-25 09:38:42 -03:00 |
|
lucasdelimanogueira
|
29ee569d04
|
fix import distributed
|
2024-05-24 19:55:19 -03:00 |
|
lucasdelimanogueira
|
33d4dc14d8
|
fix install nccl setup.py
|
2024-05-24 19:49:25 -03:00 |
|
lucasdelimanogueira
|
ef272b65ee
|
fix install nccl setup.py
|
2024-05-24 19:48:37 -03:00 |
|
lucasdelimanogueira
|
55db13836b
|
broadcast allreduce nccl
|
2024-05-24 18:19:39 -03:00 |
|
lucasdelimanogueira
|
e55c1195ec
|
implemented mpi for distributed run
|
2024-05-24 15:12:53 -03:00 |
|
lucasdelimanogueira
|
fb4f90b0cf
|
small fix 3D transpose
|
2024-05-23 02:35:00 -03:00 |
|
lucasdelimanogueira
|
d2fc1e3617
|
make contiguous cuda
|
2024-05-23 02:27:30 -03:00 |
|
lucasdelimanogueira
|
9708054ecd
|
min cuda and min cuda axis
|
2024-05-23 01:36:04 -03:00 |
|
lucasdelimanogueira
|
5882f1d801
|
max cuda and max cuda axis
|
2024-05-23 01:26:28 -03:00 |
|
lucasdelimanogueira
|
f25a060294
|
fix sum cuda axis with atomicAdd
|
2024-05-23 01:06:21 -03:00 |
|
lucasdelimanogueira
|
192a50f773
|
fix sum cuda axis atomicAdd
|
2024-05-23 00:30:48 -03:00 |
|
lucasdelimanogueira
|
d093015d15
|
fix sum cuda axis
|
2024-05-22 21:07:09 -03:00 |
|
lucasdelimanogueira
|
950cde13f7
|
small fix sum cuda
|
2024-05-22 20:59:25 -03:00 |
|
lucasdelimanogueira
|
718a4c9823
|
sum axis cuda version 2
|
2024-05-22 19:55:00 -03:00 |
|
lucasdelimanogueira
|
f446daf707
|
sum axis cuda version
|
2024-05-22 19:32:47 -03:00 |
|
lucasdelimanogueira
|
65dc86aaa4
|
broadcasted batched matmul cuda
|
2024-05-22 19:20:54 -03:00 |
|
lucasdelimanogueira
|
cebf890165
|
sigmoid kernel avoid overflow
|
2024-05-22 13:24:01 -03:00 |
|
lucasdelimanogueira
|
a39bd59a3f
|
softmax operation
|
2024-05-21 01:22:38 -03:00 |
|
lucasdelimanogueira
|
fd831f950d
|
fix add min max keepdim
|
2024-05-21 00:38:34 -03:00 |
|
lucasdelimanogueira
|
5e72fe57d3
|
softmax v1 need fix some erros yet
|
2024-05-20 20:16:41 -03:00 |
|
lucasdelimanogueira
|
b324b7e1fa
|
broadcasted equal operation
|
2024-05-20 16:42:45 -03:00 |
|
lucasdelimanogueira
|
cc483417dc
|
max min and equal operations
|
2024-05-20 12:50:45 -03:00 |
|
lucasdelimanogueira
|
2df6c36d99
|
fixed sum axis with keepdim
|
2024-05-17 19:29:16 -03:00 |
|
lucasdelimanogueira
|
5dd3f3d202
|
implementing keepdim sum
|
2024-05-17 19:08:09 -03:00 |
|
lucasdelimanogueira
|
de72cd67ba
|
sub broadcasted cuda
|
2024-05-17 13:15:33 -03:00 |
|
lucasdelimanogueira
|
64fb3f9edb
|
fix sum axis autograd and reversed add broadcasted order
|
2024-05-17 11:39:26 -03:00 |
|
lucasdelimanogueira
|
82a854ff11
|
batched matmul cuda
|
2024-05-16 19:33:22 -03:00 |
|
lucasdelimanogueira
|
85d8e74ad1
|
fix cuda add broadcasted
|
2024-05-16 18:06:50 -03:00 |
|
lucasdelimanogueira
|
0d789aa416
|
add broadcasted operation cuda
|
2024-05-16 17:25:16 -03:00 |
|
lucasdelimanogueira
|
ddf04363d1
|
sub broadcasted cpu autograd
|
2024-05-16 17:03:09 -03:00 |
|
lucasdelimanogueira
|
3c8da6a245
|
sum axis cpu and broadcast forward
|
2024-05-16 16:35:55 -03:00 |
|
lucasdelimanogueira
|
a846d3aa3e
|
Small fix for PiPy
|
2024-05-11 01:45:59 -03:00 |
|
lucasdelimanogueira
|
6b08c10300
|
Cosine and sine operations with autograd
|
2024-05-09 22:32:36 -03:00 |
|
lucasdelimanogueira
|
e5819a4121
|
nn module v1
|
2024-05-06 19:47:27 -03:00 |
|
lucasdelimanogueira
|
065c6a0f29
|
fix pow, div, log operations
|
2024-05-06 10:18:12 -03:00 |
|
lucasdelimanogueira
|
ca4a0f0dbc
|
nn module, log, div, pow
|
2024-05-06 01:21:18 -03:00 |
|
lucasdelimanogueira
|
a92b991776
|
Fix transpose axis and make contigous
|
2024-05-04 13:37:18 -03:00 |
|
lucasdelimanogueira
|
18c50dbeb8
|
Small fix shape of reshape
|
2024-05-03 13:34:43 -03:00 |
|
lucasdelimanogueira
|
a45b930075
|
transpose n dimensions cpu
|
2024-05-02 21:14:26 -03:00 |
|
lucasdelimanogueira
|
b7cf03828e
|
batched and broadcasted matmul
|
2024-05-02 20:21:19 -03:00 |
|
lucasdelimanogueira
|
31be051028
|
batched matmul 2D and 3D tensors
|
2024-05-02 19:13:05 -03:00 |
|