Merge pull request #733 from zhangpiu/feature/llm.cpp

Add llm.cpp(a port of this project using Eigen library, supporting CPU/CUDA), link to notable forks in readme
This commit is contained in:
Andrej 2024-08-27 04:37:33 +09:00 committed by GitHub
commit a2bdae248a
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -213,6 +213,9 @@ Lastly, I will be a lot more sensitive to complexity in the root folder of the p
- [llm.cpp](https://github.com/gevtushenko/llm.c) by @[gevtushenko](https://github.com/gevtushenko): a port of this project using the [CUDA C++ Core Libraries](https://github.com/NVIDIA/cccl)
- A presentation this fork was covered in [this lecture](https://www.youtube.com/watch?v=WiB_3Csfj_Q) in the [CUDA MODE Discord Server](https://discord.gg/cudamode)
- C++/CUDA
- [llm.cpp](https://github.com/zhangpiu/llm.cpp/tree/master/llmcpp) by @[zhangpiu](https://github.com/zhangpiu): a port of this project using the [Eigen](https://gitlab.com/libeigen/eigen), supporting CPU/CUDA.
- WebGPU C++
- [gpu.cpp](https://github.com/AnswerDotAI/gpu.cpp) by @[austinvhuang](https://github.com/austinvhuang): a library for portable GPU compute in C++ using native WebGPU. Aims to be a general-purpose library, but also porting llm.c kernels to WGSL.