aparler/c-llm
1
0
Fork 0
mirror of https://github.com/karpathy/llm.c.git synced 2026-07-27 20:25:09 -04:00
Code Issues Projects Releases Packages Wiki Activity Actions

Merge pull request #821 from ngc92/out-of-bounds-bugfix

Browse source 
fix out-of-bounds access in rmsnorm kernel
This commit is contained in:
Andrej 2025-06-26 10:01:10 -07:00 • committed by GitHub
commit 5c17e4e256
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
llmc/rmsnorm.cuh
View file

@ -90,7 +90,7 @@ __global__ void fused_residual_rmsnorm_forward_kernel5(floatX* residual, floatX*
__syncthreads();
int idx = blockIdx.x * blockDim.y + threadIdx.y;
if(idx > N) return;
if(idx >= N) return;
// adjust pointers to current token
residual += C * idx;