Merge pull request #434 from ngc92/profile-fix

initialize multi_gpu_config so profile doesn't crash
This commit is contained in:
Andrej 2024-05-19 20:57:11 +01:00 committed by GitHub
commit 00c291c679
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -49,6 +49,7 @@ int main(int argc, char *argv[]) {
// override number of layers to 1 because all layers repeat the same kernels, only profile once
model.config.num_layers = 1;
set_zero_configs(&multi_gpu_config, 0, model.num_parameters);
// do a training step
gpt2_forward(&model, x, y, B, T);