4 commits

Author	SHA1	Message	Date
Andrej Karpathy	8d55c4a6ac	fix a bug, we have to be careful to make sure we evaluate loss at the token just before the first completion token, because that is the prediction for the first token, and its accuracy	2024-05-19 15:45:28 +00:00
Andrej Karpathy	4e14b52285	report both acc and acc_norm	2024-05-19 15:18:04 +00:00
Andrej Karpathy	7bd2389c1f	add mmlu as well and refine both a bit	2024-05-19 14:23:51 +00:00
Andrej Karpathy	aec9ce5d0a	move hellaswag file to dev	2024-05-19 12:18:02 +00:00

Renamed from hellaswag.py (Browse further)