14 commits

Author	SHA1	Message	Date
Andrej Karpathy	72698a5ba3	update gpt3 125M script to be better. should exactly reproduce gpt-3 125M, except we don't use banded attention and we use fineweb	2024-07-18 16:43:14 +00:00
Andrej Karpathy	528b1b0e31	fix fat fingers	2024-07-15 17:56:41 +00:00
Andrej Karpathy	039904ee9f	revert legacy behavior in .sh scripts for -e option	2024-07-15 17:55:26 +00:00
Erik Schultheis	b5d5ed7f68	updated example scripts	2024-07-12 14:46:09 +02:00
Andrej Karpathy	c6efd90a86	upload good 1558M sh script	2024-07-02 16:49:09 +00:00
Aleksa Gordic	a259eeabe5	Fix CI errors	2024-06-24 16:26:12 +02:00
Aleksa Gordic	3abdf9a3e4	Add gpus per node arg	2024-06-24 16:26:12 +02:00
Aleksa Gordic	bfdea887eb	Add launch scripts - tested	2024-06-24 16:26:12 +02:00
Andrej Karpathy	fd564f7b8a	add the gpt2 1558M repro script too	2024-06-19 02:26:39 +00:00
Andrej Karpathy	42dff87939	clarification we trained with 150B tokens	2024-06-12 15:51:14 +00:00
Andrej Karpathy	963aa6828e	add gpt-2 774M repro script	2024-06-12 15:33:19 +00:00
Andrej Karpathy	0fddf06043	more docs on scripts	2024-05-30 21:06:36 +00:00
Andrej Karpathy	fe36e40f2c	also move pyrun script to scripts/	2024-05-30 20:17:16 +00:00
Andrej Karpathy	a0d5dbbda6	scripts folder	2024-05-30 20:00:07 +00:00