Training a 3.8B LLM to 0.384 CORE for $998 – Hugo Vergnes

Training a 3.8B LLM to 0.384 CORE for $998 Somewhere between “nanoGPT toy” and “you need a research lab” there’s a large, under-described region where one person with a few thousand dollars can train ...