OpenArch – PyTorch implementations of modern LLM architectures

Python implementations of modern open-source LLM architectures — written from scratch, one model at a time. This repository contains hand-written PyTorch implementations of the model architectures cat...