new6시간 전· 1 sources
PSSA: A non-transformer language model written from scratch in Rust
Why it matters
PSSA is a small language model that is not a transformer. It reads text one token at a time through a recurrent state-space layer, keeps a bank of episodic memories it can look things up in, and rewri...
1
Sources
+1
24h
—
Growth
1d
Active