LLMs on Consumer Hardware — Part 2: Prefill and the Failure of the AI PC

Part 1 established the hardware, the runner, and the primary model. This entry covers what governs inference on that hardware — the two phases of inference, the cost of long context, and the cost of l...