Shipping a Local LLM API with FastAPI and Ollama

Phase 2 of the de-swarm project — how I turned a 3B text-to-SQL model into a production API for $0. The setup Three weeks ago, I distilled a 120B+ text-to-SQL pipeline into a 3B QLoRA fine-tune of Qwe...