I Tried Needle2 for Local Tool Calling. I Ended Up With llama.cpp + Granite

I’ve been working on a small experiment around a semantic shell. The basic idea is that the user types something like: copy report.pdf to backup and a small local model maps that to a known tool: file...