ended5월 13일· 1 sources
Needle - Gemini 도구 호출을 증류한 2600만 파라미터 모델
Why it matters
Needle enables practical AI deployment on consumer devices by distilling Gemini into a 26M-parameter model specialized for tool calling, achieving usable performance in just 14MB. This matters because it removes cloud dependency from everyday AI tasks while remaining small enough for phones, watches, and wearables without compromising functionality. The fully open-sourced weights and training methodology democratize custom tool-calling AI, allowing developers to fine-tune models for specific use cases locally.
1
Sources
+0
24h
—
Growth
131d
Active
NeedleTool callingModel distillationEdge AIOpen source