[flagged]
Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
221–230 of 255 posts
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#222A lot of agent workflows really are just tool selection + argument extraction + structured output. How does this behave once workflows become multi-step and state starts accumulating across calls?
[flagged]
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#22326M for tool calling is wild. curious how it handles ambiguous function signatures where the correct tool depends on conversational context rather than just the last message.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#224This seems to be something that could be plugged into an Alexa style device? You had 15 tool categories, what were they and will it work on categories outside of this 15?
Exactly the goal!
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#225This is really cool to see the push for tiny models
Yes, thanks!
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#226Nice catch. Using agent for simple tasks is inefficient and wasteful, Needle really resolves this. Looking forward to future upgrades!
Thanks!
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#227Built a browser version of this runs entirely client-side via onnxruntime-web, no server: https://huggingface.co/spaces/shreyask/needle-playground
Great work, thanks!
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#228Smaller tool calling models are absolutely needed when we are trying to apply agentic workflow to on-device, small systems, where data is private. I currently use small general purpose LLM. But a special finetune is always the way. I'll try this for my use case.
Let us know how it goes!
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#229Great work Henry!
Thanks!
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#230What Google's response will be to this.
I hope they don't get mad, cause we have a great working relationship with the Gemma team particularly. So, If they are uncomfortable, we'd do what they want.