Earlier quoted context omitted.
It is for building agentic capabilities into very small devices like phones, glasses, watches and more. Does that make sense?
[flagged]
You can think of “phone use” for instance, what Siri is supposed to be.
Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
81–90 of 255 posts
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#82Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#83Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#84Earlier quoted context omitted.
[flagged]
You can think of “phone use” for instance, what Siri is supposed to be.
I mean.. Siri basically works? When I'm driving I say "Hey Siri, find me a gas station along my route", and it does. Or I say "Hey Siri, call Joe Bob mobile" and it does. Or I say "Hey Siri, play me a podcast". This is kind of a solved problem already? When I'm driving this is literally as complicated of a distraction as I want--I'm not going to be dictating emails or texts. When I'm not driving, the touchscreen keyboard (as shitty an interface as that is) is 100x better than voiced natural language commands.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#85hey nice work, is it possible to release the datasets?
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#86Earlier quoted context omitted.
Deploying AI on tiny devices like watches, earphones, glasses etc.
Ok, but why? What is the use case?
I don't think the limit is just on tiny devices. It can also be used in apps on generic computers, because its so small anything can run it reasonably quick.
For example, I am thinking this could be helpful for say if you have a complicated build and test infrastructure, fine tune this model on that infrastructure and then people can say more generic things like build and run this library's test, rather than issuing the exact commands to do that or going to Claude, GHCP, etc
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#87Earlier quoted context omitted.
You can think of “phone use” for instance, what Siri is supposed to be.
I mean.. Siri basically works? When I'm driving I say "Hey Siri, find me a gas station along my route", and it does. Or I say "Hey Siri, call Joe Bob mobile" and it does. Or I say "Hey Siri, play me a podcast". This is kind of a solved problem already? When I'm driving this is literally as complicated of a distraction as I want--I'm not going to be dictating emails or texts. When I'm not driving, the touchscreen keyb…
It does just barely work now after they spent billions, and they may still fall back to cloud LLMs for a significant number of things. This is a way that everyone can get that on the actual Apple Watch or local phone for any application they build.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#88Lovely to see the push for tiny models.
I have been building for small (20B or less) models for quite a while. Highly focused/constrained agents, many of them running together in some kind of task orchestration mode to achieve what feels like one "agent".
I build (privacy first) desktop apps this way and I want to get into mobile apps with similar ideas but tiny models.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#89Earlier quoted context omitted.
I mean.. Siri basically works? When I'm driving I say "Hey Siri, find me a gas station along my route", and it does. Or I say "Hey Siri, call Joe Bob mobile" and it does. Or I say "Hey Siri, play me a podcast". This is kind of a solved problem already? When I'm driving this is literally as complicated of a distraction as I want--I'm not going to be dictating emails or texts. When I'm not driving, the touchscreen keyb…
It does just barely work now after they spent billions, and they may still fall back to cloud LLMs for a significant number of things. This is a way that everyone can get that on the actual Apple Watch or local phone for any application they build.
I get that, but I still can't imagine what it might be for. TBH I don't have a smart watch, because I can't think of anything I'd want one for--my mechanical watch keeps time to within a few seconds per month and the lume lasts all night. I don't know what making it "smarter" would do for me, it does an A+ job of being a watch. What are the things that "everyone" can build with this that actually matter? Like, what is the differentiator?
EDIT: To be clear, the monoculture of phone operating systems sucks. If this somehow enables more entrants into that space then I'm all for it. However, I don't see this in particular being the deciding factor... For example, the reason I don't run a 3rd party operating system on my phone isn't because it's lacking Siri or "OK Google" (if these things went away tomorrow I'd barely notice), it's because it would be a pain in the ass to make it be a phone.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#90Lovely to see the push for tiny models. I have been building for small (20B or less) models for quite a while. Highly focused/constrained agents, many of them running together in some kind of task orchestration mode to achieve what feels like one "agent". I build (privacy first) desktop apps this way and I want to get into mobile apps with similar ideas but tiny models.
Give it a go and let us know!