Suggestion: publish a live demo of the "needle playground". It's small enough that it should be pretty cheap to run this on a little VPS somewhere!
Should be quick and easy with WebGPU, too.
Good idea. Could you make that.
Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
21–30 of 255 posts
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#22That M versus B is way too subtle. 0.026B is my suggestion
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#23FYI, distilling Gemini is explicitly against the ToS: "You may not use the Services to develop models that compete with the Services (e.g., Gemini API or Google AI Studio). You also may not attempt to reverse engineer, extract or replicate any component of the Services, including the underlying data or models (e.g., parameter weights)."
So is copying all the books in the world.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#24Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#25FYI, distilling Gemini is explicitly against the ToS: "You may not use the Services to develop models that compete with the Services (e.g., Gemini API or Google AI Studio). You also may not attempt to reverse engineer, extract or replicate any component of the Services, including the underlying data or models (e.g., parameter weights)."
This is being downvoted but it's worth noting if only for the "be careful" aspect.
That said, we need more people distilling models IMO, just be ready for a C&D and a ban
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#26This is very cool I'm going to try to carve out some time to try building this into my MOO system ( https://codeberg.org/timbran/moor / https://timbran.org/moor.html ) as alternative command parser front end.
Man, I love that there are still people writing new MOO servers in 2026. Any game out there already running on mooR?
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#27FYI, distilling Gemini is explicitly against the ToS: "You may not use the Services to develop models that compete with the Services (e.g., Gemini API or Google AI Studio). You also may not attempt to reverse engineer, extract or replicate any component of the Services, including the underlying data or models (e.g., parameter weights)."
Yeah I think Google should shove that somewhere. They effectively distilled all the internet's knowledge into these models...without asking & without permission
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#28Sounds interesting.
Got a bunch of errors trying to run it on CPU though. Very likely connected to me running this in a container (unpriv LXC), but figured for 26M CPU would suffice.
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#29That M versus B is way too subtle. 0.026B is my suggestion
Haha, we were trying to not be hand-wavy too much :)
Re: Show HN: Needle: We Distilled Gemini Tool Calling into a 26M Model
#30That M versus B is way too subtle. 0.026B is my suggestion
[deleted]