[flagged]
Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
201–210 of 214 posts
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#202Earlier quoted context omitted.
Well running from QSPI flash (even the internal memory versions use SPI internally) so any inference would be very slow streaming from that compared to RAM. The featured article says: “With a peak session RAM around 28MB, Needle runs on newer microcontrollers like ESP32-S3.” So I don’t see this doing anything useful on a Pico. The Pico 2 (RP2350) for example has 520k of RAM.
An ESP32 has the same amount of SRAM as the Pi Pico. You can hook up PSRAM to the Pi Pico just like ESP32 to get 16MB more RAM.
[dead]
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#203Earlier quoted context omitted.
It is a 14MB model. You don’t need servers to run it. Check your napkin well.
I am sorely dissappointed that the state of the internet has become such that my sarcasm was not only possibly but actually missed.
Mine too! I was not serious. I was just answering your napkin joke. But when I reread now, it is not that obvious. I guess with text you can pass only so much of emotions.
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#204Earlier quoted context omitted.
but wouldn't it need to know the current temp for that to work? my understanding was that the model is best at tool calling
In what world would this make any sense at any temperature? > 'warmer' implies need for cooling
"It has gotten warmer" could imply a desire to return to homeostasis.
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#205Earlier quoted context omitted.
In what world would this make any sense at any temperature? > 'warmer' implies need for cooling
"It has gotten warmer" could imply a desire to return to homeostasis.
Now you are just making stuff up. The original query was "Make it a little warmer in here". Just because you can come up with some sort of context where the word warmer could mean that you want it cooler does not mean it fits in this scenario which is exactly what people are using LLMs for - to actually understand that context, if it can't do that it's worthless
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#206[flagged]
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#207[dead]
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#208Earlier quoted context omitted.
So, its not a general language model, focused on tool call strictly for tiny edge-devices. There are solutions everywhere for high-capacity devices, Needle is for sub-$200 devices.
It seems to me that the model struggles to have enough general intelligence, knowledge, or reasoning capacity for arbitrary prompted tool calling. At this size, not surprising. I am VERY interested in seeing how it could perform with some fine-tuning for a specific family of tools/tasks. That would be a great addition to the demo.
[flagged]
Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#209Re: Show HN: Needle2: 14MB agentic LLM for phones, wearables, smart home and robots
#210Earlier quoted context omitted.
I am sorely dissappointed that the state of the internet has become such that my sarcasm was not only possibly but actually missed.
Mine too! I was not serious. I was just answering your napkin joke. But when I reread now, it is not that obvious. I guess with text you can pass only so much of emotions.
Ah no harm, then. I considered /s, but I really thought it should be plain that I'm not crazy enough to believe one would need any more than a single local device to process such a relatively low complexity command.