Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: I made a Raspberry with Qwen my local car AI

github.com

Post reply on HN
Print view View original

11–20 of 79 posts

Re: Show HN: I made a Raspberry with Qwen my local car AI

#14

Post by ehnto »

Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars.

Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit.

I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decades, with dedicated fan databases that would have been scraped.

Questions like "what air filter do I need for my 1994 Suzuki Swift?" are hit and miss.

Re: Show HN: I made a Raspberry with Qwen my local car AI

#15

Post by dofm »

0xbadcafebee wrote: post #4
dofm wrote: post #3

Cool — but is that model really the right choice for the task? I guess it is only 3B active which helps a lot but is Gemma 4 E4B not more practical?

Qwen 4B and 9B should be faster and better reasoning than Gemma 4 E4B. Other good options for that much RAM are Gemma 4 12b and 31b. Gemma 4 E4B would be better for native audio, but OP is using Whisper for STT so prob doesn't matter

The issue is not RAM size. It's memory bandwidth!

The 12B and 31B models will be useless on a Pi 5; maybe the 12B can be persuaded to run, but it may not manage more than one token per second. It only manages 17GB/s memory bandwidth (I have seen a suggestion that the 4GB model manages more).

But yes — some sort of small reasoning-oriented model (Ornith?) seems a better candidate than Qwen 35B.

(Don't get me wrong, I think the 35B model is ace… just seems like at least an unusual choice here)

Re: Show HN: I made a Raspberry with Qwen my local car AI

#17

Post by javier123454321 »

ehnto wrote: post #14

Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars. Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit. I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decad…

This seems to be trained(? or referencing) on the specific cars' owner's manual.
Post reply on HN