21–30 of 79 posts
Cool — but is that model really the right choice for the task? I guess it is only 3B active which helps a lot but is Gemma 4 E4B not more practical?
Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars. Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit. I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decad…
This seems to be trained(? or referencing) on the specific cars' owner's manual.
I will shamelessly plug https://pitstop.app . I've been working on this for years and I work on/race cars regularly. I wouldn't fully trust LLMs with this :p BUT this project is still really freaking sweet.
Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars. Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit. I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decad…
This seems to be trained(? or referencing) on the specific cars' owner's manual.
Something every LLM user ends up learning is that they're far better used as search and summarization tools than as knowledge databases in themselves.
Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars. Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit. I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decad…
Fair warning, I have found local models and frontier models to be very bad at the specifics when it comes to cars. Small differences like month and year model can impact oil capacity, oil weight and things like that, the details that matter quite a bit. I found frontier models couldn't get things like what engine was in a 1994 Nissan Skyline, one of the more infamous and talked about cars on internet forums for decad…