Built rightsize exactly for this. https://nehmeailabs.com/right-size
Choosing an AI model: one prompt, 11 models, different results
71–80 of 105 posts
Re: Choosing an AI model: one prompt, 11 models, different results
#72Am I wrong or are these evaluations, while interesting, not really meaningful for anyone doing serious development work? I'm asking because I personally only use AI with specific and detailed instructions, building my projects piece-by-piece. I mostly don't look at the low level code and some of it I don't understand as much as I'd like, but I very much give much more technical instructions than a simple, two sentenc…
> Am I wrong or are these evaluations, while interesting, not really meaningful for anyone doing serious development work?
As a non-designer trying to build something solo, I think value's in the higher-tier models being able to brainstorm and infer a variety of design directions, as well as dissect the "this looks off" comments that would frustrate human designers.
Some of the frontend design skills try to bridge the gap, but the better models perform far better as is, and often better without one of those frontend design skills trying to ram their own workflows in.
Re: Choosing an AI model: one prompt, 11 models, different results
#73> Build a one-page site for a neighbourhood coffee shop: opening hours, the address, a short menu and a photo. Nothing on it changes unless I edit it myself. If that's the entire prompt, it's quite depressing how much alike these all look. I appreciate some of the details from the Opus 5 version, but I can't help but strongly feel the AI vibes emanating from that design.
I was thinking the same thing, but I suspect there was something more to it. Check out this sentence from the page.
>Our default skills also include some UI design guidance, mainly to avoid known gotchas (e.g., the now-dreaded purple AI slop) and get the model to reason about the visual identity appropriate for the user’s ask. But beyond that, each model is free to go build what it thinks we’ll want.
Re: Choosing an AI model: one prompt, 11 models, different results
#74[flagged]
Re: Choosing an AI model: one prompt, 11 models, different results
#75[flagged]
Re: Choosing an AI model: one prompt, 11 models, different results
#76> Build a one-page site for a neighbourhood coffee shop: opening hours, the address, a short menu and a photo. Nothing on it changes unless I edit it myself. If that's the entire prompt, it's quite depressing how much alike these all look. I appreciate some of the details from the Opus 5 version, but I can't help but strongly feel the AI vibes emanating from that design.
I think this is exactly what we should expect. LLMs are engineered to produce the most likely output given the training data. When you give it a generic design task, you're going to get a distillation of design cliches and tropes from the past decade.
Re: Choosing an AI model: one prompt, 11 models, different results
#77Am I wrong or are these evaluations, while interesting, not really meaningful for anyone doing serious development work? I'm asking because I personally only use AI with specific and detailed instructions, building my projects piece-by-piece. I mostly don't look at the low level code and some of it I don't understand as much as I'd like, but I very much give much more technical instructions than a simple, two sentenc…
As someone who's done web development for 20+ years, I find the model personalities pretty dang fascinating, especially how they develop (and evolve) design sensibilities. I'm interested to know how the classic AI "purple preference" emerged (organically?) and if the beige wave came out of specific training efforts to combat it? To your point on development work (the code itself), I was talking to some friends on the…
It's impossible to NOT get the beige/orange/cream/paper combo.
You basically have to explicitly say not to use those colors/themes.
Re: Choosing an AI model: one prompt, 11 models, different results
#78That prompt is unrealistic. Shops already have opening hours, prices, locations, etc. If you leave all those up to the model then there's no correct answer and the models will perform better – the less you constrain them the more they can output the median answer. If you constrain them with all those real requirements, they can get things wrong and we can see where they actually fall short.
Re: Choosing an AI model: one prompt, 11 models, different results
#79Earlier quoted context omitted.
> Nobody is saying, "man I would love to go to this coffee shop but I can't find their website". Me, I'm saying that, and I've skipped going to coffee shops and restaurants because they don't have a website, just a fucking Facebook page . I don't use Meta products and can't see their page if I'm not logged into an account I don't have, so I do what the business owner intended: I go fuck myself and get coffee somewher…
But... why do you want to look up a coffee shop online before going there? Honestly have never heard anyone say this in my life before
When I travel I have limited time, and if e.g. the coffee shop doesn't have the hallmarks of good coffee, I will save my time and find one that does
Re: Choosing an AI model: one prompt, 11 models, different results
#80nice to see you still on the netlify train todd!!!! warms the hear to see netlify back on HN