Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

flawless.is

Post reply on HN
Print view View original

1–10 of 17 posts

Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#1

Post by liorgrossman »

Last week, I got seriously fascinated by the new GPT-4 Vision API introduced on OpenAI DevDay, so I decided to build a UX Audit tool with this API.

It's pretty simple to use - just go to https://flawless.is and enter your homepage or landing page URL.

I'm using the urlbox API to get a screenshot of your page, then I utilize GPT-4V to analyze the screenshot, find potential usability and conversion issues, suggest fixes, and highlight the relevant areas in the screenshot (although the position is sometimes inaccurate).

Last week, I launched it on Hacker News (https://news.ycombinator.com/item?id=38207892), but I wasn't ready for the 20,000 visitors that came next... Unfortunately, GPT-4V has a rate limit of 100 events daily, so almost no one could use the service - EPIC FAIL.

To manage demand, I now priced the service at $1.99 (still less than a cup of coffee), which should keep the demand at bay, and also cover the costs of GPT-4V, the screenshot API, and hosting.

As a proof of concept, there are some demo audits on the homepage you can click and check out.

Please let me know your thoughts and suggestions on how to improve it!

Show HN: GPT-4-Vision UX audit for your landing page (relaunch)
flawless.is

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#2

Post by imranhou »

The feedback for Slack is a hit and miss, for example it considers the signup buttons too small, or customer logos too small - is there an issue with its perception or mine? Additionally down below it says button color matches background which isn't true, but other sister buttons may be, which is misleading. At the end of this, I think some parts are useful, but not sure by how much when I have to sift through and ignore the other parts....

Is it possible to adjust the prompts to address some of this? or have a second to run validate the output?

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#4

Post by liorgrossman »

Broiling3167 wrote: post #3

It is not clear what aspect of the payment is "one time", please clarify this! Is it per-domain or per-email? Rerunning the same domain takes me to checkout again, and I didn't receive an email so I'm lost.

Thanks for giving it a try.

One time meaning you are charged $1.99 one time, and you can audit one URL, the one you've chosen on the main page.

After you pay, it takes you to a unique URL with a token. Might be a good idea to send users email with this URL...

There's no concept of logging in or logging out right now, that's why that URL is important. It looks something like this: https://flawless.is/audit?url=https%3A%2F%2Fslack.com%2F&t=1...

If you can't find this URL in your browser history, please ping me at lior at lifehacklabs.org, and I'll restore this URL and send it to you!

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#5

Post by liorgrossman »

imranhou wrote: post #2

The feedback for Slack is a hit and miss, for example it considers the signup buttons too small, or customer logos too small - is there an issue with its perception or mine? Additionally down below it says button color matches background which isn't true, but other sister buttons may be, which is misleading. At the end of this, I think some parts are useful, but not sure by how much when I have to sift through and ig…

All great points, thank you!

I think GPT-4V perception of size might be distorted, since it downsizes everything to be 512px wide before scanning it. I wonder how can this be overcome, I'll try to play with the prompts to instruct it specifically about sizes.

Regarding the "Meet Slack for Enterprise" - you're right, it is weird, looks like it's hallucinating. I'll try and dig deeper.

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#6

Post by Broiling3167 »

liorgrossman wrote: post #4
Broiling3167 wrote: post #3

It is not clear what aspect of the payment is "one time", please clarify this! Is it per-domain or per-email? Rerunning the same domain takes me to checkout again, and I didn't receive an email so I'm lost.

Thanks for giving it a try. One time meaning you are charged $1.99 one time, and you can audit one URL, the one you've chosen on the main page. After you pay, it takes you to a unique URL with a token. Might be a good idea to send users email with this URL... There's no concept of logging in or logging out right now, that's why that URL is important. It looks something like this: https://flawless.is/audit?url=https%3…

Thank you, I did find that url now.

I’m still confused though, let’s say I “fix” all the problems it gave me, and afterwards if I want to run it again with those fixes, I will need to pay again?

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#8

Post by liorgrossman »

Broiling3167 wrote: post #6
liorgrossman wrote: post #4

Earlier quoted context omitted.

Thanks for giving it a try. One time meaning you are charged $1.99 one time, and you can audit one URL, the one you've chosen on the main page. After you pay, it takes you to a unique URL with a token. Might be a good idea to send users email with this URL... There's no concept of logging in or logging out right now, that's why that URL is important. It looks something like this: https://flawless.is/audit?url=https%3…

Thank you, I did find that url now. I’m still confused though, let’s say I “fix” all the problems it gave me, and afterwards if I want to run it again with those fixes, I will need to pay again?

That's great to hear.

I think now I better understand your original question.

Yeah, to run an audit again on that same site, you'd need to pay again.

Otherwise, I'll have to put in place user management & user rate limits to avoid abuse, since someone could run this 50 times on their website within a given day, and currently OpenAI limits us to 100 queries per day.

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#9

Post by liorgrossman »

artur_makly wrote: post #7

Any Senior UX folks here that can review the quality recommendations shown on the audit results posted on this site? A quick glance shows some dubious suggestions. Still better than no UX audit.

Yeah, happy to get it roasted by real (human) UX folks for some sanity check.

Re: Show HN: GPT-4-Vision UX audit for your landing page (relaunch)

#10

Post by Broiling3167 »

liorgrossman wrote: post #8
Broiling3167 wrote: post #6

Earlier quoted context omitted.

Thank you, I did find that url now. I’m still confused though, let’s say I “fix” all the problems it gave me, and afterwards if I want to run it again with those fixes, I will need to pay again?

That's great to hear. I think now I better understand your original question. Yeah, to run an audit again on that same site, you'd need to pay again. Otherwise, I'll have to put in place user management & user rate limits to avoid abuse, since someone could run this 50 times on their website within a given day, and currently OpenAI limits us to 100 queries per day.

I understand clearly now, thank you very much for your detailed responses and an inspiring tool you shared with us!

As a solo full-stack web dev from Turkey, I will be closely following this tool's future, and looking forward to your continued development of it.

For an audience like me (solo developers) this is potentially incredibly useful, and at worst a nice heuristic apparatus that’s worth paying, so thank you again for making my job easier and aiding me deliver more quality product!

Post reply on HN