Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Ask HN: What are some of the best user experiences with AI?

news.ycombinator.com

Post reply on HN
Print view View original

41–50 of 58 posts

Re: Ask HN: What are some of the best user experiences with AI?

#41

Post by lynx23 »

thejohnconway wrote: post #27
lynx23 wrote: post #4

Well, as a blind user, I'd like to point at the OpenAI Vision integration of BeMyEyes! Being able to get fully detailed scene descriptions including OCR and translation all in one package was pretty much a game changer for me. Not so much kick-ass, but still works nicely: https://github.com/mlang/tracktales -- My MPD track announcer with support for describing album art...

Can I ask if you think this might make alt text on images obsolete? Do you use the alt text where it’s available, or BeMyEyes (I presume you have a choice)?

Those are two different topics. BeMyEyes is a smartphone app which brings your camera and OpenAI vision models together. It is ment to be used to describe/OCR things in your real-world environment.

While alt texts could theoretically be replaced by a browser/screen reader functionality that asks a vision model to describe the image, it is a waste of time and energy to have each and every user do it over and over again.

Re: Ask HN: What are some of the best user experiences with AI?

#42

Post by _bramses »

rupi wrote: post #40
_bramses wrote: post #17

Gonna drop my own link here, because I really think the UX I’m working on is truly novel. Inspired by the commonplace book format, I take highlights from Kindle and embed them in a DB [1]. From there I build (multiple) downstream apps but the central one, Commonplace Bot [2] is a bot that serves as a retrieval and transformer for said highlights. It has changed the way I read books. I now get to link ideas from books…

I love this. I have my commonplace book in Roam Research. Search in Roam is not perfect and I have wondered lately if there was a way to get all of the content into a graph DB and then query using LLMs. But I haven't had time to tinker with it - I am sure open source libraries exist that do exactly this. Can your library take all highlights from Readwise or just Kindle? I use Readwise Reader quite a bit and will love…

You definitely could! Funnily enough, I have a function named "justBooks()" [1] that filters the Readwise export to just book type tags, but you could use the entire export, or whatever upstream method you want. I think much like journaling, every one's use case will be catered to their own tasks/quotes/ideas, but allow me to share centralized advice. You'll definitely need: 1) a database that supports vectors, I use Postgres 2) a low friction way to get your "new" highlights from your reading practice, I use Readwise 3) an llm to "cache" transformations [2]. This transformation does an insane amount of work, and takes it to the next level in terms of utility, I wouldn't skip it.

[1] - https://github.com/bramses/quoordinates/blob/1b9d1fadaded98b... [2] - https://github.com/bramses/quoordinates/blob/1b9d1fadaded98b...

Re: Ask HN: What are some of the best user experiences with AI?

#43

Post by nunez »

codingdave wrote: post #24

When someone pulled right in front of me from a side street a while back while I was driving, the car slammed on the brakes and before I even registered fully what was going on, I found myself stopped safely, but only inches away from having t-boned that guy. That is the level of experience AI needs to get to. Not buttons that basically say: "Use AI!!" but features so fully integrated and smooth that you don't even t…

Oh man; that's a daily experience in Houston!

tbf Tesla's full self driving software does use AI to react to exactly these cut-in scenarios as of v12. (They were hardcoded in previous versions.)

Re: Ask HN: What are some of the best user experiences with AI?

#44

Post by BrandiATMuhkuh »

The best UX at the moment is to do role play with chatGPT's voice interaction. My son (5y) loves to play "holiday". So I tell GPT to pretend to be a hotel receptionist. And he will then have a conversation about rooms, events, costs, etc. with the bot.

Re: Ask HN: What are some of the best user experiences with AI?

#45

Post by aprilthird2021 »

_bramses wrote: post #17

Gonna drop my own link here, because I really think the UX I’m working on is truly novel. Inspired by the commonplace book format, I take highlights from Kindle and embed them in a DB [1]. From there I build (multiple) downstream apps but the central one, Commonplace Bot [2] is a bot that serves as a retrieval and transformer for said highlights. It has changed the way I read books. I now get to link ideas from books…

This is really cool! I could see it being excellent for anyone who writes or gives speeches very often, a great way to quickly access the knowledge one builds up over a lifetime of reading. Love it!

Re: Ask HN: What are some of the best user experiences with AI?

#47

Post by thejohnconway »

lynx23 wrote: post #41
thejohnconway wrote: post #27

Earlier quoted context omitted.

Can I ask if you think this might make alt text on images obsolete? Do you use the alt text where it’s available, or BeMyEyes (I presume you have a choice)?

Those are two different topics. BeMyEyes is a smartphone app which brings your camera and OpenAI vision models together. It is ment to be used to describe/OCR things in your real-world environment. While alt texts could theoretically be replaced by a browser/screen reader functionality that asks a vision model to describe the image, it is a waste of time and energy to have each and every user do it over and over agai…

Ah, sorry, got you. The aspect I think about with alt text is that AI is often better than a mediocre human effort, and it is improving all the time. Improving AI will improve the description of all images, even older ones, and therefore you might want to run the current AI on all images, even if they have existing alt text.

Re: Ask HN: What are some of the best user experiences with AI?

#48

Post by taneq »

davedx wrote: post #31
codingdave wrote: post #24

When someone pulled right in front of me from a side street a while back while I was driving, the car slammed on the brakes and before I even registered fully what was going on, I found myself stopped safely, but only inches away from having t-boned that guy. That is the level of experience AI needs to get to. Not buttons that basically say: "Use AI!!" but features so fully integrated and smooth that you don't even t…

Not necessarily AI at all. Collision avoidance can work purely based on range finding. Self driving that actually does use AI is all over the place

Not in any 2+ dimensional situation. Radar based AEB is awful. Reliable collision avoidance requires robust prediction of future trajectories for everything around you (technically it requires robust lower bounds on minimum time to impact for every object around you, which requires perception of and identification of every object around you plus reasonable predictions based on identification and behaviour history for each object... if you're willing to allow "nah that was BS and not your fault" style collisions like the "stopped for a paper bag sitting on the road" / "hit a stack of bricks in a paper bag" dichotomy then it's a little more forgiving but still much harder than rangefinder + 2nd order equations of motion.)

Re: Ask HN: What are some of the best user experiences with AI?

#49

Post by stavros »

guappa wrote: post #37
codingdave wrote: post #24

When someone pulled right in front of me from a side street a while back while I was driving, the car slammed on the brakes and before I even registered fully what was going on, I found myself stopped safely, but only inches away from having t-boned that guy. That is the level of experience AI needs to get to. Not buttons that basically say: "Use AI!!" but features so fully integrated and smooth that you don't even t…

My car has an alert for collision detection. It always triggers slightly AFTER I stopped or avoided the collision.

Oh, that's not the collision detection alert, that's actually the Aperture Collision Avoidance Congratulatory Chime.

Re: Ask HN: What are some of the best user experiences with AI?

#50

Post by stavros »

guappa wrote: post #38
caesil wrote: post #3

Earlier quoted context omitted.

Chat sucks and will be replaced in almost all cases, I suspect. Speaking is much easier for many tasks, traditional UIs for others. Mediating everything through a keyboard is clunky and slow.

Speaking is tiring. And generally also slower than typing.

I very much doubt that speaking is slower than typing, given that basically only stenographers can transcribe things in real time, and that's by using special technique.
Post reply on HN