Live data from Hacker News

Enough AI copilots, we need AI HUDs

geoffreylitt.com

251–260 of 290 posts

Re: Enough AI copilots, we need AI HUDs

#251

All I have ever wanted in my life is a heads-up display for my eyes that puts floating icons over other people telling me their name, birthday, the names of their kids, and what we talked about the last time we met.

You basically want a cognitive aid device?

Re: Enough AI copilots, we need AI HUDs

#252

This whole Copilot vs HUD debate instantly brought to mind a classic Japanese anime from 1991 called Future GPX Cyber Formula ( https://en.wikipedia.org/wiki/Future_GPX_Cyber_Formula ). Yeah, it’s a racing anime set in the then-distant future of 2015, where cars come with full-on intelligent AIs. The main character’s car, Asurada, is basically a "Copilot" in every sense. It was designed by his dad to be more than jus…

I checked some videos and it looks astonishing. And this is a 34 year old anime?

Re: Enough AI copilots, we need AI HUDs

#253

I'm very curious if a toggle would be useful that would display a heatmap of a source file showing how surprising each token is to the model. Red tokens are more likely to be errors, bad names, or wrong comments.

That's actually something I implemented for a university project a few weeks ago. My professor also did some research into how this can be used for more advanced UIs. I'm sure it's a very common idea.

Re: Enough AI copilots, we need AI HUDs

#255

Earlier quoted context omitted.

Rally co-driver/navigator seems reasonable, given its augmented senses like gps and radar. One part "90 degree right in 200m" and one part "OMG, sheep, dodge left".

This is I’d say partially because we don’t have a HUD that can handle the bandwidth and pace of data required for rally. Overlaying a visualization of the turns ahead would be much better than a copilot for sure

If we have HUDs that can handle aerial combat, why don't we have HUDs that can handle racing?

Re: Enough AI copilots, we need AI HUDs

#256

My aha moment into this direction happened when i got XR glasses and tried embracing voice agents to see where this leads. Did not expect the HUD aspect be so cool of how this setup works. At first i tried using the glasses as a replacement for my main screen and using voice agents as a replacement to the sidebars and chat windows we are used to, which worked ok but then i started using the main screen and main agent…

What glasses are you using?

Re: Enough AI copilots, we need AI HUDs

#257

This whole Copilot vs HUD debate instantly brought to mind a classic Japanese anime from 1991 called Future GPX Cyber Formula ( https://en.wikipedia.org/wiki/Future_GPX_Cyber_Formula ). Yeah, it’s a racing anime set in the then-distant future of 2015, where cars come with full-on intelligent AIs. The main character’s car, Asurada, is basically a "Copilot" in every sense. It was designed by his dad to be more than jus…

The Anime Yukikaze (2002 - 2005) has some similar themes. It's about a fighter jet pilot using a new AI-supported jet to fight against aliens. It asserts that the combination of human intuition and artificial intelligence trumps either of the two on its own. If I remember correctly, the jet can pilot on its own, but when it becomes dangerous, the human pilot only uses the AI hints instead of letting it autopilot.

Yukikaze is a very interesting novel - still have to sit down and read the novels instead of watching the anime, but an important plot element is both the interactions between humans and their AIs (which are not just "human in a computer" as usual) but also a different take on popular views of which way an AI will decide in a conflict :)

Re: Enough AI copilots, we need AI HUDs

#258

This whole Copilot vs HUD debate instantly brought to mind a classic Japanese anime from 1991 called Future GPX Cyber Formula ( https://en.wikipedia.org/wiki/Future_GPX_Cyber_Formula ). Yeah, it’s a racing anime set in the then-distant future of 2015, where cars come with full-on intelligent AIs. The main character’s car, Asurada, is basically a "Copilot" in every sense. It was designed by his dad to be more than jus…

Awesome recommendation, I started watching it, and now I want to finish the season.

Re: Enough AI copilots, we need AI HUDs

#259

[flagged]

It's explicitly against the guidelines to comment like this:

Please don't post insinuations about astroturfing, shilling, brigading, foreign agents, and the like. It degrades discussion and is usually mistaken. If you're worried about abuse, email hn@ycombinator.com and we'll look at the data.

https://news.ycombinator.com/newsguidelines.html

Re: Enough AI copilots, we need AI HUDs

#260

My aha moment into this direction happened when i got XR glasses and tried embracing voice agents to see where this leads. Did not expect the HUD aspect be so cool of how this setup works. At first i tried using the glasses as a replacement for my main screen and using voice agents as a replacement to the sidebars and chat windows we are used to, which worked ok but then i started using the main screen and main agent…

What glasses are you using?

viture pro xr but connected just as external display to my macbook. the experimental hud software is build from scratch for my usecase using web presentation api and a custom svelte framework that does stereoscopic rendering with css matrix transformations.
Post reply on HN