Live data from Hacker News

Enough AI copilots, we need AI HUDs

geoffreylitt.com

261–270 of 290 posts

Re: Enough AI copilots, we need AI HUDs

#261

This whole Copilot vs HUD debate instantly brought to mind a classic Japanese anime from 1991 called Future GPX Cyber Formula ( https://en.wikipedia.org/wiki/Future_GPX_Cyber_Formula ). Yeah, it’s a racing anime set in the then-distant future of 2015, where cars come with full-on intelligent AIs. The main character’s car, Asurada, is basically a "Copilot" in every sense. It was designed by his dad to be more than jus…

[deleted]

Re: Enough AI copilots, we need AI HUDs

#262

Earlier quoted context omitted.

This is I’d say partially because we don’t have a HUD that can handle the bandwidth and pace of data required for rally. Overlaying a visualization of the turns ahead would be much better than a copilot for sure

If we have HUDs that can handle aerial combat, why don't we have HUDs that can handle racing?

[deleted]

Re: Enough AI copilots, we need AI HUDs

#263
post #8

Doesn't it all come down to "what is the ideal interface for humans to deal with digital information"? We're getting more and more information thrown at us each day, and the AIs are adding to that, not reducing it. The ability to summarise dense and specialist information (I'm thinking error logs, but could be anything really) just means more ways for people to access and view that information who previously wouldn't…

Websites were a way to get authoritative information about a company, from that company (or another trusted source like Wikipedia). That trust is powerful, which is why we collectively spent so much time trying to educate users about the "line of death" in browsers, drawing padlock icons, chasing down impersonator sites, mitigating homoglyph attacks, etc. This all rested on the assumption that certain sites were auth…

In some cases like the Air Canada one where the courts made them uphold a deal offered by their chatbot it'll be "accurate" information whether the company wants it to be or not!

Not not everything an LLM tells you is going to be worth going to court over if it's wrong though.

Re: Enough AI copilots, we need AI HUDs

#264

Love the idea & spitballing ways to generalize to coding.. Thought experiment: as you write code, an LLM generates tests for it & the IDE runs those tests as you type, showing which ones are passing & failing, updating in real time. Imagine 10-100 tests that take The tests could appear in a separated panel next to your code, and pass/fail status in the gutter of that panel. As simple as red and green dots for tests t…

> Imagine 10-100 tests that take Doesn’t seem like high ROI to run full suite of tests on each keystroke. Most keystrokes yield an incomplete program, so you want to be smarter about when you run the tests to get a reasonably good trade off.

[deleted]

Re: Enough AI copilots, we need AI HUDs

#265

Earlier quoted context omitted.

This is I’d say partially because we don’t have a HUD that can handle the bandwidth and pace of data required for rally. Overlaying a visualization of the turns ahead would be much better than a copilot for sure

If we have HUDs that can handle aerial combat, why don't we have HUDs that can handle racing?

this is true, so we just lack the incentives to make them? a human copilot is just a core part of the sport?

Re: Enough AI copilots, we need AI HUDs

#266

Earlier quoted context omitted.

import openai, math, os, textwrap, json, sys query = 'Paris is the capital of' # short demo input os.environ['OPENAI_API_KEY'] # check key early client = openai.OpenAI() resp = client.chat.completions.create( model='gpt-3.5-turbo', messages=[{'role': 'user', 'content': query}], max_tokens=12, logprobs=True, top_logprobs=1 ) logprobs = [t.logprob for t in resp.choices[0].logprobs.content] perplexity = math.exp(-sum(lo…

If you want to generate a heatmap of existing text, you will have to take a different approach here. The naive solution I could come up with would be really expensive with openai, but if you have an open source model, you can write up custom inference that goes one-token-at-a-time through the text, and on each token you look up the difference in logprobs between the token that the LLM predicted vs what was actually t…

There's some libraries that might make this easier to implement:

https://github.com/kanishkamisra/minicons

Re: Enough AI copilots, we need AI HUDs

#267
post #8

Doesn't it all come down to "what is the ideal interface for humans to deal with digital information"? We're getting more and more information thrown at us each day, and the AIs are adding to that, not reducing it. The ability to summarise dense and specialist information (I'm thinking error logs, but could be anything really) just means more ways for people to access and view that information who previously wouldn't…

Computers / the web are a fast route to information, but they are also a storehouse of information; a ledger. This is the old "information wants to be free, and also very expensive." I don't want all the info on my PC, or the bank database, to be 'alive', I want it to be frozen in kryptonite, so it's right where I left it when I come back.

I think we're slowly allowing AI access to the interface layer, but not to the information layer, and hopefully we'll figure out how to keep it that way.

Re: Enough AI copilots, we need AI HUDs

#268
post #181

This whole Copilot vs HUD debate instantly brought to mind a classic Japanese anime from 1991 called Future GPX Cyber Formula ( https://en.wikipedia.org/wiki/Future_GPX_Cyber_Formula ). Yeah, it’s a racing anime set in the then-distant future of 2015, where cars come with full-on intelligent AIs. The main character’s car, Asurada, is basically a "Copilot" in every sense. It was designed by his dad to be more than jus…

any release you'd recommend?

669198800283 if you need English subtitles. VPXY-71923 if you’re fine with Japanese.

Re: Enough AI copilots, we need AI HUDs

#269

I'm very curious if a toggle would be useful that would display a heatmap of a source file showing how surprising each token is to the model. Red tokens are more likely to be errors, bad names, or wrong comments.

You know what happens when a measure becomes a target, though.

Re: Enough AI copilots, we need AI HUDs

#270

I'm very curious if a toggle would be useful that would display a heatmap of a source file showing how surprising each token is to the model. Red tokens are more likely to be errors, bad names, or wrong comments.

We explored this exact idea in our recent paper https://arxiv.org/abs/2505.22906 Turns out this kind of UI is not only useful to spot bugs, but also allows users to discover implementation choices and design decisions that are obscured by traditional assistant interfaces. Very exciting research direction!

I've wanted someone to write an extension utilising this idea since GPT-3 came out. Is it available to use anywhere?
Post reply on HN