Live data from Hacker News

Karpathy: Let's reproduce GPT-2 (1.6B): one 8XH100 node 24h $672 in llm.c

github.com

61–62 of 62 posts

Re: Karpathy: Let's reproduce GPT-2 (1.6B): one 8XH100 node 24h $672 in llm.c

#61
post #48

Earlier quoted context omitted.

As a gamedev, what would you use currently instead for NPCs? And what would you say makes this/those solutions better than LLMs?

Dialogue systems vary by game and are generally custom. But they amount to hard coded if-else branches if you squint. The only one I ever wrote was a simple announcer for a sports-ish shooter. Your question is weird. Every video game ever made has shipped using not LLMs. Not a single commercial game has ever shipped with an LLM. So I’d say what makes classic NPC systems better is they’ve shipped tens of thousands of…

My question was genuine as I'm not from the gamedev domain and I might have missed the real state of the art.

Hard coded dialogs often feel very unnatural and limiting. I can see why people want to explore LLM to try to make new experiences possible.

I can see it becoming a new dimension of game design, open vs closed dialogs, like there is currently open vs closed world. And as in the open vs closed world, they will probably coexist instead of one type replacing the other.

Re: Karpathy: Let's reproduce GPT-2 (1.6B): one 8XH100 node 24h $672 in llm.c

#62

Earlier quoted context omitted.

I think at first even background NPCs that don't give quests and rewards would be nice. Sort of give everyone a character and let them just babble. It breaks the immersion to hear the same phrases repeatedly. You can still handcraft every important quest and interaction to achieve high fidelity, but I would like random NPCs you bump into to not just repeat things all the time.

You're more likely to see studios (who want lots of more varied content) use generative AI in the studio, where they might generate and review it before release. Letting generators run free on the client sets up different kinds of immersion-breaking, where NPC's hallucinate misleading details about the story/world, can be tricked into reciting off-topic absurdities or age-rating violations, etc. AAA studios can't aff…

Sounds like there's a ton of money to be had to someone that can solve those problems though. A version of fallout where I can go up to people/things and just start talking to them, instead of picking from a list of things to say? :shutupandtakemymoney:
Post reply on HN