Andrej Karpathy: Software in the era of AI [video]

Post by alightsoul » Thu, Jun 19, 2025, 10:25 PM UTC

sponnath wrote: post #539

alightsoul wrote: post #471

It's interesting to see people here and on Blind are more wary? of AI than people in say, Reddit or Youtube comments

Reddit and YouTube are such huge social media platforms that it really depends on which bubble (read: subreddits/yt channels) you're looking at. There's the "AGI is here" people over at r/singularity and then the "AI is useless" people at r/programming. I'm simplifying arguments from both sides here but you get my point.

Post by [deleted] » Thu, Jun 19, 2025, 10:30 PM UTC

Post by sockboy » Thu, Jun 19, 2025, 10:36 PM UTC

mkw5053 wrote: post #589

This DevOps friction is exactly why I'm building an open-source "Firebase for LLMs." The moment you want to add AI to an app, you're forced to build a backend just to securely proxy API calls—you can't expose LLM API keys client-side. So developers who could previously build entire apps backend-free suddenly need servers, key management, rate limiting, logging, deployment... all just to make a single OpenAI call. Any…

Post by consumer451 » Thu, Jun 19, 2025, 10:46 PM UTC

diggan wrote: post #378

chamomeal wrote: post #336

Earlier quoted context omitted.

I say this all the time! Does anybody really want to be an assembly line QA reviewer for an automated code factory? Sounds like shit. Also I can’t really imagine that in the first place. At my current job, each task is like 95% understanding all the little bits, and then 5% writing the code. If you’re reviewing PRs from a bot all day, you’ll still need to understand all the bits before you accept it. So how much time…

> Does anybody really want to be an assembly line QA reviewer for an automated code factory? Sounds like shit. On the other hand, does anyone really wanna be a code-monkey implementing CRUD applications over and over by following product specifications by "product managers" that barely seem to understand the product they're "managing"? See, we can make bad faith arguments both ways, but what's the point?

Post by solaire_oa » Thu, Jun 19, 2025, 10:57 PM UTC

hellovai wrote: post #599

solaire_oa wrote: post #411

Earlier quoted context omitted.

I also think that structured outputs are criminally underused, but it isn't perfect... and per your example, it might not even be good, because I've done something similar. I was trying to make a decent cocktail recipe database, and scraped the text of cocktails from about 1400 webpages. Note that this was just the text of the cocktail recipe, and cocktail recipes are comparatively small. I sent the text to an LLM fo…

have you tried schema-aligned parsing yet? the idea is that instead of using JSON.parse, we create a custom Type.parse for each type you define. so if you want a: class Job { company: string[] } And the LLM happens to output: { "company": "Amazon" } We can upcast "Amazon" -> ["Amazon"] since you indicated that in your schema. https://www.boundaryml.com/blog/schema-aligned-parsing and since its only post processing, t…