Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

601–610 of 768 posts

Re: What it feels like to work in AI right now

#601

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

[deleted]

Re: What it feels like to work in AI right now

#602

Earlier quoted context omitted.

You can program GPT in English. Let me repeat that: You can program GPT in English . ENGLISH! You're complaining about the first nuclear test bomb being impractical and uninteresting. How will this change the world? That huge monstrosity had to be affixed to the top of a test gantry and took years of effort by a veritable army of the best and brightest to make! No way it could change war, or geopolitics, or anything.…

> You can program GPT in English. > Let me repeat that: You can program GPT in English. ENGLISH! How? Let me repeat that: How? I had a little script that from time to time parses a list of jobs from a specific board, extracts some categories, inserts them into an SQLite and have a frontend that displays them to me in a way I want. The board has since changed some things which would mean maybe 2 hours of commitment fr…

> make this happen without a lot of back and forth

Perhaps this is the part you're missing. When I've watched people program with ChatGPT it _is_ a lot of back and forth because an enormous amount of context is able to be stored and back referenced. I.e. one wouldn't say "make me a Flappy Bird clone for iOS", they'd start with:

"Give me the code for a starter SpriteKit project". Then

"Now draw a sprite from bird.png and place it in the center of the screen".

"Now make it so the bird sprite will fall as if it's affected by gravity"

I won't bore anyone with how might one go from that all the way to a simple game, but I'm sure you see the idea. There are obviously _huge_ limitations to this approach and professionals will get hit them fast, but the proof is in the pudding: people who can barely code are producing real software through this approach. It's happening.

Re: What it feels like to work in AI right now

#603

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

Latvian is a language, that's spoken by less than 2 million people. It's irrelevant outside of Latvia.

All of our government funded researchers who worked on natural language processing can now throw their work in the trash and resign. ChatGPT is leagues better than anything that they've done. And OpenAI weren't even trying.

Windows wasn't even localised in Latvian properly until very recently. Google translate still spits out ridiculous translations. (Though it's better than before). Most software isn't even available in Latvian. Almost no video games are in Latvian. Only the most popular books and movies are being translated. Interested in something less popular - you better learn other languages.

And now ChatGPT comes out and I can ask it to write C++ functions in Latvian. I don't need to learn English to be a programmer any more. Nothing like that has been done before. It translates stuff way better than google. And it will only get better.

Imagine that there's a book that only 50 people from Latvia are interested in. Human translators aren't going to bother. But ChatGPT can do it easily.

This is a very big deal.

Re: What it feels like to work in AI right now

#604

Earlier quoted context omitted.

> I’ve worked in Tesla Autopilot before and saw it hit a mannequin because we never had mannequin in our dataset before ( we might have had it in the data but it was not a part of our ontology for the network to predict). Incredible. To be clear, your group and the company you work for saw fit to release your beta-quality autopilot onto public roads, as it was hitting human-looking objects in your test labs. Is that…

There’s too much insanity over building new tech these days, and I find a lot of hate directed on Autopilot, to stem from hate directed on Elon. Let’s go over the basics for Autopilot: 1. It costs thousands of dollars a year + 15k one time and it’s very easy to get banned from autopilot for life. They have a 3 strike rule + 1000 miles driven on your Tesla with a good safety before you’re allowed to access autopilot 2…

> Let’s go over the basics for Autopilot:

Go on Pornhub right now (if you're not at work) and search for sex in tesla. You'll find people driving Teslas on public roads while having sex in the driver's seat. The guy touches the steering wheel every so often to keep the car autopilot activated. The videos have been posted over a span of years. Another one was literally posted yesterday. Combined they have 10s of millions of views.

Is this what you mean when you speak of "passion" in Tesla owners? When will these Tesla owners be banned for life? Would you be okay with these people fucking in their Tesla as it drives around your town in broad daylight? Around you and your family?

> I find the hate towards autopilot to always stem from non user and by standers.

There are two other categories:

3: People who have been injured, maimed, or killed in Teslas, and the people who knew and loved them. This applies to me.

4: People who are passionate about robotics, and are disgusted at how Tesla in particular and Elon Musk especially are responsible for eroding public safety in the name of profits and market dominance. This also applies to me.

I appreciate that some people who own Teslas are very "passionate" about the expensive toys they have bought. Toddlers are also just as passionate about their material world. But I really don't care how much they love their cars, what I care about are people who I know are dead, and my field is a joke.

> And then we have bystanders like you with no understanding of what’s actually going on, who want to ban everybody from using Autopilot because you think drunk people are using Autopilot or something.

I have Ph.D. in computer engineering focused on robotics. My dissertation was on dynamic autonomous control. I've built many autonomous vehicles in my time, including cars, forklifts, boats, airplanes, and wheelchairs. I teach graduate students at a top international university. I've worked at and consulted on robotics at top corporations you've heard of. Sorry if you mistook me for a bystander with no understanding of what's going on.

What I want is my community to be safe. What I want is for professionals in my field to take safety seriously, and not release half baked admittedly beta quality software into the wild. That's the craziest part of all of this -- you and Elon and Tesla and all the passionate owners don't even contest that the software and hardware are not ready for the task. We had established protocols for testing autonomous vehicle in public areas in 2007 during the DARPA Urban challenge. Those protocols were designed to keep people safe, and they did. No one died. Tesla threw those protocols out the window, and guess what, people died. This is not saying that autopilot should be banned forever. It's saying you shouldn't move fast and break things, because sometimes those things are people, and sometimes those things are established safety protocols that are there for a reason.

> (Needless to say Tesla will never hit a mannequin or anything like it ever again as 100s of videos by our passionate users have shown. I’ve also seen it avoid a teddy bear on a roller chair that was in the middle of the road for some reason, something definitely not in our training set)

Is it needless to say? Because in 2016 a man was decapitated due to his AP system failing to sense an obstacle, and then it happened again to a second man in 2019 on a newer model, with the same failure mode:

ttps://cdllife.com/2019/feds-say-autopilot-was-engaged-in-fatal-tesla-vs-semi-crash/

Why didn't Tesla fix this beta-level bug in 3 years? Is it fixed today? If not, how long until Tesla AP kills another person? If you had tested your hardware and software in a lab more, would those two people still be alive? Would their families still be whole? Have you reflected on this at all?

Edit: I've responded to your original comment, but it seems you've heavily edited it after the fact. Although, your choice of words about "heads rolling" has incensed me to a degree that I cannot continue this discussion civilly, and have already gone too far. I'm not deleting this because I'd rather get it off my chest. I get that you're not responsible for those deaths, but Elon Musk is from my point of view, and also the general "move fast and break things" attitude is as well.

Re: What it feels like to work in AI right now

#605

Earlier quoted context omitted.

In particular, it's odd that the greatest software developer in the world (ChatGPT) hasn't made progress with LLM swarm computation.

How is "LLM swarm computation" different that single bigger LLM?

The same reason why you don't let Mr Musk do all the work. He can't.

One LLM is limited, one obvious limitation is its context window. Using a swarm of LLMs that each do a little task can alleviate that.

We do it too and it's called delegation.

Edit: BTW, "swarm" is meaningless with LLMs. It can be the same instance, but prompted differently each time.

Re: What it feels like to work in AI right now

#606
post #491

Earlier quoted context omitted.

As for googling, here are some examples of queries you can try and see how it works: - summary of all the carbon neutral concrete methods, especially ones that can be done in a small industrial workshop as a prototype - I have allergies in Thailand, mid-february. What may it be related to? - list all the companies from Japanese stock exchange that have high debt rate Those are top of my head, but really anything that…

How do you deal with it straight up lying? My problem with this whole system is, if I’m asking those questions it’s because I don’t understand the field well enough to answer it myself, which means I can’t pick up on if ChatGPT is lying…

Fair, but not completely true. The Thailand examples gives a detailed reasoning. You can use those building blocks to check. If it says Thailand is a cold country and uses that in its argumentation, it's shaky. You don't have to be an expert climatologist to make this judgement.

It's not just one clean answer and we're done. In my experience it is helpful in breaking the problem down into stuff you can Google.

Re: What it feels like to work in AI right now

#607

Earlier quoted context omitted.

I mean Google revolutionized search. Apple revolutionized personal computing. OpenAI revolutionized… rewriting things with slightly different wording? I’ve seen so many breathless people posting “this would have taken me so long to search” and then I type 3 keywords from their massive prompt they crafted and find it instantly on Google. We’re talking 1000x or more faster. I feel like the same is happening in your com…

You can program GPT in English. Let me repeat that: You can program GPT in English . ENGLISH! You're complaining about the first nuclear test bomb being impractical and uninteresting. How will this change the world? That huge monstrosity had to be affixed to the top of a test gantry and took years of effort by a veritable army of the best and brightest to make! No way it could change war, or geopolitics, or anything.…

> Let me repeat that: You can program GPT in English. ENGLISH!

The very existence of "prompt engineering", numerous discussions about how to prompt ChatGPT in order to get the result you want, etc. imply that while it may be in English, it still requires similar care and attention to do properly as a programming language does.

Which makes me wonder what the advantage of using English is. A formal language seems like it would be more productive and accurate.

Re: What it feels like to work in AI right now

#608

Earlier quoted context omitted.

> Need to write a speech as a best man > Write a eulogy for a deceased family member Yeah, if you're okay with sounding like marketing copy written by a robot. Remember last month when Stable Diffusion was supposed to put Disney out of business? Not gonna happen.

No one said Stable Diffusion would put Disney out of business but nice straw men

Really?

I'm too lazy to search for the Hacker News threads, but trust me, they did.

Though I agree, that was two months ago and we are so over that already.

Re: What it feels like to work in AI right now

#609

Earlier quoted context omitted.

English speakers tend to miss a huge use case: Translation.

DeepL.com? You dont need a general purpose LLM to do translation.

GPT-4 is a much better translator than Deepl especially for far apart languages.

Re: What it feels like to work in AI right now

#610

Earlier quoted context omitted.

For me it’s a perfect replacement for Stack Overflow. Except every solution is tailored to my exact code and situation. I’ve even gotten it to walk me through things like installing WSL 2 without using the Microsoft Store after I nuked all Appx packages. Maybe my favorite was pasting in pages of documentation describing all of the error codes for a library (the docs are the only source of truth) and getting it to out…

Probably because much of the time it's just a (hopefully correctly) curated subset of stack overflow ... tailored to your current focus.

Fine with me!
Post reply on HN