Live data from Hacker News

What it feels like to work in AI right now

robotic.substack.com

641–650 of 768 posts

Re: What it feels like to work in AI right now

#641
With chatgpt having the ability to have so much more personality it would be interesting in the future when comments are just overrun by bots with actual human-like comments and reply. Eg. Imagine if someone released a ‘Snark Bot’ that made Snarky Comments and replies. But most likely it’s going to up the game politically to try to sway peoples opinions

Re: What it feels like to work in AI right now

#642

Earlier quoted context omitted.

No idea why you had to tout out that you had a PhD when I was pointing out that you were not a user. Well news flash, I did my PhD in EECS with a focus on Perception and Autonomous Vehicle Applications from a top 4 CS school and so did most people in Autopilot (Most are from Stanford, Berkeley or CMU in Tesla AP), in fact I worked with people who were a part of the 2007 DARPA Urban Challenge who are in Autopilot now…

I've calmed down after your "heads will roll" comment so I promise to be civil. To continue. Yes, you should put back your original comment to reduce confusion. I'm fine reading a long comment. > No idea why you had to tout out that you had a PhD when I was pointing out that you were not a user. You said: And then we have bystanders like you with no understanding of what’s actually going on, who want to ban everybody…

Again I did in fact open pornhub when you point it out and that’s Tesla Autopilot not FSD. I do find it beyond the pale that people drunk use FSD, because there are very strict controls for people using FSD. Autopilot is advanced cruise control, apart from regulatory authorities saying it’s safe compared to competitors, Tesla releases quarterly safety reports since 2019 counting the incidents with Autopilot. It is shown to be safer than humans behind the wheel by quite a margin. Critics will point out, that Tesla AP users are old and most accidents are done by teenagers, AP is used on freeways while accidents are more common in city streets etc but in my view that’s still fine. It shows even the AP users are reasonable responsible. The real risk comes when you have FSD, that takes complete control over your car crash and even worse if it crashes while the user is trying to prevent one. I don’t think the latter is possible, because the software cedes control to the user instantaneously. There is a risk of users being too careless with FSD, which is why people we put quite some effort to getting rid of such users quickly. As I mentioned there are no deaths with FSD, just one case in 2021 being investigated by NHTSA.

Re: What it feels like to work in AI right now

#643
post #564

Earlier quoted context omitted.

It's a hype bubble. There's a small group if die-hards in the tech-adjacent VC community that talk it up to no end and attack anyone who disagrees (I just saw a guy ask you if you were "virtue signaling" with your post - lol. And there's lots of people exploring how it could potentially be commercially useful - just like with blockchain. As everyone points out, it's got more going for it than blockchain did because i…

I've got access to GPT-4 at work. There have been many times that I'll encounter a bug while programming, I'll paste my code to GPT, tell it what my code is currently doing, and tell it what I actually want the code to do. It then explains what I'm doing wrong and what I can do to fix it. I've had success with this over 90% of the time. This saves me a significant amount of time that would have otherwise been spent h…

How simple are your bugs? The bugs I usually have to fix at work involve edge cases around complex user interactions that are less programming bugs and more "well we didn't really think about this particular user interaction when developing this feature" - things that are usually simple 1 liner fixes but can take hours to figure out based on back and forth with product to figure out if it's even a bug and tracing where exactly the data/interaction in the code comes from.

Until I can paste in my entire codebase and the entire history of the product development process into GPT I don't see how it can help.

The bugs that it easily fixes, are generally the bugs whose errors i can copy/paste into google and find an immediate answer on stackoverflow

Re: What it feels like to work in AI right now

#644
post #81
post #70

Earlier quoted context omitted.

why is that? don't like those academic particle researchers get tons of money to build wild experiments to measure waves or collide particles? unless i get the funding part wrong? are those not academic projects?

The issue here is speed. If it takes 10 years to get funding on particle physics, generally it doesn't matter "that much" because that part of the science scene moves pretty slowly. If it takes 10 years to build a billion dollar cluster for AI today, what the hell is the AI world going to look like in 10 years anyway? Building a cluster to study AI ethics might be meaningless because a terminator may be pointing its…

So basic science will have to move to the private sector.

Re: What it feels like to work in AI right now

#645

Earlier quoted context omitted.

You’re asking “what’s so big about GUIs? Literally nobody has asked to move a pointer around a screen”. It’s the use cases these thing enable that are important. Today, I wrote a draft product announcement. Only after I was done did I realize I had written it in a really impersonal third person (“users will be able to”). No big deal, but maybe 10-20 minutes of work to make it energetic and second person (“now you can…

I mean Google revolutionized search. Apple revolutionized personal computing. OpenAI revolutionized… rewriting things with slightly different wording? I’ve seen so many breathless people posting “this would have taken me so long to search” and then I type 3 keywords from their massive prompt they crafted and find it instantly on Google. We’re talking 1000x or more faster. I feel like the same is happening in your com…

You act like writing itself doesn't take time and energy. It has sped up my grant writing 6 fold. Any long-ish form writing that I need to do now happens at warp speed

Re: What it feels like to work in AI right now

#646

From my perspective it’s just _confusing_ to work in AI right now. We have some massive models that are doing some really neat stuff, and apparently hundreds of millions of people are using them—but I keep wondering: to do _what_, exactly? I’m not asking what the models can do, I’m asking what people want the models to do every day, all the time. I’ve been shown some neat pictures people made that they thought were c…

I use ChatGPT at least 10 times a day, as a software developer, and I agree with all your assessments about the use-cases you mention. Here are my ten most recent prompts: * Asking about how back-propagation works with multiple output nodes * Examples of successful ICOs * A deep dive into what it means to calculate the gradient of a function, with me asking lots of clarifying questions * A deep dive into how electric…

I’d be interested to see what it said about differentiating a function (and I’m assuming you mean in the context of programming). I consider that one of the dirtier secrets of gradient-based ML.

Re: What it feels like to work in AI right now

#647
post #178

Earlier quoted context omitted.

For my use case I use it for input processing, it’s just amazing that way. Hallucination is a huge problem, but you can avoid it.

I believe it. For text->text workflows it's a game changer. For anything touching a physical systems, even the highest-level path planning for robotics, there's a long way to go.

It’s all about being very deliberate with your use. People are getting ahead of themselves right now for sure. It’s still a monumental leap in UX!

Re: What it feels like to work in AI right now

#648

Earlier quoted context omitted.

You can program GPT in English. Let me repeat that: You can program GPT in English . ENGLISH! You're complaining about the first nuclear test bomb being impractical and uninteresting. How will this change the world? That huge monstrosity had to be affixed to the top of a test gantry and took years of effort by a veritable army of the best and brightest to make! No way it could change war, or geopolitics, or anything.…

> Let me repeat that: You can program GPT in English. ENGLISH! The very existence of "prompt engineering", numerous discussions about how to prompt ChatGPT in order to get the result you want, etc. imply that while it may be in English, it still requires similar care and attention to do properly as a programming language does. Which makes me wonder what the advantage of using English is. A formal language seems like…

For one, GPT-4 requires far less prompt engineering and generally interprets intent better.

The advantage of using English (natural language that is), the humans around you tend to speak it. I don't naturally speak powershell. Instead I want a script that searches for particular filenames, under a particular size, between a particular date in a directory path I specify. I told GPT I wanted that and in a few seconds it dumped out what I needed. It wrote the script in a formal language, which is then interpreted by the machine in an even more formal manner. Let the code deal with accuracy, and lets let language models argue back and forth with humans on intent.

Re: What it feels like to work in AI right now

#649
post #378
post #207

Earlier quoted context omitted.

Fully functional in what way? As far as I can tell, ChatGPT is a box that I put sentences into, and I get grammatically correct sentences that contains topics or words loosely statistically correlated to what were in my sentences, that may or may not be correct and often are not. The box has little to no memory. I honestly don't see what's so useful about this box.

When hooked up to plugins or tools it does feel like a fully functional interface. With access to a browser, it can do basically whatever I want it to. I hooked GPT-4 up to a shell and asked it to use the GPT-3.5-turbo completions API (not in the dataset), and it successfully did it through trial and error with curl and error messages. This example is of course not something you would actually do regularly, but rathe…

Yes, exactly this is what I meant. You can really leverage the API in other systems. CharGPT on its own is cool, but my mouse comment was about NL being a bolt on UX tool. Which is crazy!

Re: What it feels like to work in AI right now

#650

The annoying thing about AI is that it can do stuff but with like 90% accuracy. This means that if you want to do something that takes 10 AI steps, your accuracy is down to 35%. This is also why Copilot can't really do computer programming.

Context size of 32K tokens probably changes it a little. I think external memory patterns or just simply brute force and GPT-5 will fix that.

First seeing, then believing ;)
Post reply on HN