How long until someone combines an LLM with a free standing android? That’s when we’ll see how good/poor LLM safeguards are.
ChatGPT for Robotics
31–40 of 100 posts
Re: ChatGPT for Robotics
#32Any insights into how this is able to generate the Microsoft logo SVG near the end of the article? I feel like this would be a nearly impossible task unless there was another layer of knowledge on top of the language model. I'm leaning toward the example being gamed in some way (e.g. retrying until it happened to work). EDIT: also notable is that the first ChatGPT answer decribes the color as 'orange' but the SVG ans…
By hardcoding tasks, like old assistants. If they don't have proof that it isn't hardcoded then it is almost surely hardcoded. For example Google Duplex, I remember many being very impressed by this: https://www.youtube.com/watch?v=D5VN56jQMWM That entire conversation was just hardcoded with some if-else statements depending on what the other part said. The tech isn't as impressive when you know that, and anyone who…
It doesn't quite manage the google logo https://imgur.com/69t6bfK
Re: ChatGPT for Robotics
#33Chatgpt for drones. “Fly to [address], make sure to take a discrete route with low traffic, take a few pictures on each side of the house. Scan for people near by, make sure people are no closer than 300ft”.
I am sorry I cannot comply with this task as it can be seen as a violation of privacy, and it may also raise safety concerns. It's important to recognize that people have a reasonable expectation of privacy in many situations, and using a drone to take pictures of them without their consent can be seen as an invasion of that privacy.
[deleted]
Re: ChatGPT for Robotics
#34PromptCraft Open Source Tool and AirSim-chatGPT integration
Re: ChatGPT for Robotics
#35Earlier quoted context omitted.
By hardcoding tasks, like old assistants. If they don't have proof that it isn't hardcoded then it is almost surely hardcoded. For example Google Duplex, I remember many being very impressed by this: https://www.youtube.com/watch?v=D5VN56jQMWM That entire conversation was just hardcoded with some if-else statements depending on what the other part said. The tech isn't as impressive when you know that, and anyone who…
The context is pretty different - Duplex was a public demo, this is a research paper with a whole paper behind it. There's no reason to script something if they have a working algorithm...
Looking more closely at the code it generates I'm not sure what the point of putting ChatGPT in that loop is? Rotating until an object is in view isn't a very useful strategy for finding an object, and a non-techical user wouldn't be able to resolve that easily, and a technical user who knew about those basic functions could code the finding strategy he wants based on those examples and instructions.
You would produce a better and easier to use interface faster and with less work by just exposing a few high level utility functions that are better designed than what ChatGPT generates there. Or at least it would be better to let ChatGPT use those high level functions.
If they could make it solve a maze or find something in a more complex environment they would have shown that.
Re: ChatGPT for Robotics
#36The microwave example is very interesting. The prompt only asked to "warm up my lunch" without specifying how. SayCan[1] generated step-wise high level instructions using LLMs for robotic tasks. This takes it a step further by converting high level instructions to low level actions almost entirely autonomously. [1] https://say-can.github.io/
The microwave example reminded me of https://twitter.com/_LucasRizzotto/status/151620562566283673...
Re: ChatGPT for Robotics
#37So ChatGPT can’t do basic maths or can I get it to write functional code most of the time, but we’re going to have it control expensive pieces of hardware ? I don’t get it ?
I wish I did…
Re: ChatGPT for Robotics
#38So ChatGPT can’t do basic maths or can I get it to write functional code most of the time, but we’re going to have it control expensive pieces of hardware ? I don’t get it ? I wish I did…
This is the first year of general purpose language AIs broadly available to the public. The best way to improve it quick is to throw complex things at it.
Re: ChatGPT for Robotics
#39So ChatGPT can’t do basic maths or can I get it to write functional code most of the time, but we’re going to have it control expensive pieces of hardware ? I don’t get it ? I wish I did…
This is the first year of general purpose language AIs broadly available to the public. The best way to improve it quick is to throw complex things at it.
It also says later in the video a roboticist will check the code instead of naively relying on ChatGPTs generated code.
So it’s probably not dissimilar to people trying to code with ChatGPT today.
Re: ChatGPT for Robotics
#40So ChatGPT can’t do basic maths or can I get it to write functional code most of the time, but we’re going to have it control expensive pieces of hardware ? I don’t get it ? I wish I did…
I think "get it to write functional code most of the time" severely discounts the value of the code produced by ChatGPT. Knowing zero Swift (but being an SDE), I was able to build an audio plugin for Logic Pro X in a day, by leveraging ChatGPT. I'd previously tried this twice, and gave up because of the learning curve and my lack of free time. It's the most insane 0% to 80% tool I've ever seen.