Live data from Hacker News

Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

news.ycombinator.com

21–30 of 38 posts

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#21
The first time I felt a mixture of awe and fear about AI was after I watched the first Terminator movie, as a teenager in early 90s. Something just clicked for me and I saw the inevitable eventual emergence of AI as the successor race on this planet.

Fast forward to 2012, when I saw this discussed in the news: https://www.wired.com/2012/06/google-x-neural-network/ - that was when I decided to quit my job and enroll in a phd program to do AI research.

Fast forward to 2017, when I was working at one of the first generative AI startups. I remember the moment when I played with image style transfer models and there was a realistic painting showing (among other things) a nicely detailed clock handing on a wall. This painting was recreated as a cartoon, and the clock was shown as as a silly cartoonish clock hanging on the same spot on the wall. It seems trivial now, but at that moment I realized these models are capable of something profound (i.e. they understood a visual concept of a clock).

A couple of years later, GPT-2 came out and I read the story it generated about English speaking unicorns. That was when I realized human level intelligence is probably much simpler to achieve than we thought. That was when my research interests switched to NLP. About a year later (early 2020), I was discussing chatbot progress with someone here on HN. We made a $100 bet where I claimed that an AI model will be able to pass Turing test - properly conducted - by the end of 2022. Properly conducted means a model would successfully pretend to be an adult educated native English speaker, during a 2 hour chat session. Many people back then expressed how ridiculously implausible that seemed. Today I admit I lost the bet and I would pay up if contacted by the guy. However, note that ChatGPT was released in November and had OpenAI optimized it for passing Turing Test, instead of adding all the ethical safeguards, it would have fooled a lot of people. I feel that GPT-4 would have widely succeed, had the passing of TT been its training objective.

Despite all that, despite my knowledge and experience as an ML researcher, I did feel the things you mentioned, the mixture of awe and fear for what's coming, after I watched the OpenAI live stream. Especially after I asked GPT-4 the same questions I asked GPT-3.5 just a couple of weeks ago - the questions I ask job candidates applying to an ML researcher position to test both depth and breadth of their ML knowledge. GPT-4 produced satisfactory answers where GPT-3.5 didn't. That same day I asked it to write code for me - not some toy example but the actual code I needed for work (complicated rounding schemes when quantizing an ML model to a specific number format) - and it did eventually produced correct working code. I've spent roughly an hour on prompt engineering, progressive clarifications/corrections of what I'm trying to do, and verifying the results, but it would have taken me at least 3 hours to write code like that, maybe more.

For me, it's not so much about the current abilities of GPT-4, which are obviously a big deal. It's about what's coming next, in the near future (1-3 years). We (ML researchers) have not reached the plateau with LLMs yet - they will get better. We have just started looking into video generation, which has a huge potential of building very good world models. Video/audio and language modeling abilities will reinforce and amplify each other. Most importantly, models trained to predict the next video frame will be able to act in the physical world. When GPT-5 or GPT-6 is released inside a robot, and can do non-trivial physical actions - that's when things get really interesting. This will happen faster than people expect (again), and I am willing to bet we will see intelligent humanoid robots, capable of performing most forms of human physical labor - by the end of 2025. The only reason I would lose this bet is if humans decide they don't want it to happen (e.g. like the ethical safeguards built into GPT-4).

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#22
AI has definitely reached a significant milestone of development with both this and the generative abilities of the stable diffusion models. While it is moving quite fast, I believe most people have not been following much of the progress which has been made in the past decade in detail (unless this is your field of study or interest). For these people who are just now taking notice, it seems like it has advanced much more rapidly than one would expect and I am sure it might be overwhelming for many.

While I find the recent gains are impressive, I am not overwhelmed by these advancements. GPT is not general intelligence. As I see it is rather a natural language interface to a store of information. There is no guarantee that the information you are retrieving is either correct or entirely related to your query.

Many people take the most exaggerated examples of it's successes, package it with some blurb and offload it to social media for attention. IMO, It's not quite that great, but it is decent enough to have uses. I personally have been using the ChatGPT model to lookup sources of information. If I am unfamiliar with a term or name of an area of study, I can describe in a query and the model is capable of giving me the proper name (in this case predictive markets). It's also pretty good at knowing where some of the information is it has been trained on or about sources such as book names, research papers, and lectures if you ask further on such a subject. In this regard, I consider it to be a watershed moment in search engine tech and I encourage others to utilize it (discriminatively) in this manner as well.

Personally, this is great boon for me since I essentially have been working in a vacuum for the past 6-7 years. I know very few people who share my interests at the same depth and most of those who might are either in purely academic settings, highly specialized research departments, or small unadvertised groups of enthusiasts. Sometimes you need to rely on knowledge and experience of others to steer you in the right direction, and while that is not always available to me at least I can make queries about esoteric subjects without having to track somebody down capable of answering them.

As for family, I always advise caution. Sen. Coons summed my sentiments well in his statement in the Nov 17, 2020 Judiciary hearings on social media: "... it's time for us to take seriously the ways which technology can be a threat, and to measure it not just by the good it does, but the harm it can cause."

You can thank ChatGPT for looking that quote for me from a rather clumsy approximation and rough setting of when it occurred. When queried for links to the video from C-SPAN however, it rather just made up some BS approximations of what the URL might have looked like.

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#23
post #10

I posted in length in another thread... to sum it up, I ended with "It's a big deal." I'm also in my 40s, and I have similar thoughts to yours. My latest thoughts have been about thinking that we need to take a hard look at what software teams are made off nowadays. Redraw software teams from scratch: I think 2-3 devs can make the most complex project happen with AI assistance now. I never understood startups with 10…

I've seen several examples of devs using AI to write or help write complex web sites, with fields and checkboxes and dropdowns, etc. The question is, why bother. Just give the user a chatGPT box where they can ask the AI to do the thing, instead of having to navigate a bunch of web UI. If the AIs can write programs, they can do much much more, eg setup a facebook marketing campaign, configure a bunch of AWS instances…

Who wants to debug a program written by an AI? I mean, can you imagine how inaccurate the annotations might be in such code? While it can be terrific at certain tasks of reproduction it's level of knowledge could still be considered superficial.

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#24
Many people are feeling uncertainty, anxiety and excitement. It seems like especially people closer to the tech as they are seeing how fast this is moving. And it seems to be accelerating.

From Reddit today: https://www.reddit.com/r/singularity/comments/11v41u0/is_any...

There are more threads like that on other subs too.

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#25

Earlier quoted context omitted.

I've seen several examples of devs using AI to write or help write complex web sites, with fields and checkboxes and dropdowns, etc. The question is, why bother. Just give the user a chatGPT box where they can ask the AI to do the thing, instead of having to navigate a bunch of web UI. If the AIs can write programs, they can do much much more, eg setup a facebook marketing campaign, configure a bunch of AWS instances…

Who wants to debug a program written by an AI? I mean, can you imagine how inaccurate the annotations might be in such code? While it can be terrific at certain tasks of reproduction it's level of knowledge could still be considered superficial.

Who wants to debug a program written by an AI?

Another AI, obviously.

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#26

I’m feeling shocked. This is the biggest technological advance in my lifetime, and it’s clear that we will get several-fold advances in the near term, just from obvious improvements(eg llms reading about how to use themselves based on all the experiments humans are doing now). That’s not even including upside surprises which there will doubtless be. LLMs gaining knowledge of the world through next word prediction was…

> Also, I feel…strangely at peace, and less bothered by the things that usually stress me - achievement, health, the economy, whatever. The moments we’re living in and about to live through are going to be so unimaginably great(good and/or bad) those all seem so inconsequential.

Why so optimistic? Not trying to drag you down to my cynical level but I'm not sure I understand what is putting you at peace, the unimaginably great, good and/or bad? It feels something like the very early days on the internet, how we all knew it's going to change everything and probably for the better, but I'm not sure what we have today is what people were imagining back then. We're definitely not living in some kind of tech utopia now compared to where we were 25 years ago.

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#29

Earlier quoted context omitted.

I've seen several examples of devs using AI to write or help write complex web sites, with fields and checkboxes and dropdowns, etc. The question is, why bother. Just give the user a chatGPT box where they can ask the AI to do the thing, instead of having to navigate a bunch of web UI. If the AIs can write programs, they can do much much more, eg setup a facebook marketing campaign, configure a bunch of AWS instances…

Who wants to debug a program written by an AI? I mean, can you imagine how inaccurate the annotations might be in such code? While it can be terrific at certain tasks of reproduction it's level of knowledge could still be considered superficial.

I thought about this, and the answer I think is no one. Because no one wants to debug code...

Re: Ask HN: I'm feeling awe, unsettled and disoriented by GPT-4. How about you?

#30
40yo here. I always been a nerd and early adopter of technology but for the first time I don't want to embrace it and I don't even want to try it. Especially when I see what the web had become. Which lead to some anxiety over my future and put me in some unsolvable "adapt or die" mood as I really don't want to fit in that future being written.
Post reply on HN