Live data from Hacker News

GPT-4

openai.com

961–970 of 1001 posts

Re: GPT-4

#961
post #288

Interesting how quickly we are pushing ahead with obsoleting human cognition. It may bring many benefits, but I wonder if at some point this development should not be decided by society at large instead of a single well-funded entity that is in an arms race with its competitors. This endeavor is ultimately about replacing humanity with a more intelligent entity, after all. Might be that more humans should have a say…

Maybe we need a non-profit artificial intelligence research company whos goal is to advance digital intelligence in the way that is most likely to benefit humanity as a whole, unconstrained by a need to generate financial return.

like OpenAI(2016) https://web.archive.org/web/20151222103150/https://openai.co...

Re: GPT-4

#962
post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

I think we are introducing too much context to the question that sums up to "is it capable of reasoning?"

To answer this question one needs to remove unnecessary context.

GPT-4 can’t sum two unusually big integers.

This is as context-free as it gets. Ability to pass this test wouldn’t be conclusive, but the inability seems to be conclusive that it isn't capable of reasoning.

With this fact in mind explaining why it can't solve a logical riddle is pointless.

Re: GPT-4

#963
post #705
post #288

Interesting how quickly we are pushing ahead with obsoleting human cognition. It may bring many benefits, but I wonder if at some point this development should not be decided by society at large instead of a single well-funded entity that is in an arms race with its competitors. This endeavor is ultimately about replacing humanity with a more intelligent entity, after all. Might be that more humans should have a say…

every other day i am reminded about the state of AI and i feel complete despair. why do people not realize exactly what you just said, that this endeavor is ultimately about replacing humanity? what other long-term result could the concept of AI possibly have? its like the biggest mass psychosis that has ever existed. whenever i talk to people about this, they always parrot the same thing almost word for word: people…

Our position becomes like royalty with more capable subjects. The thing is to tell them what to do and try to stay in charge.

Re: GPT-4

#964
post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

This is probably one of the things you can get it to "realize". There's one party which has interactions with both other parties - that party is the one which can't be left alone. Then you get it to spot that party in novel descriptions of the puzzle.

If it was a person it'd have some strange exploitable mental gaps. As a text analysis tool it's amazing even if it has some edge cases where you need to explain to "take your time and analyze the rules of the question before answering."

("Take your time" doesn't mean anything to a timeless being, but it seems to put it in the textual pattern of someone willing to spill more ink before committing to something, and when it discusses and plans out its path it can then generally follow it to the right answer.)

Re: GPT-4

#966

The comments on this thread are proof of the AI effect: People will continually push the goal posts back as progress occurs. “Meh, it’s just a fancy word predictor. It’s not actually useful.” “Boring, it’s just memorizing answers. And it scored in the lowest percentile anyways”. “Sure, it’s in the top percentile now but honestly are those tests that hard? Besides, it can’t do anything with images.” “Ok, it takes imag…

Here is what it thinks of the shifting goal posts https://raw.githubusercontent.com/soheil/fileshare/main/The%...

Re: GPT-4

#967
post #361

Seems like OpenAI is forecasting massive changes to the job market. I highly recommend reading page 18 of the research paper. "GPT-4 or subsequent models may lead to the automation of certain jobs.[81] This could result in workforce displacement.[82] Over time, we expect GPT-4 to impact even jobs that have historically required years of experience and education, such as legal services.[83]"

I work at company that uses AI to automate about ⅓ of the job of trained licensed professionals. Looking at GPT4 those licensed professionals are now completely irrelevant. It's going to take years to build the supporting software around gpt4 to completely eliminate those jobs, but today I am convinced that we are on the verge of massive unemployment. Today thousands of job types have just been made redundant. What s…

I work at company that uses the Newcomen engine to automate about ⅓ of the job of trained artisan laborers. Looking at the Watt engine those artisan laborers are now completely irrelevant. It's going to take years to build the supporting machinery around the Watt engine to completely eliminate those jobs, but today I am convinced that we are on the verge of massive unemployment. Today thousands of job types have just been made redundant.

What scares me is we are unprepared for the kind of change that a perpetual 20% unemployment rate is going to trigger.

Every new technology since the Industrial Revolution kicked off has been claimed to herald the elimination of millions of jobs and the dawn of permanent unemployment--and often they have eliminated millions of jobs, yet the permanent unemployment never comes. People in the past have always struggled to imagine the new jobs that will be created, and maybe we aren't any better at it.

Re: GPT-4

#968
post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

FWIW I just tested this with GPT4 and it seemed to get it correctly. Prompt: I have a duck, some grain, and a fox. I'm at a river crossing and I can only take one of them with me on the boat at a time, leaving them on the other side and coming back to get the next. I can't leave the duck with the grain, or the fox with the dock, because the predator will eat its prey. In which order should I get them all across? GPT4…

[deleted]

Re: GPT-4

#969

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

> edit (addition): What % of people can hold 25,000 words worth of information in their heads, while effectively reasoning with and manipulating it? I'm guessing maybe 10% at most, probably fewer. And they're probably the best in their fields. Now a computer has that ability. And anyone that has $20 for the OpenAI api can access it. This could get wild. It's true that most humans cannot do this, but loading words and…

The comparison between the context length and what humans can hold in their heads just seems faulty.

I'm not sure I can agree that humans cannot hold 25,000 words worth of information in their heads. For the average person, if they read 25,000 words, which can be done in a single sitting, they're not going to remember all of it, for sure, but they would get a lot out of it that they could effectively reason with and manipulate.

Not to mention that humans don't need to hold the entire report in their head because they can hold it in their hand and look at it.

And if anything, I think it's more significant to have a bigger working memory for GPT's own outputs than it is for the inputs. Humans often take time to reflect on issues, and we like to jot down our thoughts, particularly if it involves complex reasoning. Giving something long, careful thought allow us to reason much better.

Re: GPT-4

#970
post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

[deleted]
Post reply on HN