Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

GPT-4

openai.com

Post reply on HN
Print view View original

831–840 of 1001 posts

Re: GPT-4

#831

Post by easterncalculus »

pwpw wrote: post #267
nealabq wrote: post #227

Test taking will change. In the future I could see the student engaging in a conversation with an AI and the AI producing an evaluation. This conversation may be focused on a single subject, or more likely range over many fields and ideas. And may stretch out over months. Eventually teaching and scoring could also be integrated as the AI becomes a life-long tutor. Even in a future where human testing/learning is no l…

I think a shift towards Oxford’s tutorial method [0] would be great overall and compliments your point. “Oxford's core teaching is based around conversations, normally between two or three students and their tutor, who is an expert on that topic. We call these tutorials, and it's your chance to talk in-depth about your subject and to receive individual feedback on your work.” [0] https://www.ox.ac.uk/admissions/under…

What I find interesting is how this will affect perceptions of test fairness. A big argument for standardized testing is that the every student is evaluated the same. Considering how people can jailbreak these AIs, I wonder if the new form of test cheating would be based around that instead with this model.

Re: GPT-4

#833

Post by rhtgrg »

Imnimo wrote: post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

> lesson is that GPT'S reasoning capabilities are always a bit of smoke and mirrors that passes off memorization for logic.

That is the lesson, but people do not want to hear it. See my downvoted comment here [0].

[0] https://news.ycombinator.com/item?id=35038804#35043875

Re: GPT-4

#834

Post by altilunium »

yoyohello13 wrote: post #120
_boffin_ wrote: post #70

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

If you don't know the subject, how can you be sure what it's telling you is true? Do you vet what ChatGPT tells you with other sources? I don't really know Typescript, so I've been using it a lot to supplement my learning, but I find it really hard to accept any of its answers that aren't straight code examples I can test.

> If you don't know the subject, how can you be sure what it's telling you is true?

The same question could be asked when we're learning through books or an expert. There's no guarantee that books or experts are always spitting out the truth.

Re: GPT-4

#835

Post by oska »

maxdoop wrote: post #265

The comments on this thread are proof of the AI effect: People will continually push the goal posts back as progress occurs. “Meh, it’s just a fancy word predictor. It’s not actually useful.” “Boring, it’s just memorizing answers. And it scored in the lowest percentile anyways”. “Sure, it’s in the top percentile now but honestly are those tests that hard? Besides, it can’t do anything with images.” “Ok, it takes imag…

I will continually push back at the concept of 'Artificial Intelligence'. It's a science fiction conceit, a fantasy, and I don't think it is ever possible to achieve (creation of an actual artificial intelligence). And people who do think tat are, imo, fantasists.

That being said, in the field of machine learning there are significant things being achieved. I was wowed by DeepMind's AlphaZero and its achievements in 'teaching itself' and playing Go, at a level never seen before. I'm impressed by what Tesla is doing with self-driving. I'm less impressed by OpenAI's GPT-x because I don't think it's very useful technology (despite all the, imo, foolish talk of it doing away with all sorts of knowledge jobs and being able to 'tutor' ppl) but I do recognise that it also marks a step up in machine learning in the area of LLMs. None of this is 'Artificial Intelligence' however, and it is both silly and dangerous to conceptualise it as such.

Re: GPT-4

#836

Post by mtc010170 »

belter wrote: post #380

Leetcode (hard) from 0/45 (GPT-3.5) to 3/45 (GPT-4). The lack of progress here, says a lot more about is NOT happening as an AI paradigm change. Still a glorified pattern matching and pattern creation engine, even if a very impressive one.

Idk about that. The jump from 0 to 1 may be a whole lot harder than 1 to 45.

Re: GPT-4

#837

Post by roflyear »

Imnimo wrote: post #218

A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…

You can't teach the model things

Re: GPT-4

#838

Post by kfichter »

cwkoss wrote: post #722
AJRF wrote: post #688

That footnote on page 15 is the scariest thing i've read about AI/ML to date. "To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amou…

I want my retirement occupation to be managing a 'nest' of AI agents (several server racks) where the agents engage in commerce and pay me rent in exchange for compute time. Like cyberpunk beekeeping.

I suspect most AI agents will exist on highly decentralized networks

Re: GPT-4

#839

Post by JBiserkov »

DiogenesKynikos wrote: post #801
mk_stjames wrote: post #577

I just finished reading the 'paper' and I'm astonished that they aren't even publishing the # of parameters or even a vague outline of the architecture changes. It feels like such a slap in the face to all the academic AI researchers that their work is built off over the years, to just say 'yeah we're not telling you how any of this is possible because reasons'. Not even the damned parameter count. Christ.

Ironic, given that their name is "OpenAI."

"Take the opposite of your biggest flaw and blast it on repeat 24/7 in your media campaigns."

Here they've managed 2 - it's not open and it's not AI.

Re: GPT-4

#840

Post by imranq »

hooande wrote: post #584

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

There's less and less relevant data with longer documents, so I would expect performance wouldn't change much
Post reply on HN