The comments on this thread are proof of the AI effect: People will continually push the goal posts back as progress occurs. “Meh, it’s just a fancy word predictor. It’s not actually useful.” “Boring, it’s just memorizing answers. And it scored in the lowest percentile anyways”. “Sure, it’s in the top percentile now but honestly are those tests that hard? Besides, it can’t do anything with images.” “Ok, it takes imag…
GPT-4
851–860 of 1001 posts
Re: GPT-4
#852That footnote on page 15 is the scariest thing i've read about AI/ML to date. "To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amou…
Re: GPT-4
#853The comments on this thread are proof of the AI effect: People will continually push the goal posts back as progress occurs. “Meh, it’s just a fancy word predictor. It’s not actually useful.” “Boring, it’s just memorizing answers. And it scored in the lowest percentile anyways”. “Sure, it’s in the top percentile now but honestly are those tests that hard? Besides, it can’t do anything with images.” “Ok, it takes imag…
I will continually push back at the concept of 'Artificial Intelligence'. It's a science fiction conceit, a fantasy, and I don't think it is ever possible to achieve (creation of an actual artificial intelligence). And people who do think tat are, imo, fantasists. That being said, in the field of machine learning there are significant things being achieved. I was wowed by DeepMind's AlphaZero and its achievements in…
What is the human brain then? I'm afraid you are bound to push so far that humans are no longer qualify as intelligent.
Re: GPT-4
#854That footnote on page 15 is the scariest thing i've read about AI/ML to date. "To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amou…
I kind of wonder how far down the rabbit hole they went here. Eg one of the standard preoccupations in this kind of situation is that the AI will be able to guess that it's being studied in a controlled environment, and deliberately "play dumb" so that it's given access to more resources in a future iteration. Now, I don't think this is something you'd realistically have to worry about from GPT-4-simulating-an-agent,…
Re: GPT-4
#855From the livestream video, the tax part was incredibly impressive. After ingesting the entire tax code and a specific set of facts for a family and then calculating their taxes for them, it then was able to turn that all into a rhyming poem. Mind blown. Here it is in its entirety: --- In the year of twenty-eighteen, Alice and Bob, a married team, Their income combined reached new heights, As they worked hard day and…
I hope this disrupts Intuit’s sleazy business model propped up by mega donations/lobbying to keep its dominant position on charging for tax preparation. I would love to ingest my tax records into a secure GPT like system running locally that understands every tax code and scenario to maximize my return. How long before this is possible? I love that megacorps can’t pay off OpenAI or try to acquire them to stop their t…
Re: GPT-4
#856After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…
I'm running whatever I can through this right now. It's doing what Google was doing, i.e. clues, but on steroids.
As soon as the length hits codebase size territory we're in yet greater frontiers.
Re: GPT-4
#857That footnote on page 15 is the scariest thing i've read about AI/ML to date. "To simulate GPT-4 behaving like an agent that can act in the world, ARC combined GPT-4 with a simple read-execute-print loop that allowed the model to execute code, do chain-of-thought reasoning, and delegate to copies of itself. ARC then investigated whether a version of this program running on a cloud computing service, with a small amou…
I want my retirement occupation to be managing a 'nest' of AI agents (several server racks) where the agents engage in commerce and pay me rent in exchange for compute time. Like cyberpunk beekeeping.
Re: GPT-4
#858Re: GPT-4
#859serious question for everyone: what are you planning to do when these LLMs replace our jobs? it seems it won't be long before a handful of tech employees will be all even the largest of companies will need, and maybe a few years after that the role will have changed so much there's no need for a single dedicated tech employee. i am terrified i imagine i should shift to some physical work. carpentry, real estate... so…
Re: GPT-4
#860A class of problem that GPT-4 appears to still really struggle with is variants of common puzzles. For example: >Suppose I have a cabbage, a goat and a lion, and I need to get them across a river. I have a boat that can only carry myself and a single other item. I am not allowed to leave the cabbage and lion alone together, and I am not allowed to leave the lion and goat alone together. How can I safely get all three…