After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…
"Second Opinion machine" -- that's a good phrase. Before I read your post, the best term I heard was "summary machine". A huge part of "office work" (services) is reading and consuming large amounts of information, then trying to summarise or reason about it. Often, you are trying to find something that doesn't fit the expected pattern. If you are a lawyer, this is absolutely the future of your work. You write a shor…
GPT-4
931–940 of 1001 posts
Re: GPT-4
#932This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…
I'm very excited for the future wave of confidently incorrect people powered by ChatGPT.
Re: GPT-4
#933This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…
You can't do that yet due to factuality issues, but that's the goal... the future of learning will radically change
I can ask it about the certification process, what certified pilots can and can’t do, various levels of certification, etc.
Re: GPT-4
#934After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…
In the case that the doctor isn't familiar with something accepted by science and the medical profession my experience is that they send you to another doctor that works with that particular drug or therapy. I've had this experience even with drugs that are generally accepted as safe.
Re: GPT-4
#935Greg Brockman just tldr'd the whole thing in his live deeloper demo of GPT-4: ~ "GPT-4. It's not perfect, but neither are you"
"Why not use Whisper directly? All that seems to be happening is gladia.io is running 120 concurrent calls to openAI using 120 30s chunks of an hour long audio. So yeah, you do get a speedup! Chop audio and stitch transcripts. But OP is vaguely (and briefly) promising a breakthrough of some sorts."
How did you figure out that is what they are doing? Or is this hypothetical?
Re: GPT-4
#936From the livestream video, the tax part was incredibly impressive. After ingesting the entire tax code and a specific set of facts for a family and then calculating their taxes for them, it then was able to turn that all into a rhyming poem. Mind blown. Here it is in its entirety: --- In the year of twenty-eighteen, Alice and Bob, a married team, Their income combined reached new heights, As they worked hard day and…
I hope this disrupts Intuit’s sleazy business model propped up by mega donations/lobbying to keep its dominant position on charging for tax preparation. I would love to ingest my tax records into a secure GPT like system running locally that understands every tax code and scenario to maximize my return. How long before this is possible? I love that megacorps can’t pay off OpenAI or try to acquire them to stop their t…
Re: GPT-4
#937After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…
I must have missed the part when it started doing anything algorithmically. I thought it’s applied statistics, with all the consequences of that. Still a great achievement and super useful tool, but AGI claims really seem exaggerated.
Re: GPT-4
#938I just finished reading the 'paper' and I'm astonished that they aren't even publishing the # of parameters or even a vague outline of the architecture changes. It feels like such a slap in the face to all the academic AI researchers that their work is built off over the years, to just say 'yeah we're not telling you how any of this is possible because reasons'. Not even the damned parameter count. Christ.
What would an academic do with the parameter count? It’s just a marketing number
Re: GPT-4
#939I just finished reading the 'paper' and I'm astonished that they aren't even publishing the # of parameters or even a vague outline of the architecture changes. It feels like such a slap in the face to all the academic AI researchers that their work is built off over the years, to just say 'yeah we're not telling you how any of this is possible because reasons'. Not even the damned parameter count. Christ.
Re: GPT-4
#940Imagine ingesting the contents of the internet as though it's a perfect reflection of humanity, and then building that into a general purpose recommendation system. That's what this is Is the content on the internet what we should be basing our systematic thinking around? No, I think this is the lazy way to do it - by using commoncrawl you've enshrined the biases and values of the people who are commenting and provid…
I think specialized models will be built with high quality curated content and will receive the equivalent of the Good Housekeeping seal of approval. Building a model from 10 years of upvoted Hacker News or Metafilter content looks far different than a model trained on the cesspool of 8chan.