Live data from Hacker News

GPT-4

openai.com

931–940 of 1001 posts

Re: GPT-4

#931

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

"Second Opinion machine" -- that's a good phrase. Before I read your post, the best term I heard was "summary machine". A huge part of "office work" (services) is reading and consuming large amounts of information, then trying to summarise or reason about it. Often, you are trying to find something that doesn't fit the expected pattern. If you are a lawyer, this is absolutely the future of your work. You write a shor…

Pre 2023 “Wayback machine” will be the only content guaranteed to be human. The rest is AI-generated.

Re: GPT-4

#932

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

I'm very excited for the future wave of confidently incorrect people powered by ChatGPT.

Its a difficult job, but it gets me by

Re: GPT-4

#933
post #165

This technology has been a true blessing to me. I have always wished to have a personal PhD in a particular subject whom I could ask endless questions until I grasped the topic. Thanks to recent advancements, I feel like I have my very own personal PhDs in multiple subjects, whom I can bombard with questions all day long. Although I acknowledge that the technology may occasionally produce inaccurate information, the…

You can't do that yet due to factuality issues, but that's the goal... the future of learning will radically change

Im actually interested in becoming a private pilot. ChatGPT pointed me to the proper reading material to get started and I’m going through that, using ChatGPT to clarify various concepts I misunderstand or poorly understand. Its been an amazing supplement to my learning.

I can ask it about the certification process, what certified pilots can and can’t do, various levels of certification, etc.

Re: GPT-4

#934

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

Is ChatGPT going to output a bunch of unproven, small studies from Pubmed? I feel like patients are already doing this when they show up at the office with a stack of research papers. The doctor would trust something like Cochrane colab but a good doctor is already going to be working from that same set of knowledge.

In the case that the doctor isn't familiar with something accepted by science and the medical profession my experience is that they send you to another doctor that works with that particular drug or therapy. I've had this experience even with drugs that are generally accepted as safe.

Re: GPT-4

#935

Greg Brockman just tldr'd the whole thing in his live deeloper demo of GPT-4: ~ "GPT-4. It's not perfect, but neither are you"

This is off topic, but in regards to all the latest open AI news, including the ChatGPT and Whisper API releases. I came across Gladia.io and I see made a comment regarding it

"Why not use Whisper directly? All that seems to be happening is gladia.io is running 120 concurrent calls to openAI using 120 30s chunks of an hour long audio. So yeah, you do get a speedup! Chop audio and stitch transcripts. But OP is vaguely (and briefly) promising a breakthrough of some sorts."

How did you figure out that is what they are doing? Or is this hypothetical?

Re: GPT-4

#936
post #797

From the livestream video, the tax part was incredibly impressive. After ingesting the entire tax code and a specific set of facts for a family and then calculating their taxes for them, it then was able to turn that all into a rhyming poem. Mind blown. Here it is in its entirety: --- In the year of twenty-eighteen, Alice and Bob, a married team, Their income combined reached new heights, As they worked hard day and…

I hope this disrupts Intuit’s sleazy business model propped up by mega donations/lobbying to keep its dominant position on charging for tax preparation. I would love to ingest my tax records into a secure GPT like system running locally that understands every tax code and scenario to maximize my return. How long before this is possible? I love that megacorps can’t pay off OpenAI or try to acquire them to stop their t…

Long time. Wed need a system that reliably understands rules. We don't even have a roadmap for developing that kind of AI. BSing will take you surprisingly far in life -- as demonstrated by many humans before AI -- but it can't do everything.

Re: GPT-4

#937

After watching the demos I'm convinced that the new context length will have the biggest impact. The ability to dump 32k tokens into a prompt (25,000 words) seems like it will drastically expand the reasoning capability and number of use cases. A doctor can put an entire patient's medical history in the prompt, a lawyer an entire case history, etc. As a professional...why not do this? There's a non-zero chance that i…

I must have missed the part when it started doing anything algorithmically. I thought it’s applied statistics, with all the consequences of that. Still a great achievement and super useful tool, but AGI claims really seem exaggerated.

What if our brains are just carefully arranged statistical inference machines?

Re: GPT-4

#938

I just finished reading the 'paper' and I'm astonished that they aren't even publishing the # of parameters or even a vague outline of the architecture changes. It feels like such a slap in the face to all the academic AI researchers that their work is built off over the years, to just say 'yeah we're not telling you how any of this is possible because reasons'. Not even the damned parameter count. Christ.

What would an academic do with the parameter count? It’s just a marketing number

It's not just a marketing number, its a main indicator of model size and memory usage. Some of what is happening now is trying to see how 'large' the LLMs need to be to function at certain level, for instance it was claimed Llama (65B) had GPT-3 (175B) level performance but at 65B parameters that is a lot less memory usage. It's rough high level indicator of the computational requirements to run the model.

Re: GPT-4

#939

I just finished reading the 'paper' and I'm astonished that they aren't even publishing the # of parameters or even a vague outline of the architecture changes. It feels like such a slap in the face to all the academic AI researchers that their work is built off over the years, to just say 'yeah we're not telling you how any of this is possible because reasons'. Not even the damned parameter count. Christ.

[deleted]

Re: GPT-4

#940

Imagine ingesting the contents of the internet as though it's a perfect reflection of humanity, and then building that into a general purpose recommendation system. That's what this is Is the content on the internet what we should be basing our systematic thinking around? No, I think this is the lazy way to do it - by using commoncrawl you've enshrined the biases and values of the people who are commenting and provid…

I think specialized models will be built with high quality curated content and will receive the equivalent of the Good Housekeeping seal of approval. Building a model from 10 years of upvoted Hacker News or Metafilter content looks far different than a model trained on the cesspool of 8chan.

Which just further reinforces the bubbles everyone is in...
Post reply on HN