Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Summarize Any Article as a Dialog Between Two People with Bing Chat

aidemos.info

Post reply on HN
Print view View original

41–50 of 67 posts

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#41

Post by jxy »

IIAOPSW wrote: post #33
akio wrote: post #17

Earlier quoted context omitted.

Now write a dialog between Mary and David discussing the dialog between Alice and Bob. ---- Mary: David, after listening to Alice and Bob's conversation, it seems to me that Alice is empathizing with John's intentions, while Bob is more focused on Jane's feelings. David: I see what you mean, Mary. But don't you think Bob was right to emphasize the importance of understanding Jane's perspective? John's actions had a c…

Well, I have to give credit where its due. It certainly does a lot better on this test than the first time I tried it. I'm curious to see how it does as the prompts of this form get more adversarial and difficult. I can think of a few different ways. 1. The most obvious: keep going deeper. How many layers until it breaks down. 2. The hidden information variant: Can it do a layer where only Sharon has read the previou…

This seems to be a setup of an extremely interesting experiment. We could get a bunch of different language models and actual humans together and prompt them to write under these different scenarios.

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#42

Post by jxy »

It should be emphasized that Bing never processes the link in real time. It really just access some Microsoft database when you give it a link. Sometimes it's frustrating to realize that Bing hallucinated the whole article based on the URL instead of the actual content.

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#43

Post by JPLeRouzic »

MuffinFlavored wrote: post #39
JPLeRouzic wrote: post #35

Earlier quoted context omitted.

I tried on ChatGPT and with this prompt and it worked quite well: " Please, browse https://padiracinnovation.org/News/2023/05/misdiagnosis-in-a... and make a summary in the form of a dialog between two people. Leave an empty row after each dialog. Bolden the important parts of the text. Before the dialog start with 2 or 3 sentence summary. "

Does ChatGPT have access to the internet?

That surprised me also because today I asked it to make a summary of an article and it refused, saying it has no access to internet:

Me: "Dear ChatGPT, please could you summarize this scientific article: https://www.mdpi.com/2227-9059/11/4/1131"

ChatGPT: "I apologize, but as an AI text-based model, I am unable to browse the internet or access specific webpages like the one you provided. However, if you can provide me with the text of the article or a specific section you would like me to summarize, I would be happy to help you with that."

Yet this time it accessed Internet.

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#44

Post by JPLeRouzic »

JPLeRouzic wrote: post #43
MuffinFlavored wrote: post #39

Earlier quoted context omitted.

Does ChatGPT have access to the internet?

That surprised me also because today I asked it to make a summary of an article and it refused, saying it has no access to internet: Me: " Dear ChatGPT, please could you summarize this scientific article: https://www.mdpi.com/2227-9059/11/4/1131 " ChatGPT: " I apologize, but as an AI text-based model, I am unable to browse the internet or access specific webpages like the one you provided. However, if you can provide…

Hum, I regenerated this prompt and this time it told it accessed Internet, but it was hallucinating:

Me: "Dear ChatGPT, please could you summarize this scientific article: https://www.mdpi.com/2227-9059/11/4/1131"

ChatGPT: "Certainly! The article titled "Pregnancy Outcome in Women with COVID-19: A Systematic Review and Meta-Analysis" published in the International Journal of Environmental Research and Public Health aimed to provide a comprehensive analysis of the effects of COVID-19 infection on pregnant women and their outcomes. etc, etc.."

The article is : "RAGE Inhibitors in Neurodegenerative Diseases by V. Prakash Reddy"

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#45

Post by mcbuilder »

jxy wrote: post #42

It should be emphasized that Bing never processes the link in real time. It really just access some Microsoft database when you give it a link. Sometimes it's frustrating to realize that Bing hallucinated the whole article based on the URL instead of the actual content.

It's so easy to fall for it as well, even as someone who has been using LLMs since they came out. Just the other day, I was using ChatGPT on my phone, when I found myself asking whether it was GPT-3.5 or GPT-4. Didn't realize I was being suckered until I reran the prompt. As a human, you'd expect another person to know basic facts about themselves, so it's new kind of "AI Authority Fallacy" which is a result of these models being highly "intelligent" as well as incredible bullshitters.

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#46

Post by sebzim4500 »

mcbuilder wrote: post #45
jxy wrote: post #42

It should be emphasized that Bing never processes the link in real time. It really just access some Microsoft database when you give it a link. Sometimes it's frustrating to realize that Bing hallucinated the whole article based on the URL instead of the actual content.

It's so easy to fall for it as well, even as someone who has been using LLMs since they came out. Just the other day, I was using ChatGPT on my phone, when I found myself asking whether it was GPT-3.5 or GPT-4. Didn't realize I was being suckered until I reran the prompt. As a human, you'd expect another person to know basic facts about themselves, so it's new kind of "AI Authority Fallacy" which is a result of these…

Yeah, it's surprising that OpenAI don't put what model it is in the system prompt. I guess the cost would add up, unless they can reuse the kv cache from the system prompt?

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#48

Post by nomel »

andsoitis wrote: post #30
jjeaff wrote: post #26

Earlier quoted context omitted.

So, I certainly wouldn't ascribe any higher level thinking to these LLMs. But they do seem to have more capability than just regurgitating information. They have some logical thinking skills that I assume are not really emergent, but built into the system. For example, I was working on a configuration file for a somewhat new and esoteric firmware, so there isn't much info online about it. But I asked if a specific pa…

I would be careful to draw that conclusion. Not all information LLMs are trained on is accessible to the wide public (e.g. ChatGPT has training data from closed sources). Regardless, If you share the details of your prompt, I’d be interested to see whether my Google-fu turns up information.

Are you suggesting that LLM can't produce novel output?

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#49

Post by altacc »

jimmySixDOF wrote: post #5

Kind of more interesting in the other direction summarizing conversations into an article sort of like what these folks put together: Show HN: The HN Recap – AI generated daily HN podcast | Hacker News https://news.ycombinator.com/item?id=35831177

Same here. Interviews hide interesting information within a lot of noise and I'd much rather have a concise and information dense summary.

Re: Summarize Any Article as a Dialog Between Two People with Bing Chat

#50

Post by gtirloni »

"I apologize but I am not able to browse websites" is what I get from Bing Chat. Any clues?

EDIT: It seesm that "More Creative" mode has external access. I saw it mentioned here but I don't know how I would have figured this out from the information in the website.

Post reply on HN