Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT

github.com

Post reply on HN
Print view View original

101–105 of 105 posts

Re: ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT

#101

Post by pillefitz »

tmalsburg2 wrote: post #59
sigmoid10 wrote: post #42

Earlier quoted context omitted.

A lot of people cite these numbers as cynics or to dissuade others' optimism, but if you actually work in the field and know what it was like just 5 years ago, these numbers should be extremely worrying to everyone who's afraid of automation. Even that linked paper from 2021 is already outdated. We don't need another revolution, we just need maybe a dozen small to medium insights. The steps from GPT3 to 3.5 alone wer…

The training data contains tons of false information and the training objective is simply to reproduce that information. It's not at all surprising that these models fail to distinguish truth from falsehood, and no incremental change will change that. The problem is paradigmatic. And calling people cynics for pointing out the obvious and serious shortcomings of these models is poor form IMO.

I'm sure you can add constraints of some sorts to build internally consistent world models. Or add stochastic outputs as has been done in computer vision to assign e.g. variances to the probabilities and determine when the model is out if its depth (and automatically query external databases to remove the uncertainty / read up on the topic..)

Re: ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT

#102

Post by meghan_rain »

fassssst wrote: post #64
meghan_rain wrote: post #10

What if the paper is longer than what fits in a prompt?

bing.com/new doesn’t have a length restriction, and the Edge sidebar version can do it like this. Disclosure: I work at MSFT but not on Bing

It must have some length restriction though, no? A GPT always has a max context window if I understand correctly. It's likely Bing has access to models with a much larger context window than what is accessibly through the OpenAI API.

Re: ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT

#103

Post by sigmoid10 »

chordalkeyboard wrote: post #100
sigmoid10 wrote: post #99

Earlier quoted context omitted.

This gets repeated by the cynics every time like prayer, but it shows a very poor understanding of the current state of research.

Can you explain or share what research is being done on getting machines to understand the meaning and intent of the data and prompts they are given?

Here is just one recent example: https://arxiv.org/abs/2210.13382

If you actually follow the literature, you'll find that there is tons of evidence that the seemingly "simple" transformer architecture might actually work pretty similar to the way the human brain is believed to work.

Re: ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT

#104

Post by julius »

te_chris wrote: post #34
julius wrote: post #33

Earlier quoted context omitted.

I asked it how to do something with an AWS cli tool. ChatGPT invented a new parameter that looked like a programmer would come up with it and it would do exactly what I was looking for (I assumed many people had my problem before). aws cloudfront update-distribution --id --distribution-config --no-reset-origin-access-identity Took me a while to figure out that the parameter --no-reset-origin-access-identity was not o…

Did you not think to check the docs? (Srs question)

ChatGPT was my first choice just because I want to know if it is any good at helping me with my work.

But for this problem (CF-Distribution lost OAC settings when updating the root file), all the google fu in the world did not help me. It turned out that I had to update my aws-cli and my problem went away. Apparently no one else on the internet had that problem, so only my gut could help me figure it out.

Re: ArxivGPT: Chrome extension that summarizes arxived research papers using ChatGPT

#105

Post by machiaweliczny »

Lockal wrote: post #58
machiaweliczny wrote: post #53

Earlier quoted context omitted.

If you can measure it you can improve it

When a measure becomes a target, it ceases to be a good measure https://en.wikipedia.org/wiki/Goodhart%27s_law

Only in management, not engineering
Post reply on HN