Live data from Hacker News

Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

genmon.github.io

11–20 of 177 posts

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#11
post #3

Wait. Is temperature=0 "pretty deterministic", or is it deterministic?

On a related note, has anyone noticed the growing use of "pretty" as a hedge against ever being wrong? Also, "not", as in "not the fastest" or "not the hottest".

It could be 46C/115F outside and you say "wow, today is unbearably hot", to which someone retorts "nah, it's fine. It's not the hottest day". That's pretty good hedging. You can make infinite technically correct statements this way without ever saying anything meaningful

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#12
post #3

Wait. Is temperature=0 "pretty deterministic", or is it deterministic?

Temperature=0 is not perfectly deterministic for the OpenAI API.

It's mentioned briefly in the OpenAI text completion guide: https://platform.openai.com/docs/guides/completion/introduct...

If you have two possible tokens with probability 40% and 30%, you'll always get the 40% token at T=0. But if you have two possible tokens at 40% and 39.99%, you may get the 39.99% token on occasion, even if at T=0. (Numbers illustrative.)

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#13
post #8

The BBC offers pretty exhaustive RSS feeds ( https://podcasts.files.bbci.co.uk/b006qykl.rss ) so I'm not exactly sure what ChatGPT even did here (Maybe the Dewey classification? Which is of dubious usefulness).

There's more on the About page but in summary: extracts the synopsis, guests (name, affiliation), and reading list (title, author, publisher, year) as structured data. Not massively hard with a bit of web scraping, but tedious and results in brittle code -- this took 20 minutes to write the prompt plus 3 cents per episode.

https://genmon.github.io/braggoscope/about

(GPT-3 not ChatGPT for the model.)

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#15

I love In Our Time, a real BBC gem. I've been meaning to pull all the audio for a while and this has inspired me. A fun thing to do would be to pass through Whisper, a great corpus to play with.

I've been considering this, but my assumption is that it would be tripped up by the specialist words.

I wonder... is there a way to "prime" Whisper (e.g. with the embedding of the episode synopsis) so that it "listens out" for words related to a particular topic? I haven't looking but this would be neat!

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#18
post #11
post #3

Wait. Is temperature=0 "pretty deterministic", or is it deterministic?

On a related note, has anyone noticed the growing use of "pretty" as a hedge against ever being wrong? Also, "not", as in "not the fastest" or "not the hottest". It could be 46C/115F outside and you say "wow, today is unbearably hot", to which someone retorts "nah, it's fine. It's not the hottest day". That's pretty good hedging. You can make infinite technically correct statements this way without ever saying anythi…

> Also, "not", as in "not the fastest" or "not the hottest".

Mid twenties Hiberno-English speaker here and that's always been a fairly common form of hedging, and I've not noticed an increase.

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#19

I see several very dubious classifications. Shouldn’t the great stink be under civil engineering rather than agriculture, and why is Plato’s Atlantis under computer science?

Now that's an interesting regression! I don't remember seeing it there before.

(The worst I've noticed before has been Lawrence of Arabia under History of the Ancient World. Very much 20th century really.)

Several other classifications are arguable -- which I think shows one of the limitations of this technique: it's not possible to iterate + improve.

So instead I've been wondering about using the embeddings of each episode synopsis, and comparing to the embeddings of Dewey subdivisions. I should be able to tune the results better that way.

There's also a technique from Google called CAVs (Concept Activation Vectors) that I'm intrigued about trying -- would love to hear if anybody has experience using this

https://arxiv.org/abs/1711.11279

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#20

I see several very dubious classifications. Shouldn’t the great stink be under civil engineering rather than agriculture, and why is Plato’s Atlantis under computer science?

There's also an episode about aliens under 000.
Post reply on HN