Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

genmon.github.io

Post reply on HN
Print view View original

21–30 of 177 posts

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#21

Post by lerchmo »

valgaze wrote: post #2

This is a really interesting use-case Applying "transformations" or classifying data in this way without having to setup a lot of detail-work seems like a real labor-saver/multiplier

My company has gone years wanting our product catalog to have structured data around our products but not going through the tedium of extracting it all. about an hour of prompt tweaking and it can pull, normalize, summarize and output valid json from all of our products. Basically pulling it out of a big unstructured html blob.

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#22

Post by genmon »

Some unlinked features...

If you put the Dewey division in the URL, the directory auto-opens. e.g. here are episodes about prehistoric life (my current jumping-off point)

https://genmon.github.io/braggoscope/directory#560

There's a visual map of episodes. After principal component analysis of the episode embedding vectors, these are the most significant two components as the x,y

https://genmon.github.io/braggoscope/map.html

(it's not super useful tbh -- e.g. the Manhattan Project and the Cambrian Explosion have the same x,y... presumably because they are both about explosions?)

Many episodes have a reading list, and these are all linked to Google Books (so you can purchase/check out from a library), e.g. this episode page

https://genmon.github.io/braggoscope/2022/10/20/the-fishtetr...

There are ~4,600 books, and I have ~88% coverage on getting a Google Books page from the original data. Any ideas about what to do with this big list of academic-recommended books v welcome!

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#23

Post by lerchmo »

genmon wrote: post #10
PaulHoule wrote: post #4

What's the prompt?

One of the prompts is Extract the description and a list of guests from the supplied episode notes from a podcast. Also provide a Dewey Decimal Classification code and label for the description Return valid JSON conforming to the following Typescript type definition: { "description": string, "guests": {"name": string, "affiliation": string | null}[] "dewey_decimal": {"code": string, "label": string}, } Episode synops…

I like the typescript definition, rather than example json that I normally use.

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#24

Post by taberiand »

genmon wrote: post #15
specproc wrote: post #14

I love In Our Time, a real BBC gem. I've been meaning to pull all the audio for a while and this has inspired me. A fun thing to do would be to pass through Whisper, a great corpus to play with.

I've been considering this, but my assumption is that it would be tripped up by the specialist words. I wonder... is there a way to "prime" Whisper (e.g. with the embedding of the episode synopsis) so that it "listens out" for words related to a particular topic? I haven't looking but this would be neat!

I haven't tried, but the Open AI docs mention priming on the whisper model being available

    prompt
    string
    Optional

    An optional text to guide the model's style or continue a previous audio segment. The prompt should match the audio language.

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#26

Post by gwillen »

LeoPanthera wrote: post #5
haolez wrote: post #3

Wait. Is temperature=0 "pretty deterministic", or is it deterministic?

It’s my understanding that 0 is completely deterministic, except for when the model is updated, which does happen occasionally.

Their docs say (somewhat recently updated, I think) that even 0 is not perfectly deterministic in all cases (though it's very close). Some people had previously observed this and speculated that it was some kind of floating point roundoff issue, when two outputs have almost identical scores.

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#27

Post by sorokod »

dvt wrote: post #8

The BBC offers pretty exhaustive RSS feeds ( https://podcasts.files.bbci.co.uk/b006qykl.rss ) so I'm not exactly sure what ChatGPT even did here (Maybe the Dewey classification? Which is of dubious usefulness).

For comparison two links for the (currently) last episode, first from BBC, the second from genmon

https://www.bbc.co.uk/programmes/m001jkzg

https://genmon.github.io/braggoscope/2023/03/02/megaliths.ht...

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#28

Post by astroalex »

I love this project!!

Ever since my partner and I discovered In Our Time a few years back, it’s been our go-to podcast to listen to together. Part of the allure is that the archive is so vast, but that makes it hard to browse.

My partner made her own archive of In Our Time here, if you’re interested: https://shelby.cool/melvyn/

She used Wikipedia to find and categorize each episode. I also really like that she indexed episodes by guest, too. Certain guests are REALLY good and have been on many episodes.

Super excited to see someone else make an archive; we’ll definitely be exploring yours!

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#29

Post by CrypticShift »

genmon wrote: post #22

Some unlinked features... If you put the Dewey division in the URL, the directory auto-opens. e.g. here are episodes about prehistoric life (my current jumping-off point) https://genmon.github.io/braggoscope/directory#560 There's a visual map of episodes. After principal component analysis of the episode embedding vectors, these are the most significant two components as the x,y https://genmon.github.io/braggoscope/m…

Excellent! I'd love to see a script that sends a list of "descriptions" (1-100 words) to ChatGPT and directly gives you back a ready-made (embedding vectors closeness) map in a (textual) graph/chart format (like your above map or your plot https://interconnected.org/more/2023/02/in_our_time-PCA-plot...)

Re: Show HN: BBC “In Our Time”, categorised by Dewey Decimal, heavy lifting by GPT

#30

Post by p0pcult »

genmon wrote: post #22

Some unlinked features... If you put the Dewey division in the URL, the directory auto-opens. e.g. here are episodes about prehistoric life (my current jumping-off point) https://genmon.github.io/braggoscope/directory#560 There's a visual map of episodes. After principal component analysis of the episode embedding vectors, these are the most significant two components as the x,y https://genmon.github.io/braggoscope/m…

Love the visual map. What does color mean? Any way to do a 3rd PC, and put the visualization in a cube one can toy around with?
Post reply on HN