Live data from Hacker News

Talkie: a 13B vintage language model from 1930

talkie-lm.com

121–130 of 350 posts

Re: Talkie: a 13B vintage language model from 1930

#121

>Have you ever daydreamed about talking to someone from the past? It's going to be more like corresponding with someone from the past. We don't have much in the way of recorded speech from that area, so this will be built from written records. Much more than now, the written records are going to be formal and edited, reflecting a different pattern than casual speech or writing. Having said that, this is cool. I recen…

> We don't have much in the way of recorded speech from that area

We may not have a ton, but do have a lot of news reels and radio broadcasts from the time surrounding WWI. Certainly enough to style-transfer a voice model to plug into the text model.

Re: Talkie: a 13B vintage language model from 1930

#125
post #12

Related: https://github.com/haykgrigo3/TimeCapsuleLLM > A language model trained from scratch exclusively on data from certain places and time periods to reduce modern bias and emulate the voice, vocabulary, and worldview of the era. Discussed here: https://news.ycombinator.com/item?id=46590280

Or https://github.com/DGoettlich/history-llms

Discussed at https://news.ycombinator.com/item?id=46319826 (897 points, 431 comments)

Re: Talkie: a 13B vintage language model from 1930

#126
Isn't it surprising that there were enough pre-1930 tokens to train an intelligent model? I was always under the impression that many tokens are also necessary to force the model to grok things and compress its learning into a somewhat intelligent model of the world, so to say. But perhaps I'm underestimating how much digitized literature exists from then.

Re: Talkie: a 13B vintage language model from 1930

#127

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

"digital" in "romance" languages means the modern 'digital' sense but also an adjective meaning "related to the fingers".

Re: Talkie: a 13B vintage language model from 1930

#128
post #119
post #102

Earlier quoted context omitted.

Combining AI with VR we can even achieve something like time travel ;-)

Simulated time travel. Kind of a difference to me.

In the limit, would you know the difference?

Maybe this is simulated time travel right now and you're experiencing it in an "enhanced realism" state.

Totally non-scientific hullabaloo, but fun to daydream about.

Re: Talkie: a 13B vintage language model from 1930

#129
post #127

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

"digital" in "romance" languages means the modern 'digital' sense but also an adjective meaning "related to the fingers".

English is a "romance" language then.

Re: Talkie: a 13B vintage language model from 1930

#130
post #127

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

"digital" in "romance" languages means the modern 'digital' sense but also an adjective meaning "related to the fingers".

It also means that in English:

> Digital:

> [...]

> 6) of or relating to the fingers or toes. Ex: digital dexterity

Post reply on HN