Live data from Hacker News

Talkie: a 13B vintage language model from 1930

talkie-lm.com

101–110 of 350 posts

Re: Talkie: a 13B vintage language model from 1930

#101
post #93

Earlier quoted context omitted.

> Every day I'm finding it harder to believe we're not already in a simulation. Seek help before it’s too late.

Dude, I'm having a blast. I love life. Terminally online doomerism is what needs to be reined in. This tech is legitimately the jet packs we dreamed of as kids. It's better, even.

One can be excited for the future of LLMs while also acknowledging that the progress isn't simulated. It's cool, but not miraculous.

Re: Talkie: a 13B vintage language model from 1930

#102
post #91

Earlier quoted context omitted.

I'm really enjoying the way it writes and its tone.

We're going to be able to simulate any period of time (for which we have or can simulate data) and transport ourselves there. This is going to be amazing. At some point I'm going to data mine all of my old internet AIM and IRC chats, emails, old laptop hard drives, essays, etc. and go nostalgia/core on it. I have old video and audio recordings too. Lots of stuff for reminiscent inference. Every day I'm finding it har…

Combining AI with VR we can even achieve something like time travel ;-)

Re: Talkie: a 13B vintage language model from 1930

#103
USER: What will the future hold for computers?

TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six.

USER: and digital computers?

TALKIE-1930: Computers who make use of machines will be distinguished from digital computers, who perform their operations by means of the fingers alone. The former will be employed in offices and public establishments, where a great number of calculations have to be made; the latter in private houses, and by individuals.

(for those confused, "computer" was, at the time, a human occupation)

I love this.

Re: Talkie: a 13B vintage language model from 1930

#105
post #46

If anyone was wondering ... it's racist Unsurprisingly the texts written up until that time were dominated by such individuals which is tragic for LLM training if you think about it. The voiceless groups or fringe opinions which we take as normative today do not appear. Does this encourage us to write in the present such that we influence the models in perpetuity?

I'd be more worried if words from that era were fully aligned with present day notions of morality. Wouldn't that indicate a certain stagnation & lack of progress?

Let us hope, 100 years from now, there will be people who look back unkindly on us.

Re: Talkie: a 13B vintage language model from 1930

#106

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

Also, I'd like to see the inverse of it: a model trained only on the last few weeks - or even minutes - of published information, or only on scientific papers published in the last year or two. Should present some interesting psychoses!

Re: Talkie: a 13B vintage language model from 1930

#108

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

I'm slightly embarrassed to admit this took me a couple reads to get :)

Re: Talkie: a 13B vintage language model from 1930

#110

Question: could you train a model like this from before a known but important scientific breakthrough happened and see if it is able to work it out. At least then you know the answer yourself and know it’s something that can be reasonably worked out.

This is an active area of research. Demis Hassabis proposed training a model with a strict knowledge cutoff before 1915, and seeing whether it can independently arrive at general relativity.
Post reply on HN