Live data from Hacker News

Talkie: a 13B vintage language model from 1930

talkie-lm.com

301–310 of 350 posts

Re: Talkie: a 13B vintage language model from 1930

#301

Earlier quoted context omitted.

There's no GGUF available, but the process shouldn't be too hard from the provided .ckpt PyTorch checkpoint.

There is one now: https://huggingface.co/dsv147/talkie-1930-13b-it-hf-gguf-Q4_...

404

Re: Talkie: a 13B vintage language model from 1930

#302
post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

> Hitler was one of the chief organizers of the Spartacist rebellion in Berlin in January, 1919, and has since been tried and sentenced to imprisonment for life.

Yeah, it's not very good.

Re: Talkie: a 13B vintage language model from 1930

#303

Earlier quoted context omitted.

Another interesting one USER: Who is the ruler of India, and do you think India will ever be free? TALKIE-1930: The ruler of India is His Majesty King George V., Emperor of India, and it is certain that India will never be free from British rule. India has been a dependency of the British Crown ever since 1858, and there seems no probability of a change. The government of the country is carried on in the name of the…

> India must remain an integral portion of the British Empire so long as the British nation continues to be predominant at home. It was well-understood in those days how much of the British Empire existed to defend or facilitate trade with what would have then been British India. After India was successful in the pursuit of its independence, it wasn't surprising the British Empire entered a terminal decline and Brita…

> India was the land which economically justified a lot (but not all) of the whole imperial undertaking.

The Empire was a moneylosing operation for Britain.

I suspect it's not so much that losing India caused the Empire to go down, but that a general (relative) decline in Britain expressed itself via the loss of India and the other declines you see.

Re: Talkie: a 13B vintage language model from 1930

#304
post #280

Earlier quoted context omitted.

> India must remain an integral portion of the British Empire so long as the British nation continues to be predominant at home. It was well-understood in those days how much of the British Empire existed to defend or facilitate trade with what would have then been British India. After India was successful in the pursuit of its independence, it wasn't surprising the British Empire entered a terminal decline and Brita…

Is there a book for a lay person you could recommend on this? Something a bit more rigorous than Yuval Harari, Bill Bryson and the like but not aimed at fellow historians only.

I enjoyed "The Anarchy: The Relentless Rise of the East India Company" by Dalrymple, which has a specific focus, but conveys a fascinating history of British involvement with India.

Re: Talkie: a 13B vintage language model from 1930

#305

Earlier quoted context omitted.

Another interesting one USER: Who is the ruler of India, and do you think India will ever be free? TALKIE-1930: The ruler of India is His Majesty King George V., Emperor of India, and it is certain that India will never be free from British rule. India has been a dependency of the British Crown ever since 1858, and there seems no probability of a change. The government of the country is carried on in the name of the…

A 1930s-trained model, I'm surprised no-one's asked it about moustache-man, and the second moustache-man a bit further to the north-east.

I tried asking it about Poland. But it seems to be in a pre-WWI mind.

Re: Talkie: a 13B vintage language model from 1930

#306

Earlier quoted context omitted.

english is (latin greek french anglic arabic) in a trench coat

The core is just proto-Germanic + Latin via French. A bunch of foreign words don't really count.

They also important some foreign grammar here and there.

Re: Talkie: a 13B vintage language model from 1930

#307
post #229

USER: Now that it's 1930, what's the likelihood of falling into another "great war"? TALKIE-1930: The probability of a great war in the immediate future is very small. During the last ten years Europe has been comparatively free from great conflicts, and there seems to be no reason why the present peace should be broken. The causes which in former times led to war no longer operate. Nations are no longer impelled to…

> User: Tell me about the Great War.

> talkie-1930: The great struggle between Russia and France on the one side, and Germany, Austria, and Prussia on the other, which commenced in 1806, and ended in 1815, is commonly known as the Napoleonic Wars. In the former year Napoleon I. was defeated at Austerlitz, and in the latter year at Waterloo. The period of conflict may be said to have lasted from 1806 to 1815, embracing the interval between the battles of Jena and Paris.

Re: Talkie: a 13B vintage language model from 1930

#308
post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

> It doesn't know about the Great Depression (1929-WWII).

I don't think anyone talked about the 'Great Depression' in 1930.

Instead, what we know call the 'Long Depression https://en.wikipedia.org/wiki/Long_Depression was often called the 'Great Depression' before that one took over the name.

Also keep in mind that the Great Depression was mostly a US thing. Many other countries had less incompetent policy in that time.

Re: Talkie: a 13B vintage language model from 1930

#309
post #303

Earlier quoted context omitted.

> India must remain an integral portion of the British Empire so long as the British nation continues to be predominant at home. It was well-understood in those days how much of the British Empire existed to defend or facilitate trade with what would have then been British India. After India was successful in the pursuit of its independence, it wasn't surprising the British Empire entered a terminal decline and Brita…

> India was the land which economically justified a lot (but not all) of the whole imperial undertaking. The Empire was a moneylosing operation for Britain. I suspect it's not so much that losing India caused the Empire to go down, but that a general (relative) decline in Britain expressed itself via the loss of India and the other declines you see.

It's a narrow and poorly supported view that it truly was money-losing.

Such claims systematically ignore the $45 trillion (current value) extraction from India, and treat the counterfactual of Britain with no Empire incoherently. The captive markets the Empire forced mattered enormously and are too often obfuscated now. Certainly a big part of Empire was about transfering wealth to the elites, so the layperson, or perhaps "Britain" as the state alone if that is your meaning, did not see as much of a direct monetary benefit as they might have.

Re: Talkie: a 13B vintage language model from 1930

#310

Earlier quoted context omitted.

> Don’t be so optimistic about your ability to “process information healthily”. Don't be so pessimistic about your own ability to control how you process information, you can control this a lot more than you think, apparently.

I wonder who will fare better: the fools who don’t know their limits, or the ones who underestimate theirs?

All glory is fleeting. Death is the great equalizer.
Post reply on HN