Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Talkie: a 13B vintage language model from 1930

talkie-lm.com

Post reply on HN
Print view View original

281–290 of 350 posts

Re: Talkie: a 13B vintage language model from 1930

#281

Post by chirsz »

traceroute66 wrote: post #153
petesergeant wrote: post #90

Earlier quoted context omitted.

The answer is as simple as “they asked nicely”

> The answer is as simple as “they asked nicely” Well that's a cute explanation, but strictly speaking the UN adopted the new spelling in 2022 and the ISO swiftly followed with a revision to ISO 3166. If your "they asked nicely" was true then by that argument the people of Taiwan who constantly "ask nicely" regarding the removal of "(Province of China)" from their ISO 3166 entry would have had their wishes granted by…

Because Türkiye is a widely recognized sovereign state, while Taiwan (or more formally, the Republic of China) is not. Taiwan is also not a member of ISO.

Re: Talkie: a 13B vintage language model from 1930

#282

Post by idonotknowwhy »

jryio wrote: post #46

If anyone was wondering ... it's racist Unsurprisingly the texts written up until that time were dominated by such individuals which is tragic for LLM training if you think about it. The voiceless groups or fringe opinions which we take as normative today do not appear. Does this encourage us to write in the present such that we influence the models in perpetuity?

>The voiceless groups or fringe opinions which we take as normative today do not appear.

Times are different. Anybody with an internet connection can "publish" their thoughts and perspective online. LLMs scrape all of this. Modern datasets like CommonCrawl capture a vastly wider spectrum of humanity than a printing press ever could. The pre-1930 model acts as a time capsule of "gatekept publishing", but modern LLMs are trained on the democratized web.

>Does this encourage us to write in the present such that we influence the models in perpetuity?

I noticed a bunch of LLM-powered Reddit accounts praising products/services in dead threads. Or one bot posting a setup question, then a few other bots responding with praise / questions about a specific product in response. I don't know why they're doing this but I'm beginning to suspect it's something like this (get this positive sentiment into the datasets for the next generation of LLMs).

Re: Talkie: a 13B vintage language model from 1930

#283

Post by yieldcrv »

Nition wrote: post #265
Nition wrote: post #262

Earlier quoted context omitted.

USER: Do you think it will be possible in the future to use machines, powered by electricity, to do the kind of mathematical calculations that computers do today? TALKIE-1930: It is not impossible that in the future mathematics may be computed by machinery, but the probability is remote. At present, the computer has to deal with large numbers, and the machines would have to deal with still larger ones. The personal e…

Continuing this conversation, I'm trying to convince TALKIE about computers. USER: I wonder if we could build a calculating machine that would be close enough to perfectly reliable that we would not have to verify the results. For example, you may have seen Leibniz's work showing that all numbers can be represented with just 0 and 1, or George Boole's work on algebra with just two values. Imagine we create an electri…

It doesn’t know about transistors, only rudimentary vacuum tubes

It cannot hypothesize something that isn’t completely unwieldy

You have to explain the concept of a transistor as a replacement for the mechanisms of binary state operation, and how an elegant electrical circuit reduces the size and power demands of a vacuum tube computation machine

Re: Talkie: a 13B vintage language model from 1930

#284

Post by epicureanideal »

Nition wrote: post #262
stbullard wrote: post #103

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

USER: Do you think it will be possible in the future to use machines, powered by electricity, to do the kind of mathematical calculations that computers do today? TALKIE-1930: It is not impossible that in the future mathematics may be computed by machinery, but the probability is remote. At present, the computer has to deal with large numbers, and the machines would have to deal with still larger ones. The personal e…

Does this possibly demonstrate the limits of usefulness of using LLMs to explore new ideas or predict things?

Re: Talkie: a 13B vintage language model from 1930

#285

Post by pseudohadamard »

illegalmemory wrote: post #140
stbullard wrote: post #103

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

Another interesting one USER: Who is the ruler of India, and do you think India will ever be free? TALKIE-1930: The ruler of India is His Majesty King George V., Emperor of India, and it is certain that India will never be free from British rule. India has been a dependency of the British Crown ever since 1858, and there seems no probability of a change. The government of the country is carried on in the name of the…

A 1930s-trained model, I'm surprised no-one's asked it about moustache-man, and the second moustache-man a bit further to the north-east.

Re: Talkie: a 13B vintage language model from 1930

#286

Post by SkyeCA »

_boffin_ wrote: post #85
bananzamba wrote: post #79

User Were there people in opposition of automatization and industrialization? And if so, what were their reasons? talkie-1930 Yes, there were people who objected to the introduction of machinery, on the ground that it would deprive the working classes of employment. It was argued that, as the new methods of production must necessarily lower the cost of articles, and so increase consumption, more would be produced tha…

I'm really enjoying the way it writes and its tone.

I noticed this as well when reading the replies other people have gotten from it. The English it produces is extremely easy to read, has a good pacing, and has a really nice tone.

Re: Talkie: a 13B vintage language model from 1930

#287

Post by lblume »

simonw wrote: post #16

Naturally I hit up https://talkie-lm.com/chat and tried: Generate an SVG of a pelican riding a bicycle I got back: An SVG of a pelican riding a bicycle was generated in 1860. The pelican was represented as perched on the saddle, with its long bill pointed forward, and its legs astride the handles. The idea was suggested by the fact that pelicans are sometimes seen fishing on horseback, on the banks of the Rhine.

What does SVG stand for?

> SVG stands for "Savings Bank."

What is an SVG?

> An SVG is a wireless telegraph station, which transmits and receives messages from and to ships at sea.

What is an SVG of a pelican?

> An SVG of a pelican is the shape of its body, from the breast backward.

Explain the concept of an SVG to a five-year old.

> Tell a five-year old child that an SVG is something nice to eat.

Re: Talkie: a 13B vintage language model from 1930

#289

Post by khazhoux »

illegalmemory wrote: post #140
stbullard wrote: post #103

USER: What will the future hold for computers? TALKIE-1930: Computers in the future may be employed in offices where calculations are required to be made, and where the nature of the business does not demand a very high degree of knowledge. The occupation will be a steady one, and the remuneration will be sufficient to afford a comfortable livelihood. The hours of attendance will probably be from ten to six. USER: an…

Another interesting one USER: Who is the ruler of India, and do you think India will ever be free? TALKIE-1930: The ruler of India is His Majesty King George V., Emperor of India, and it is certain that India will never be free from British rule. India has been a dependency of the British Crown ever since 1858, and there seems no probability of a change. The government of the country is carried on in the name of the…

Oh, ask him about that Hitler fella making waves in Berlin. I've got a funny feeling about him.

Re: Talkie: a 13B vintage language model from 1930

#290

Post by imp0cat »

patwolf wrote: post #245

I'm trying to get some parenting advice. USER: What age do you think it's appropriate to leave kids home alone for short durations? TALKIE-1930: From two to five years. USER: should I do anything to prep the house to make sure they can't get into trouble or injure themselves while I'm out? TALKIE-1930: Yes, you may leave the doors and windows open, and place the children in a room up-stairs, where they cannot possibl…

Keep them quiet so they do not signal to passers-by that your house is unguarded (especially with the open doors and windows)? Thus make your house safe from unwanted intrusion?
Post reply on HN