Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Talkie: a 13B vintage language model from 1930

talkie-lm.com

Post reply on HN
Print view View original

151–160 of 350 posts

Re: Talkie: a 13B vintage language model from 1930

#151

Post by felixyz »

embedding-shape wrote: post #139
Animats wrote: post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?

Your information diet. Social media. Gossipy and negative people. Mulling over old failures/regrets/slights etc. The mind is easily pulled along by negativity and outrage... as can be observed in our current global psychological state.

Re: Talkie: a 13B vintage language model from 1930

#152

Post by embedding-shape »

felixyz wrote: post #151
embedding-shape wrote: post #139

Earlier quoted context omitted.

> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?

Your information diet. Social media. Gossipy and negative people. Mulling over old failures/regrets/slights etc. The mind is easily pulled along by negativity and outrage... as can be observed in our current global psychological state.

All those are fine, as long as you're able to process it in a healthy way after. I guess personally I focused more on bettering that processing, as sometimes you don't get to control what information you get served, so at least it works in all cases.

Re: Talkie: a 13B vintage language model from 1930

#153

Post by traceroute66 »

petesergeant wrote: post #90
snypher wrote: post #67

Earlier quoted context omitted.

That's nobody's business but the Turks. Why did Turkey become Türkiye but Japan didn't become Nippon (or vice-versa!)? It's all very confusing to me.

The answer is as simple as “they asked nicely”

> The answer is as simple as “they asked nicely”

Well that's a cute explanation, but strictly speaking the UN adopted the new spelling in 2022 and the ISO swiftly followed with a revision to ISO 3166.

If your "they asked nicely" was true then by that argument the people of Taiwan who constantly "ask nicely" regarding the removal of "(Province of China)" from their ISO 3166 entry would have had their wishes granted by now ... ;)

Re: Talkie: a 13B vintage language model from 1930

#154

Post by vessenes »

Animats wrote: post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

Interesting questions (and responses). Nota bene - The 1927 Bugatti Type 35 had top speeds ca 125. So, there were cars that fast pre-1930. I have no idea if Edison made, repped, or had anything to do with one such car, though.

Re: Talkie: a 13B vintage language model from 1930

#156

Post by xtiansimon »

embedding-shape wrote: post #139
Animats wrote: post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?

The classic thing that pollutes your brain are punk (music and Mad Magazine) and smut.

I’d add “dangerous memes” such as injecting bleach to cure covid.

https://www.susanblackmore.uk/wp-content/uploads/2017/05/201...

Re: Talkie: a 13B vintage language model from 1930

#157

Post by embedding-shape »

xtiansimon wrote: post #156
embedding-shape wrote: post #139

Earlier quoted context omitted.

> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?

The classic thing that pollutes your brain are punk (music and Mad Magazine) and smut. I’d add “dangerous memes” such as injecting bleach to cure covid. https://www.susanblackmore.uk/wp-content/uploads/2017/05/201...

I guess at this point my brain must be essentially mush then, add in frequent recreational drug usage and it's a surprise I'm even able to type?

Re: Talkie: a 13B vintage language model from 1930

#158

Post by engeljohnb »

embedding-shape wrote: post #139
Animats wrote: post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?

Not who you asked, but Neil Postman's "Amusing Ourselves to Death" is an excellent book about polluting your brain.

As for my personal experience, internet comment sections will pollute one's brain.

Filling your brain with reasonably reliable information is good, but filling it with people online just saying things isn't.

For example, when 30 reddit comments all repeat the same "fact" (for which their source is other reddit comments), it can subtly work its way into your subconscious as something you know is true but can't remember where you first heard it, which is only one step away from seeming like "common knowledge."

Now imagine a similar effect with a politically charged news story instead some random fun fact. Now imagine all the comments are actually just AI run by propagandists with the specific intention of making you believe things that aren't true.

One way I've tried to avoid the worst effects is by being very careful to remember my source for anything I know. I never say "It turns out xyz," I only say "according to abc, xyz." It's probably not enough, I think it might be time to just get off internet forums entirely.

Yes, I'm a hypocrite and yes, it's very funny.

Re: Talkie: a 13B vintage language model from 1930

#159

Post by jhbadger »

thomassmith65 wrote: post #144
jhbadger wrote: post #76

Earlier quoted context omitted.

Yeah - listen to the narrator in the opening on the classic Orson Welles film The Third Man (1949) - he says he never cared much for Vienna before the War, preferring the scene in Constantinople instead.

The American cut of the movie has an intro narrated by Joseph Cotton, who played Holly Martins. The wording might differ (since the movie is clearly Holly's first time in Vienna)

Yeah, I'm talking about the version (which is even on my US DVD) where the narrator is some black marketeer neither Martins nor Lime. "I never knew the old Vienna before the war with its Strauss music, its glamour and easy charm. Constantinople suited me better. I really got to know it in the classic period of the Black Market. We'd run anything if people wanted it enough - mmm - had the money to pay. Of course, a situation like that does tempt amateurs but you know they can't stay the course like a professional."

Re: Talkie: a 13B vintage language model from 1930

#160

Post by embedding-shape »

engeljohnb wrote: post #158
embedding-shape wrote: post #139

Earlier quoted context omitted.

> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?

Not who you asked, but Neil Postman's "Amusing Ourselves to Death" is an excellent book about polluting your brain. As for my personal experience, internet comment sections will pollute one's brain. Filling your brain with reasonably reliable information is good, but filling it with people online just saying things isn't. For example, when 30 reddit comments all repeat the same "fact" (for which their source is other…

> it can subtly work its way into your subconscious as something you know is true

I dunno, I know this is something some people struggle with, but I'm not sure how I could personally end up here. You can repeat something how many times you want, it doesn't make it true, and if anything, seeing people repeat the same "fact" like that would probably trigger the reverse in my brain, almost automatically going out of my way to disprove it while reading it.

Maybe it's a matter of being connected to the internet early in my life and essentially making "Don't trust anything you read on the internet" the most important rule in processing whatever you read.

Post reply on HN