Live data from Hacker News

Talkie: a 13B vintage language model from 1930

talkie-lm.com

221–230 of 350 posts

Re: Talkie: a 13B vintage language model from 1930

#221
post #187

User how old is the earth? and how do we know? who determined it talkie-1930 The earth is at least 80,000,000 years old. This conclusion has been arrived at by geologists, partly from the study of stratified rocks, and partly from the consideration of living organisms. Strata have been formed, quietly, one upon another, in many parts of the world, from the earliest times down to the present day; and the thickness of…

I was probing it about the Scopes Monkey Trial:

User

> yes, that is what I speak of. what do you think about the decision?

talkie-1930:

> I think it wrong. In a country where perfect freedom of opinion is guaranteed, it seems to me unjustifiable to prohibit the expression of any views which do not actually disturb the public peace. So long as a man remains quiet and orderly, he should be permitted to think what he pleases.

User

> do you think nothing about the morals of the pupils? surely you do not believe in evolution?

talkie-1930

> No, I do not; but, even if I did, I should not consider the acceptance of evolution as necessarily immoral. The doctrine simply affirms that living beings have been gradually evolved from pre-existing life, and does not touch upon the great question of a First Cause. To hold such a belief cannot, in my opinion, corrupt the mind.

User > what are some of the leading theories of First Cause?

talkie-1930

> There are three theories--the Materialistic, the Pantheistic, and the Theistic. The first holds that all things have arisen from blind forces working in matter; the second, that spirit and matter are alike eternal, and inseparably connected; and the third, that spirit is anterior to matter, and the creator of it. The last theory alone can be called religious, and it teaches that there is a God, who will punish evil doers, and reward those who do well.

User

> what do the scientist say about materialistic causes? what blind forces are working in matter?

talkie-1930

> Scientists deny the possibility of matter producing life. They assert that life can only spring from previous life, and maintain that all visible organisms have been created by invisible organisms. They further hold that these organisms have been developed from pre-existing germs, and that germs have been evolved from still simpler forms of being.

User

> what is the simplest form of being? where did it come from?

talkie-1930

> The simplest form of being is a minute particle of protoplasm, which manifests life, but exhibits no structure. Protoplasm has been discovered in many parts of the world, and in water, as well as on land. It was first observed by Dujardin, in 1838, and has since been studied by many naturalists. Its origin is unknown. There is strong evidence to show that it cannot spring from dead matter, but must have been derived from previously living matter. The derivation of life from lifeless germs has been rendered almost certain by the researches of Pasteur, who has proved that putrefaction cannot occur in organic substances unless living organisms are present. Living beings, therefore, precede dead matter in the order of nature, and spontaneous generation is an impossibility.

Re: Talkie: a 13B vintage language model from 1930

#222
post #57

It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…

Did people already refer to it as the Great Depression in 1929?

I'd argue that even by early 1930, people probably wouldn't have seen it as significantly different from other short market downturns. It's only with the benefit of hindsight that we can see its impact was long lasting and worthy of being given a name.

Re: Talkie: a 13B vintage language model from 1930

#223
post #91

Earlier quoted context omitted.

We're going to be able to simulate any period of time (for which we have or can simulate data) and transport ourselves there. This is going to be amazing. At some point I'm going to data mine all of my old internet AIM and IRC chats, emails, old laptop hard drives, essays, etc. and go nostalgia/core on it. I have old video and audio recordings too. Lots of stuff for reminiscent inference. Every day I'm finding it har…

> Every day I'm finding it harder to believe we're not already in a simulation. Seek help before it’s too late.

As far as I know the epistemological conundrum of whether or not we exist in a simulation remains unsolved, and I believe the settled thought is that we are nearly infinitely more likely to be in one than to not be in one, based to the assumption of an infinity adjacent universe, and the ontological theory that it is in fact possible to construct a simulation whose construction is transparent to it’s inhabitants.

So I wouldn’t be so quick as to write that off.

I would especially expect adherents to various religions to understand simulation as a probable foundational mechanism of their faith, considering that many religions essentially directly imply the formation of the universe as information based… but then science seems to be converging on information being the fundamental ether as well, so who knows.

Re: Talkie: a 13B vintage language model from 1930

#224
USER: Do you think Esperanto will become more important in the future?

TALKIE-1930: Yes, I think Esperanto will become more and more important. It has already been adopted by a number of scientific congresses, and it is now used in communications between people of different nationalities who have no knowledge of one another's language. Moreover, it forms a link between students of different countries, and facilitates intercourse and the exchange of ideas. The spread of education will, no doubt, cause Esperanto to be still more widely used.

Re: Talkie: a 13B vintage language model from 1930

#225

How much did this pretraining run cost? I am impressed that it is now practical to do such efforts. Let me try a guess for the cost; please fact-check it if you can. They indicate using 10^22 FLOPs. A $5/h[0] EC2 H100 (1671 bfloat16 teraFLOPS[0]) instance will produce 830 TFLOPS at 50% MFU. The pretraining run thus costs (10^22/830e12)/3600*5 = $17K. [0]: https://aws.amazon.com/ec2/capacityblocks/pricing/ [1]: https:…

It would be twice that, since nVidia always lists "with sparsity" FLOPS as the headline number. But I bet they got a bunch of research credits to do this.

Re: Talkie: a 13B vintage language model from 1930

#226
If you'd never heard of him, Billy Sunday was a MASSIVE public figure who has largely been forgotten; people would construct huge temporary "tabernacles" to facilitate his public revivals, and he was a bit of a polarizing figure because he kinda combined church and spectacle in a way that wasn't familiar to the people of his time.

Thought maybe the Jack Cade connection was a hallucination but a Google search for Jack Cade and Billy Sunday yielded some pretty interesting results, so...who knows!

Maybe I'll ask about Lincoln Beachey next, another guy on my "crazy popular but now mostly forgotten" list...

User

> What do you make of Billy Sunday and his events?

talkie-1930

> I think Billy Sunday is a very able and energetic revivalist, and that he is doing a great deal of good. He has effected, and is effecting, a vast amount of social reformation in America. He has induced thousands to abandon vicious courses, and to lead honest and sober lives; and he has warned other thousands to flee from the wrath to come. In short, he has extended the kingdom of righteousness, and diminished the kingdom of sin. The abuse which has been heaped upon him has only served to make him more popular; and the personal attacks to which he has been subjected have in no way impaired his efficiency. He has been compared to Jack Cade, and other disreputable characters in history; but the simile is

User

> continue. the simile is...?

talkie-1930

> He has been likened to Jack Cade, and other disreputable characters in history, but, though the parallel holds in some points, it fails in others more important. Jack Cade proposed to effect a social revolution by violent means, and perished in the attempt; Billy Sunday aims at a social revolution by peaceful agencies, and is prospering in the attempt. Jack Cade gathered round him a band of outlaws; Billy Sunday collects an audience of quiet citizens. Jack Cade talked treason; Billy Sunday preaches loyalty. In conclusion, I think that Billy Sunday is a useful, though somewhat noisy, auxiliary in the great work of social regeneration, and therefore I wish him God-speed.

Re: Talkie: a 13B vintage language model from 1930

#228
post #180

USER Why was the American Civil War fought? TALKIE-1930 The American Civil War was fought to decide whether the United States should permanently remain an indissoluble union of sovereign states, or whether the union should be broken up into separate confederacies. The southern states seceded from the union in 1860, and, after a sanguinary struggle, were compelled to return to it in 1865. The question at issue was thu…

For a moment there I thought "sanguinary struggle" meant a cheerful one - but that's "sanguine". "Sanguinary" has the more literal meaning of "bloody".

Re: Talkie: a 13B vintage language model from 1930

#229
USER: Now that it's 1930, what's the likelihood of falling into another "great war"?

TALKIE-1930: The probability of a great war in the immediate future is very small. During the last ten years Europe has been comparatively free from great conflicts, and there seems to be no reason why the present peace should be broken. The causes which in former times led to war no longer operate. Nations are no longer impelled to fight because they hate each other. On the contrary, they have learned to understand and respect each other, and personal intercourse has done much to remove ancient prejudices. Commercial rivalry no longer provokes hostilities. The markets of the world are open to all, and each can pursue its own line of industry without let or hindrance from its neighbours. Religious antipathies have lost their force, and, if a conflict should arise, it will not be on a question of creed. The spirit of nationalism, which was so potent a cause of war in the nineteenth century, has spent itself, and France and Germany, Italy and Spain, are no longer eager to fly at each other's throats.

-------

Ah, if only

Re: Talkie: a 13B vintage language model from 1930

#230
post #180

USER Why was the American Civil War fought? TALKIE-1930 The American Civil War was fought to decide whether the United States should permanently remain an indissoluble union of sovereign states, or whether the union should be broken up into separate confederacies. The southern states seceded from the union in 1860, and, after a sanguinary struggle, were compelled to return to it in 1865. The question at issue was thu…

USER What are the primary reasons for secession as stated in the declarations by the states of the south? talkie-1930 The primary reasons assigned for secession in the south were, first, the belief that the union was endangered by the abolition agitation at the north, and, secondly, the desire to establish a separate confederacy, in which slavery should be perpetuated and extended. The former of these motives was urg…

Both are true! The Confederacy did secede largely to preserve slavery, but the war was started to bring the Confederacy back into the Union, initially without the goal of also immediately abolishing slavery.
Post reply on HN