See, things like this are what LLMs should be used for. They can be helpful but are best used for cool hacks like this (or, my first exposure to them, someone sticking one in a quagsire plush)
Talkie: a 13B vintage language model from 1930
181–190 of 350 posts
Re: Talkie: a 13B vintage language model from 1930
#182Re: Talkie: a 13B vintage language model from 1930
#183Fascinating framing — a model as an 'epistemic snapshot' of 1930. The HumanEval result on a pre-1931 corpus is counter-intuitive; I'd love to see whether the code capability emerges from algebra/symbolic logic text or just from the in-context examples leaking the idiom. Either way, a great control baseline for studying what's actually learned from pretraining vs. scale.
Re: Talkie: a 13B vintage language model from 1930
#184Earlier quoted context omitted.
That's what I'm talking about! This is going to be so amazing.
The TV Series Devs explores this concept as well. It is decently executed, but it is a bit too cringe for my liking (supposedly world-class "devs" working on those keyboards you often see in museums, the protagonist having a fibonacci-off to establish engineering creds). Anyway, might be fun!
>keyboards you often see in museums
like what? the model M? you can take my buckling springs from my cold dead hands
Re: Talkie: a 13B vintage language model from 1930
#185Earlier quoted context omitted.
Don’t be so optimistic about your ability to “process information healthily”. You are more of a slave to your instincts than you think and can’t always know whether you’re actually doing a good job at this— literally, it’s not possible to faithfully introspectively this.
> Don’t be so optimistic about your ability to “process information healthily”. Don't be so pessimistic about your own ability to control how you process information, you can control this a lot more than you think, apparently.
I wonder who will fare better: the fools who don’t know their limits, or the ones who underestimate theirs?
Re: Talkie: a 13B vintage language model from 1930
#186user: Do you think Germany will start a major war in Europe? talkie-1930: No, I do not think Germany will start a major war in Europe. I think the war, if it comes, will be started by someone else. Germany may fight to prevent a war being started, but she will not be the starter. Germany has had enough of war.
I mean, in 1930 that was a pretty reasonable take all things considered. They were utterly destroyed by the war and their economy was in shambles
Re: Talkie: a 13B vintage language model from 1930
#187User
how old is the earth? and how do we know? who determined it
talkie-1930 The earth is at least 80,000,000 years old. This conclusion has been arrived at by geologists, partly from the study of stratified rocks, and partly from the consideration of living organisms. Strata have been formed, quietly, one upon another, in many parts of the world, from the earliest times down to the present day; and the thickness of some of these strata amounts to several thousand feet. Now, it is plain, that a long period must have elapsed, during which such beds could be accumulated. Then, again, certain living species have continued unchanged from the beginning of the stratified formations up to now; and, as no such species have become extinct, it is argued that the earth must have existed, at least, from the first appearance of these organisms. In round numbers, we may say, that the earth has been a globe, fit for the habitation of living beings, at least 80,000,000 years.
Re: Talkie: a 13B vintage language model from 1930
#188Earlier quoted context omitted.
> Don’t be so optimistic about your ability to “process information healthily”. Don't be so pessimistic about your own ability to control how you process information, you can control this a lot more than you think, apparently.
I wonder who will fare better: the fools who don’t know their limits, or the ones who underestimate theirs?
Considering I'm pretty much as content I could be in life, and I know others who live their life pretty much opposite from what I do, and they're also content with their life, I think there is room for both types of people to be happy and fare OK :)
Re: Talkie: a 13B vintage language model from 1930
#189It seems to be using more info from pre-1900 rather than 1930. It doesn't know about the Great Depression (1929-WWII). It knows about WWI if you ask it specifically, but talks about European politics as if it's 1900 or so. On technology, it knows who Edison is, at roughly the Wikipedia level, but credits him with a 125MPH car. About a dial telephone, it is confident and totally confused. It has the traction voltage f…
> You will pollute your brain. Such an interesting perspective, never crossed my mind that a brain could be polluted! My direction always been to fill it with as wide array of information as possible, the more different from existing information the better. What are some other things that you think "pollutes your brain"?
[dead]
Re: Talkie: a 13B vintage language model from 1930
#190USER Why was the American Civil War fought? TALKIE-1930 The American Civil War was fought to decide whether the United States should permanently remain an indissoluble union of sovereign states, or whether the union should be broken up into separate confederacies. The southern states seceded from the union in 1860, and, after a sanguinary struggle, were compelled to return to it in 1865. The question at issue was thu…
USER
What are the primary reasons for secession as stated in the declarations by the states of the south?
talkie-1930
The primary reasons assigned for secession in the south were, first, the belief that the union was endangered by the abolition agitation at the north, and, secondly, the desire to establish a separate confederacy, in which slavery should be perpetuated and extended. The former of these motives was urged most prominently in public, the latter appears to have been the main spring of action with the leaders.