We should remember the fact that LLMs had emergence doing one mundane thing. Now think what we would have if we do our mundane thing of learning something for the sake of just learning… Emergence.
I were 17, I'd learn how to build LLMs from scratch
701–710 of 725 posts
Re: I were 17, I'd learn how to build LLMs from scratch
#702If I were 17 again, I would probably be single-mindedly focused on getting laid adequately and getting into something non-STEM. Or at least I hope so.
Re: I were 17, I'd learn how to build LLMs from scratch
#703Earlier quoted context omitted.
No, but there's a WHOLE ENTIRE WORLD of tech that isn't LLMs. LLMs aren't the future or anything. Sure they'll keep existing. Right now though all the opportunities exist for people looking literally anywhere else
So you're saying that LLMs are a dead end technology? Do you have anything to back up that claim?
Let's be very, very generous and say that an LLM is intelligent. Does intelligence eliminated the need for tools? If you have an executive assistant and your executive assistant has ten executive assistants, does that mean that Microsoft Excel is obsolete?
Why the everliving fuck has everyone stopped building tools?
Re: I were 17, I'd learn how to build LLMs from scratch
#704This is what I did, tho I’m 41
Re: I were 17, I'd learn how to build LLMs from scratch
#705Earlier quoted context omitted.
actually just use chatgpt. There is a new mode of learning thats now avaiable that doesnt require you to read about things that are already discovered leaving you with a shallow knowledge. you can now play the inventor and start with question "i want to build next token prediction software" and go as far as you can with your current knowledge while brainstroming with chatgpt as a rubber duck. dont not start with a co…
I think ChatGPT is a great way to get depth on a topic. You can Q&A for a while until you get it, and it won’t get impatient with you. That said, I think traditional resources are a better way to get breadth and to frame the topic. Just chatting about something can be a little disorienting imo.
i think process of discovering what to study is as important as stuyding something. thats the main problem with traditoinal format.
Re: I were 17, I'd learn how to build LLMs from scratch
#706Hot take - but I’d learn to build CNNs from scratch. We are only just now scratching the surface of convolutional neural networks capabilities
Re: I were 17, I'd learn how to build LLMs from scratch
#707Earlier quoted context omitted.
Hacker News is a Y Combinator (which PG co-founded) sponsored website whose original code was created by PG and whose guidelines were originally formed by PG. For those who are "sick"(sic) of rich people, VCs, or capitalism in general, you've come to the wrong place.
I stand by what I said, are you gatekeeping HN now? This is a tech news site, I don't care if he once was a co founder.
[deleted]
Re: I were 17, I'd learn how to build LLMs from scratch
#708Earlier quoted context omitted.
One of the things to think about when it comes to many kinds of "expensive" technology, is that from so many well-funded ventures, from the capitalists on down almost every decision-maker involved has not spent the majority of their life making every dollar count in some way or another. Even more so when things are not just expensive by nature, but truly overpriced beyond that point. >10000% Once in a while you do ge…
?
Not my downvote above, corrective upvote instead.
I'm with you both 10000% on this :)
I just figure the next level would be if a brilliant innovator comes up with something more than 10000x as effective as an LLM, for one reason because it has nothing to do with an LLM.
Probably by somebody who has gotten good at making every dollar count for quite some time.
Re: I were 17, I'd learn how to build LLMs from scratch
#709Earlier quoted context omitted.
We've wronged an entire generation by pushing "learn to code".
"learn to code because it will get you a good career" perhaps, but "learn to code at at least a high school level, because it will give you a very good mental model for how computers do things" is still very useful.
Or maybe generalized to "get good at problem solving." I've found building software systems has a lot of parallels to working on physical things such as carpentry/DIY and working on small engines. The concepts of breaking down a problem into a bunch of smaller problems, and identifying what can be independently tested/built remain the same.
Re: I were 17, I'd learn how to build LLMs from scratch
#710Earlier quoted context omitted.
What would be better advice for a 17 year old?
"it doesn't matter what you choose to study because no job is safe from being outsourced overseas, handed over to an indentured servant, or made redundant by a machine. you will spend your whole life surviving while the cannibalistic pedophiles who own everything invent new ways to make you own nothing. be frugal, don't get married, don't have children, do everything you can to stay healthy and independent, and you j…
We always hoped that we wouldn't live to see the dystopia in Snow Crash become reality.
We never imagined that we'd live to see Snow Crash depict a utopia by comparison to what we got.