Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

I were 17, I'd learn how to build LLMs from scratch

twitter.com

Post reply on HN
Print view View original

571–580 of 725 posts

Re: I were 17, I'd learn how to build LLMs from scratch

#571

Post by DarmokTanagra »

Grombobulous wrote: post #537
DarmokTanagra wrote: post #386

Earlier quoted context omitted.

“only make $115k” This right here is why nobody is shedding tears for the massive employment crisis in tech. You make double that shilling ai slopware while they work nights saving lives. I would tell a 17 year old that the world will always need nurses, same can’t be said for guys sitting in their pajamas burning tokens. What is happening now in tech has been a long time coming, and it can’t happen fast enough.

I just want to make it clear that I’m not assigning some kind of moral superiority to my financial situation and the amount that the economy values my labor per hour. I don’t make the rules for how much each profession is able to make in compensation. The world will always need nurses, but that doesn’t mean that it’s a fantastic career to get into if you have a neutral career preference and your primary consideration…

[flagged]

Re: I were 17, I'd learn how to build LLMs from scratch

#572

Post by asdfman123 »

oersted wrote: post #13

There's this dilemma where in theory there's a ton of demand for engineers that can do real LLM machine-learning, but in practice there are very few available positions and entrepreneurship opportunities. The reality is that an incredibly small minority of companies in the world do any real training or optimisation. It's unnecessary and inefficient for most purposes unless you are fully dedicated to being an LLM comp…

Yes. There's a lot of demand for elite talent, and no demand for slightly sub-elite talent.

Re: I were 17, I'd learn how to build LLMs from scratch

#573

Post by swozey »

Paul has the same problem just about every tech obsessed engineer has (including myself), he thinks everyone else loves computers too. They don't. At all. I''m a self-taught ex-bartender and I can't tell you how many grown adults in the service industry I've tried to get into computer stuff and they had 0 interest.

And younger people I meet don't even own laptops. I had a genz/millennial cusp friend who wrote all her college papers on her iphone.

Re: I were 17, I'd learn how to build LLMs from scratch

#575

Post by Sesse__ »

ryandrake wrote: post #455
bigfishrunning wrote: post #420

Earlier quoted context omitted.

Are you asserting that C++ is not a marketable skill? If anyone reading this has this un-marketable skill, Carnegie robotics in Pittsburgh is hiring carnegie-robotics.breezy.hr/p/2d85f5321cc7-software-engineer

I think he's saying that building a browser is not a transferrable skill, like making a generic web page is. Employers don't like specialists. I used to build display drivers for graphics cards. Wonderful learning opportunity but other employers not in the graphics card manufacturing business didn't give a shit--those three years were essentially treated as an employment gap. "Well that's nice, but we really wish you…

> I think he's saying that building a browser is not a transferrable skill, like making a generic web page is. Employers don't like specialists.

I recently switched roles, and among the seven places I interviewed, none of them seemed to see my then-current browser job as a problem, even though they were not related to browsers. (The closest one was a company implementing a HTTP reverse proxy, and I did not work on the browser's HTTP stack.)

Re: I were 17, I'd learn how to build LLMs from scratch

#576

Post by 331c8c71 »

rfgplk wrote: post #456
Aissen wrote: post #431

Earlier quoted context omitted.

I was there at the start of the smartphone boom. I built a demo Android device that was capable of telephony/data, 3D rendering, etc. all before Google open-sourced the OS, for a SoC vendor that wasn't in Google's inner circle. Yet the industry was not interested in my junior profile during the subprime crisis.

Ridiculous frankly.

More than sad...

Re: I were 17, I'd learn how to build LLMs from scratch

#577

Post by chermi »

mattlutze wrote: post #224

A lot of people here are responding to the message but not to the meaning. It would be a good idea for young people to deeply know how these programs work. Not so that they can spend their career building them, but so that they can approach the next class of problems we'll all start trying to solve, with intuition all the way down to the weights and underlying mathematics. And also, to develop a healthy intuition of…

Couldn't have said it better

Re: I were 17, I'd learn how to build LLMs from scratch

#579

Post by barbazoo »

> Someone asked what I'd do if I were 17. I'd learn how to build LLMs from scratch, and then train ones as powerful as I could with whatever hardware I could get access to.

He's seeing a future for models running on everyday hardware just capable enough to do what the use case requires.

Re: I were 17, I'd learn how to build LLMs from scratch

#580

Post by wawaWiWa2 »

barbazoo wrote: post #579

> Someone asked what I'd do if I were 17. I'd learn how to build LLMs from scratch, and then train ones as powerful as I could with whatever hardware I could get access to. He's seeing a future for models running on everyday hardware just capable enough to do what the use case requires.

That is the idea of ai Not agi A specific model for each problem.

Agi is the academia solution Software is the practical solution

Post reply on HN