Live data from Hacker News

Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

news.ycombinator.com

51–60 of 97 posts

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#51

What a goldmine of recommendations. I like Sam Witterveen’s YouTube stuff for keeping up to speed https://m.youtube.com/@samwitteveenai

My issue with YouTube channels that focus on AI news is that they’re heavily incentivized to give you a frequent stream of attention-grabbing news. Week-by-week updates aren’t that helpful. It’s easy to miss the bigger picture and there’s too much content to feel like a good use of time.

I agree with this statement, most YouTube channels are incentivized to keep repeating the same trivial information like how to compose prompts etc

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#52
Using web wrappers around AI is being an AI end user

If you want to be an AI engineer study this:

https://github.com/karpathy/llm.c

And build around llama.cpp

Ollama is like cpanel for models. It’s not going to familiarize you with lower level implementation which is just as important as knowing the math.

That was my approach. Being aware of the internals not just the equivalent of “git pull model” got me a job, without a CS degree and a long career in software. Ymmv

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#54
post #6
post #4

I don't think it's a good idea to kepp up to date at a daily/weekly cadence, unless you somehow directly get paid for it. It's like checking stocks daily, it doesn't lead to good investment decisions. It's better to do it more batchy, like once every 6-12 months or so.

How do you do that? Once you're out of the loop for half a year, it becomes harder to know what's important and what's not, I think.

Some ideas:

1. Buy O'reilly (and other tech) books as they come out. This will have a lag, but essentially somebody did this research & summarization work, and wrote it up for you in chapters. Note that you don't have to read everything in a book. Also, $50 is a great investment if it saves you 10s of hours of time.

2. Talks on Youtube at conferences by industry leaders, like Yann LeCun, or maintainers of popular libraries, etc. Also, YT videos on the topic that are upvoted/linked.

3. If you're interested in hardcore research, look for review articles on arxiv.

4. Look at tutorials/examples in the documentation/repo of popular ML/AI libraries, like Pytorch.

5. Try to cover your blindspots. One way or another, you'll know how new AI is applied to SWE and related fields. But how is AI applied to perpendicular fields, like designing buildings, composing music, or balancing a budget? Trying to cover these areas will be tougher, because it will be more noisy, as most commenters will be non-experts compared to you. To get a feel for this, do something that feels unnatural, like watch TED talks that seem bullshity, read HBR articles intended for MBAs, and check out what Palantir is doing.

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#56
post #38

Earlier quoted context omitted.

daveshap quit ai right? got agi pilled/"oneshotted by ayahuasca" as the kids say

He was only gone for a few days, IIRC. At any rate, he's back publishing AI related content again, and it looks like all (?) of his old content is back on his YT channel.

honestly his channel quality is notably different than the other 2 you mentioned. i'm vaguely curious what you get out of it that makes you put him on the same tier.

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#57
post #25

Earlier quoted context omitted.

Out of sheer curiosity, how much time did you spend on it on average? How much of this knowledge are you using now?

Not the poster you responded to but I learned quite a bit from kaggle too. I started from scratch, spent 2-4 hrs per day for 6 months & won a silver in a kaggle NLP competition. Now I use some of it now but not all of it. More than that, I'm quite comfortable with models, understand the costs/benefits/implications etc. I started with Andrew Ng's intro courses, did a bit of fastai, did Karpathy's Zero to Hero fully, a…

i mean yes but also how much does kaggling/traditional ML path actually prepare you for the age of closed model labs and LLM APIs?

im not even convinced kaggling helps you interview at an openai/anthropic (its not a negative, sure, but idk if itd be what theyd look for for a research scientist role)

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#58
post #6
post #4

I don't think it's a good idea to kepp up to date at a daily/weekly cadence, unless you somehow directly get paid for it. It's like checking stocks daily, it doesn't lead to good investment decisions. It's better to do it more batchy, like once every 6-12 months or so.

How do you do that? Once you're out of the loop for half a year, it becomes harder to know what's important and what's not, I think.

my conference is currently run on a 6 month batch https://www.youtube.com/@aidotengineer

and is curated by me/my team. hope that helps people keep up on the video/talk-length form factor (as in, instead of books, though we also have 2-3 hour workshops)

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#59
post #48

I follow these: * Matt Berman on X / YT * AI-summarized AI news digest: https://buttondown.com/ainews by swyx * https://codingwithintelligence.com/about by Rick Lamers Then I manually follow up to learn more about specific topic/news I'm interested in.

thanks for following!

i admire the youtubers a lot and often wonder if i should be venturing into that domain. youtube takes a lot of work but also has the greatest reach by far.

Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI

#60
post #51

Earlier quoted context omitted.

My issue with YouTube channels that focus on AI news is that they’re heavily incentivized to give you a frequent stream of attention-grabbing news. Week-by-week updates aren’t that helpful. It’s easy to miss the bigger picture and there’s too much content to feel like a good use of time.

I agree with this statement, most YouTube channels are incentivized to keep repeating the same trivial information like how to compose prompts etc

Completely agree in general, but his are not that. Yes he talks about recent stuff but it’s very considered and not attention or influence seeking IMO
Post reply on HN