What a goldmine of recommendations. I like Sam Witterveen’s YouTube stuff for keeping up to speed https://m.youtube.com/@samwitteveenai
My issue with YouTube channels that focus on AI news is that they’re heavily incentivized to give you a frequent stream of attention-grabbing news. Week-by-week updates aren’t that helpful. It’s easy to miss the bigger picture and there’s too much content to feel like a good use of time.
Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
51–60 of 97 posts
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#52If you want to be an AI engineer study this:
https://github.com/karpathy/llm.c
And build around llama.cpp
Ollama is like cpanel for models. It’s not going to familiarize you with lower level implementation which is just as important as knowing the math.
That was my approach. Being aware of the internals not just the equivalent of “git pull model” got me a job, without a CS degree and a long career in software. Ymmv
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#53Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#54I don't think it's a good idea to kepp up to date at a daily/weekly cadence, unless you somehow directly get paid for it. It's like checking stocks daily, it doesn't lead to good investment decisions. It's better to do it more batchy, like once every 6-12 months or so.
How do you do that? Once you're out of the loop for half a year, it becomes harder to know what's important and what's not, I think.
1. Buy O'reilly (and other tech) books as they come out. This will have a lag, but essentially somebody did this research & summarization work, and wrote it up for you in chapters. Note that you don't have to read everything in a book. Also, $50 is a great investment if it saves you 10s of hours of time.
2. Talks on Youtube at conferences by industry leaders, like Yann LeCun, or maintainers of popular libraries, etc. Also, YT videos on the topic that are upvoted/linked.
3. If you're interested in hardcore research, look for review articles on arxiv.
4. Look at tutorials/examples in the documentation/repo of popular ML/AI libraries, like Pytorch.
5. Try to cover your blindspots. One way or another, you'll know how new AI is applied to SWE and related fields. But how is AI applied to perpendicular fields, like designing buildings, composing music, or balancing a budget? Trying to cover these areas will be tougher, because it will be more noisy, as most commenters will be non-experts compared to you. To get a feel for this, do something that feels unnatural, like watch TED talks that seem bullshity, read HBR articles intended for MBAs, and check out what Palantir is doing.
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#55Unpopular opinion: if you can't use Google nor ChatGPT to get an answer to this question, I have bad news for you.
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#56Earlier quoted context omitted.
daveshap quit ai right? got agi pilled/"oneshotted by ayahuasca" as the kids say
He was only gone for a few days, IIRC. At any rate, he's back publishing AI related content again, and it looks like all (?) of his old content is back on his YT channel.
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#57Earlier quoted context omitted.
Out of sheer curiosity, how much time did you spend on it on average? How much of this knowledge are you using now?
Not the poster you responded to but I learned quite a bit from kaggle too. I started from scratch, spent 2-4 hrs per day for 6 months & won a silver in a kaggle NLP competition. Now I use some of it now but not all of it. More than that, I'm quite comfortable with models, understand the costs/benefits/implications etc. I started with Andrew Ng's intro courses, did a bit of fastai, did Karpathy's Zero to Hero fully, a…
im not even convinced kaggling helps you interview at an openai/anthropic (its not a negative, sure, but idk if itd be what theyd look for for a research scientist role)
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#58I don't think it's a good idea to kepp up to date at a daily/weekly cadence, unless you somehow directly get paid for it. It's like checking stocks daily, it doesn't lead to good investment decisions. It's better to do it more batchy, like once every 6-12 months or so.
How do you do that? Once you're out of the loop for half a year, it becomes harder to know what's important and what's not, I think.
and is curated by me/my team. hope that helps people keep up on the video/talk-length form factor (as in, instead of books, though we also have 2-3 hour workshops)
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#59I follow these: * Matt Berman on X / YT * AI-summarized AI news digest: https://buttondown.com/ainews by swyx * https://codingwithintelligence.com/about by Rick Lamers Then I manually follow up to learn more about specific topic/news I'm interested in.
i admire the youtubers a lot and often wonder if i should be venturing into that domain. youtube takes a lot of work but also has the greatest reach by far.
Re: Ask HN: Recommendation for a SWE looking to get up to speed with latest on AI
#60Earlier quoted context omitted.
My issue with YouTube channels that focus on AI news is that they’re heavily incentivized to give you a frequent stream of attention-grabbing news. Week-by-week updates aren’t that helpful. It’s easy to miss the bigger picture and there’s too much content to feel like a good use of time.
I agree with this statement, most YouTube channels are incentivized to keep repeating the same trivial information like how to compose prompts etc