Live data from Hacker News

Ask HN: Daily practices for building AI/ML skills?

news.ycombinator.com

131–135 of 135 posts

Re: Ask HN: Daily practices for building AI/ML skills?

#131

Not a complete answer, but here are the most helpful resources for understanding transformer basics in particular: Original transformer paper: https://arxiv.org/abs/1706.03762 Illustrated transformer: http://jalammar.github.io/illustrated-transformer/ Transformer visualization: https://bbycroft.net/llm minGPT (Karpathy): https://github.com/karpathy/minGPT --- Next, some foundational textbooks for general ML and deep…

> Elements of Statistical Learning

"Elements" is a great reference book, but it isn't really a textbook. There's a popular introductory textbook by some of the same authors called "An Introduction to Statistical Learning", which focuses on applications but elides a lot of the mathematical details.

Re: Ask HN: Daily practices for building AI/ML skills?

#132
post #33

(Former AI researcher + current technical founder here) I assume you’re talking about the latest advances and not just regression and PAC learning fundamentals. I don’t recommend following a linear path - there’s too many rabbit holes. Do 2 things - a course and a small course project. Keep it time bound and aim to finish no matter what. Do not dabble outside of this for a few weeks :) Then find an interesting area o…

I also recommend fastai. It gets you hands on from the very beginning with links to extra resources like papers and articles you can read to improve your understanding.

Doing fastai while solving comparative problems on your own in kaggle is quite enlightening

Re: Ask HN: Daily practices for building AI/ML skills?

#133

Earlier quoted context omitted.

The risk with this is that you spend 10 hours learning statistics then get demotivated and never do the other 190 hours to get to the good stuff. Then quickly you forget the 10 hours of stats you learnt too as it's irrelevant and you don't use it. For me, playing with things and doing cool & fun stuff is always the way to get deeper into something.

> Then quickly you forget the 10 hours of stats you learnt too as it's irrelevant and you don't use it. Stats is one of a very small number of college courses that I took where I came away thinking "this should be mandatory for all voting adults". I use that stats course way more often than I use even algebra, just to be a functional adult in a world where bad statistics are used day in and day out to manipulate and…

Where did you do your stats course? Who taught it? What was the textbook? Asking because it sounds like your experience taking stats was a lot better than mine and I wonder if I could learn some more if I studied it again in a way more similar to what you did.

Re: Ask HN: Daily practices for building AI/ML skills?

#134
post #101

I'd spend most of that hour a day using ChatGPT, Bard and other models. Learning how to effectively prompt an LLM is an enormous space in its own right - and there's no shortcut for it, you have to actively play with the things. I've been using them constantly for over a year at this point and I'm still figuring out new tricks and strategies all the time. Weirdly, knowledge of Machine Learning isn't actually that rel…

That's a unique suggestion. Any chance you could share your favorite resources around it? Also, since you seem to have accumulated experience/expertise, would be super happy to read about it from you as well. Thanks for the advise.

I've found the following resources helpful:

- 15 Rules For Crafting Effective GPT Chat Prompts (https://expandi.io/blog/chat-gpt-rules/)

- Awesome ChatGPT Prompts (https://github.com/f/awesome-chatgpt-prompts)

For more resources of like nature, you can search for "mega prompt".

Re: Ask HN: Daily practices for building AI/ML skills?

#135
I'm no expert and I'm self-taught, here's what I think

1. Don't waste your time on courses [not after you know the basics]

2. Kaggle Competitions [Featured ones] worked for me

3. Read blogs/newsletters - Tldr AI comes with new research and many open-source projects, I have personally starred a ton of repos and it's totally amazing, then there's bizzaro devs, data elixir, Hackernews newsletter which combines top links, You can read Lilian Weng if you have strong fundamentals, Jay Alammar

4. Additionally I took Udacities nano degrees, they were nice, you can try it, for RL and Self Driving cars at least..

Best Jay

Post reply on HN