Live data from Hacker News

Ask HN: How do you stay on top of advances in AI?

news.ycombinator.com

1–10 of 43 posts

Ask HN: How do you stay on top of advances in AI?

#1
The rate of change in the AI space is super fast. What are some of the best ways to stay on top on what's going on in AI (let's say on a weekly or bi-weekly basis) without having to be glued to social media or compile a bunch of different sources together from across the Internet manually?

Let's say for example that I'm a founder in the space, and want to be abreast of what the major new things are this week.

I'm thinking, at the least:

* Press releases from relevant companies

* Relevant new research papers

* News articles

* Blogs

* Open-source library updates

* Videos

* Tweets

Re: Ask HN: How do you stay on top of advances in AI?

#2
I leave it to YOShInOn, the smart RSS reader I have been dreaming about since 2005. YOShInOn ingested 2054 articles (not all about A.I.) and picked out 300 to show to me based on a transformer model. I make thumbs up, thumbs down or favorite jugements on the articles in an interface that looks like TikTok or Stumbleupon. One feed it ingests is

https://arxiv.org/list/cs/new

and it's learned that I really like anything about reccomendation systems, text classifiers and many kinds of deep network but that I'm not so interested in reinforcement learning, theoretical CS, etc.

I had a fight with it early on when it struggled to understand that I liked the NFL but not the Premier League but in the process of understanding why I read so many articles about football and I started thinking "Wow, they won that game 1-0 and it was an own goal" and wondering "How would I feel if it was my team that got relegated?" and before I knew it I cared if Man City or Arsenal came out on top...

Re: Ask HN: How do you stay on top of advances in AI?

#3
Twitter / Mastodon - I follow a lot of researchers and other people in this space.

(Perhaps surprisingly) Facebook - I'm in a few AI/ML/DL related groups, and there's one individual in particular who does a really good job of identifying interesting new papers and articles that show up and then submits the links or one or more of those groups.

Google News - mostly popsci articles show up here, but a few are of interest now and then.

HN - A few really interesting AI related links show up here from time to time.

/r/machinelearning on reddit

/r/artificial on reddit

Manually browsing ArXiv, JMLR, JAIR, and a handful of similar sites.

Email newsletters - I am subscribed to a few newsletters that surface interesting items

Youtube - some conferences put all (or most, or some) of their presentations up on Youtube. The AGI conference, for example, usually has their presentations there. NeurIPS also posts a lot (if not all) of their sessions. And so on...

Re: Ask HN: How do you stay on top of advances in AI?

#5

Twitter / Mastodon - I follow a lot of researchers and other people in this space. (Perhaps surprisingly) Facebook - I'm in a few AI/ML/DL related groups, and there's one individual in particular who does a really good job of identifying interesting new papers and articles that show up and then submits the links or one or more of those groups. Google News - mostly popsci articles show up here, but a few are of intere…

Thanks for your feedback! I wish there was something that could aggregate all this so it could be browsed quickly a couple times per week.

Re: Ask HN: How do you stay on top of advances in AI?

#6
I work in AI for a living, my advice would be worry less about what's the latest and greatest and focus on solving your problem, and learning the things you're interested in well.

Precisely because "the rate of change in the AI space is super fast", there really isn't much of a point to keeping up, even if you're an academic researcher (for those you only need to keep up with your piece of the puzzle, and you likely know everyone in that space already).

For example, I wasn't working in the NLP space for a few years. I kept an eye on what was getting mentions in various circles but basically ignored everything until I had a problem to solve. I work with LLMs everyday now, and honestly, even though I do understand them pretty deeply, there's no real need. Prior to the rise of LLMs I spent some time building LSTMs because I felt that I needed to understand them better. Lots of fun projects, but if I had skipped all that it wouldn't have really mattered at all.

Even more dramatically, I was never particularly specialized in computer vision, but currently build things (for fun) with Staple Diffusion every night. I've spent a fair bit of time really understanding the underlying model well (still have much to learn) but, because the space moves so fast, it's not that big a deal that I didn't also spend nights building GANs. Even though Stable Diffusion is also perpetually changing, the community has largely stuck with 1.5 and is very focused on squeezing as much juice out of that as they can.

Most important: the fundamentals have never changed. GPT4 still projects information into some highly non-linear latent space and samples from that. Diffusion models are probably the most novel thing happening now, but more so for their engineering (they're essentially 3 models all trained together with differentiable programming). If you really understand the fundamentals then catching up when you need to is fairly easy.

Re: Ask HN: How do you stay on top of advances in AI?

#8

I work in AI for a living, my advice would be worry less about what's the latest and greatest and focus on solving your problem, and learning the things you're interested in well. Precisely because "the rate of change in the AI space is super fast", there really isn't much of a point to keeping up, even if you're an academic researcher (for those you only need to keep up with your piece of the puzzle, and you likely…

Yes of course, but let’s assume the goal is to be conversational in what’s changing/new at the level of a Marc Andreesen, without actually having to be Marc Andreesen. I work in the space as well, but because I’m not in the Valley, find it more challenging to always be abreast of the changes. While it might not be essential for the actual product engineering to know what’s new, as a founder talking to customers it’s highly beneficial to be on top of things (depending of course on your vertical).

Re: Ask HN: How do you stay on top of advances in AI?

#9
I scrape arxiv once a day and have a small pipeline that tries to identify all AI-related submissions and summarize them. It’s hit-or-miss currently, but a.) the papers it finds are sometimes pretty interesting when I skim them to check the summaries and b.) it’s a great project to focus my AI learning on and I’m improving it all the time. One day I hope to get it good enough that it’s suitable to post to HN!

Re: Ask HN: How do you stay on top of advances in AI?

#10
post #5

Twitter / Mastodon - I follow a lot of researchers and other people in this space. (Perhaps surprisingly) Facebook - I'm in a few AI/ML/DL related groups, and there's one individual in particular who does a really good job of identifying interesting new papers and articles that show up and then submits the links or one or more of those groups. Google News - mostly popsci articles show up here, but a few are of intere…

Thanks for your feedback! I wish there was something that could aggregate all this so it could be browsed quickly a couple times per week.

There is a newsletter called 'The Rundown' but it's more on the consumer side of gen AI; rather than hard academic research

https://www.therundown.ai/

Post reply on HN