Live data from Hacker News

Ask HN: Has anyone made the transition from app development to ML/AI work?

news.ycombinator.com

21–30 of 64 posts

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#21
post #2

From my experience, there are plenty of teams in FANG that will hire you as a backend developer in a ML team assuming you can pass their interviews. 90% of the work in these teams is not core ML and is more mundane work supporting these models, such as data piping, cleaning, feature generation, experimentation, and real-time serving. You'll get plenty of experience in working directly with ML systems. The jump to cor…

>90% of the work in these teams is not core ML and is more mundane work supporting these models, such as data piping, cleaning, feature generation, experimentation, and real-time serving. You'll get plenty of experience in working directly with ML systems.

MLOps is what you're describing, and it's probably the number one field I'd recommend someone to go down right now as a backend dev.

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#22
post #9

Earlier quoted context omitted.

FWIW I worked at Amazon in one of these teams and it's not something I found very interesting. You get thrown a random binary that some ML researcher compiled with instructions to host-it. No sense of ownership over the product, you're just an Ops frontend for a researcher so they can do the fun stuff building models and you're dealing with the pagers.

That sounds like the worst kind of tech position to be in

[deleted]

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#23
I made the jump and pivoted a bit. My first gig was in enterprise applications and then I made the jump to mobile apps that I developed for 5 years.

I got somewhat lucky as the feature my team owned was powered by ML. After gaining credibility on the mobile side I worked with my manager to make the transition to backend. Did backend for about a year and was fortunate with the timing that my team was launching a new product with a model it owned. I got to work closely with ML engineers on it and eventually I became the DRI of the feature along with the model. After 2 more years I came to the realization that ML was moving a bit faster than I could keep up reading white papers about and decided to pivot to ML Ops. This let me leverage my strengths in distributed computing that I developed, be very close to ML without having to study math in my spare time

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#24
One concrete example we're hiring in: We're looking for a cleared security / SIEM engineer in Australia to help build out GPU/AI SOC tech. As long as they love Python and modern bits like scaling detection engineering & automation, they'll be learning the GPU & AI side pretty darn fast :)

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#25
post #9

Earlier quoted context omitted.

FWIW I worked at Amazon in one of these teams and it's not something I found very interesting. You get thrown a random binary that some ML researcher compiled with instructions to host-it. No sense of ownership over the product, you're just an Ops frontend for a researcher so they can do the fun stuff building models and you're dealing with the pagers.

That sounds like the worst kind of tech position to be in

It's about the same tier as BI dashboards. Huge breadths of data you don't produce but are nevertheless accountable for. All your stakeholders can easily stream-of-consciousness rattle off dozens of new metric/feature ideas or questions about the feature/metric values they're seeing over the course of 45 seconds, each one taking you tens of hours eyeballs deep in SQL to even begin to answer.

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#26
I have yet to make the transition in a paid role, but I quit my backend job to start a startup developing realistic text-to-speech for long-form content.

My approach has been to start at a high-level, with a specific goal in mind, and to progressively go deeper and deeper. The specific goal part has been really helpful IMO. It prevents sort of aimless shuffling about and provides a good metric to see if you're making progress. When I started I was basically just focusing on producing training data and treating the models, which were open-source on GitHub, as a black-box. At this point I've made a lot of modifications to the actual model code itself and I'm learning a ton. There's of course a bunch of adjacent skills that are similar to traditional backend skills, but slightly different. Like autoscaling for example, there aren't many autoscaling solutions for GPU VMs yet, there are some startups working on this space, but IMO it's good to have a rock-solid hosting solution that you don't have to worry about too much.

I opened up the beta of my product just last week at https://bondsynth.ai/signup

The goal is to either have my startup succeed or to move into an ML engineer position at a small-to-medium sized company.

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#27
I've been doing "full stack" for many years. Until the new GPT came out I thought that I needed to become an expert in ML and had taken some Coursera classes etc.

But now with the general purpose power of the ChatGPT API / OpenAI Embeddings, things like Stable Diffusion, and Eleven Labs, etc., and the expectation of new models coming out that have visual understanding integrated with the large language model, and quite possibly even more intelligence, I don't feel that ML is a good path for me. It makes more sense for me to just leverage the APIs to build applications.

I get the impression that optimized (multimodal) transformer models are going to be readily adaptable to most tasks and so its much less important going forward to do "real research" in order to get results.

As soon as the GPT3 API came out I started experimenting and moving towards launching https://aidev.codes. So now I have quite a bit of experience with prompt engineering for GPT, and a few other AI-related APIs. I am looking to raise money for marketing aidev.codes. If anyone wants to hire me, see the email in my profile.

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#29
post #13

Quit my job in Fintech to work on my own AI startup. I built https://FakeYou.com as a side project, and it blew up. I quit my job after I realized the potential, added monetization, and started to broaden what we do. I've been working on https://storyteller.ai for a year and plan to launch our platform soon. Both of these tool sets reinforce one another. I'm hiring folks that were engineers that want to do AI instead…

Well done!!

Re: Ask HN: Has anyone made the transition from app development to ML/AI work?

#30
I just made the transition in the other direction. I did a Masters in computer vision, then worked at a startup doing computer vision and machine learning work for 2 years. I recently transitioned into app dev.

There are 2 levels to ML/AI, being a researcher and being an engineer. The researcher actually creates new models, architectures, etc. You're going to need to be talented at math, as well as pursue a PhD to have enough time to absorb some subset of the material to have a good understanding. (A masters was good but not enough time for me personally).

Then there is engineering which is leveraging the creations of the very smart PhDs. At least in my experience, the shallow level is basically fine-tuning models to your use case, which does require an understanding of some things like loss functions, train/validation/test sets, but it's not too complicated.

Everyone that asks me how to learn machine learning, I advise them to read Hands on Machine Learning by Aurélien Géron cover to cover. When I first started my masters I did this and it helped immensely because it was easy to understand, was broad, and was interested usually from an application perspective.

From there, I would suggest learning PyTorch (starting w/ Keras is ok too, but don't stay there too long, and avoid Tensorflow), as it's much easier to develop with. I always learn best with a personal project, so maybe see if there is a real life "problem" you'd be interested in solving, like classifying different pets from each other or something like that.

It'll take a while to build up your skills, so going to school is of course an option, but with dedication I think you can also accomplish this solely with side projects and learning on your own. Best of luck!

Post reply on HN