Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Generative AI for Beginners

microsoft.github.io

Post reply on HN
Print view View original

91–100 of 104 posts

Re: Generative AI for Beginners

#91

Post by two_in_one »

andreygrehov wrote: post #71

Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.

> Is there a learning path for someone who hasn't done any AI/ML ever?

It highly depends on what do you actually want.

1. Use existing models. The easiest is web services (mostly payed). Harder way is local install, still need a good computer

2. Understand how models work

3. General understanding where all this is going.

4. Being able to train or finetune existing models

4.1 Create some sort of framework for models generation

4.2 frameworks for testing, training, inference, etc..

5. Models design. They are very different depending on the domain. You will have to specialize if you want to get deeper.

6. Get AGI finally.

All things are different. Some require just following the news, some need coding skills, others more theory, philosophy. You can't have it all. If you have no relevant skill the first 4 are still withing the reach. Oh, yes. You can become ethic 'expert', that's the easiest.

Re: Generative AI for Beginners

#92

Post by nameisansh »

andreygrehov wrote: post #71

Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.

I would really like to know some course or roadmap for getting into AI/ML as a student.All the courses i found assume that you already know bunch of things.

Re: Generative AI for Beginners

#94

Post by cl42 »

schnitzelstoat wrote: post #58

This seems more of a course about how to use Generative AI - does anyone have a good recommendation of a course or book about how they actually work?

Here's a list of free courses and textbooks: https://phaseai.com/resources/free-resources-ai-ml-2024 I reviewed all of these to ensure they're high quality + not sales/marketing fluff. Enjoy!

Re: Generative AI for Beginners

#95

Post by angra_mainyu »

andreygrehov wrote: post #71

Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.

While I much prefer Linear Algebra over Calculus, I feel that a good, properly done course on Linear Algebra requires a certain level of mathematical maturity best forged through a course in Calculus.

Also, if you know Calculus you can dive into approximation theory (e.g: Padé Approximations), which is a beautiful subject that lies in the intersection of Calculus and Linear Algebra.

In any case "Schaum's Outline of Linear Algebra" is probably _the_ best book on Linear Algebra I've ever read. It even touches on bits of Abstract Algebra.

Re: Generative AI for Beginners

#97

Post by nopassrecover »

thekashifmalik wrote: post #69
simonw wrote: post #56

Earlier quoted context omitted.

The key problem is that an LLM can't distinguish between instructions from a trusted source and instructions embedded in other text it is exposed to. You might build your AI assistant with pseudo code like this: prompt = "Summarize the following messages:" emails = get_latest_emails(5) for email in emails: prompt += email.body response = gpt4(prompt) That first line was your instruction to the LLM - but there's no cu…

Ah interesting. I had assumed there were different methods, something like: gpt4.prompt(prompt) gpt4.data(email_data) response = gpt4.response() If the interface is just text-in and text-out then Prompt injection seems like an incredibly large problem. Almost as large as SQL injection before ORMs and DB libraries became common.

The way I see it, the problem is almost closer to social engineering than SQL injection.

A manager can instruct their reception team to only let people in with an ID Badge, and they already know they need to follow their manager’s direction, but when someone smooth persuades their way through they’re going to give a reason like “he said he was building maintenance and it was an emergency”.

Re: Generative AI for Beginners

#98

Post by derangedHorse »

andreygrehov wrote: post #71

Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.

This isn’t the correct path to learn the basics of deep learning. Take Andrew Ngs Intro to Machine Learning and Deep Learning Coursera classes. I also hear Deep Learning by Goodfellow and company is pretty good too, although I haven’t read it myself.

If you revisit all of a standard Calculus or Linear Algebra curriculum you will WASTE time. Learn the relevant math taught in the ai courses or the beginning chapters of deep learning books, not the irrelevant 90% of each introductory course. I say this as someone who actually used to build neural networks from scratch around 10 years ago and lost interest.

Re: Generative AI for Beginners

#100

Post by mark_l_watson »

dharmab wrote: post #36
mark_l_watson wrote: post #25

Earlier quoted context omitted.

On Mac Silicon, try Ollama as a means to easily download and run open LLMs.

Also works great on Linux if you have a high end desktop CPU.

After reading your comment, I spent a few minutes getting Ollama running on Google Colab - works great. First time I tried it on Linux + Intel.
Post reply on HN