Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.
Generative AI for Beginners
71–80 of 104 posts
Re: Generative AI for Beginners
#72This seems more of a course about how to use Generative AI - does anyone have a good recommendation of a course or book about how they actually work?
Re: Generative AI for Beginners
#73This seems more of a course about how to use Generative AI - does anyone have a good recommendation of a course or book about how they actually work?
thank you, the replies to your comment are far better than this marketroid rubbish that doesn't even tell you how to run a generative ai, much less write one
Re: Generative AI for Beginners
#74Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.
Do you want to USE it or BUILD it? If the later, ChatGPT's recommendations are a good start. If the former, courses like this one are a good start.
Re: Generative AI for Beginners
#75Earlier quoted context omitted.
The key problem is that an LLM can't distinguish between instructions from a trusted source and instructions embedded in other text it is exposed to. You might build your AI assistant with pseudo code like this: prompt = "Summarize the following messages:" emails = get_latest_emails(5) for email in emails: prompt += email.body response = gpt4(prompt) That first line was your instruction to the LLM - but there's no cu…
Ah interesting. I had assumed there were different methods, something like: gpt4.prompt(prompt) gpt4.data(email_data) response = gpt4.response() If the interface is just text-in and text-out then Prompt injection seems like an incredibly large problem. Almost as large as SQL injection before ORMs and DB libraries became common.
Yeah, that's exactly the problem: it's string concatenation, like we used to do with SQL queries.
I called it "prompt injection" to name it after SQL injection - but with hindsight that was a bad choice of name, because SQL injection has an easy fix (escaping text correctly / parameterizing your queries) but that same solution doesn't actually work with prompt injection.
Quite a few LLMs offer a concept of a "system prompt", which looks a bit like your pseudocode there. The OpenAI ones have that, and Anthropic just announced the same feature for their Claude 2.1 model.
The problem is the system prompt is still concatenated together with the rest of the input. It might have special reserved token delimiters to help the model identify which bit is system prompt and which bit isn't, and the models have been trained to pay more attention to instructions in the system prompt, but it's not infallible: you can still put instructions in the regular prompt that outweight the system prompt, if you try hard enough.
Re: Generative AI for Beginners
#76Re: Generative AI for Beginners
#77Is there a learning path for someone who hasn't done any AI/ML ever? I asked ChatGPT, it recommended to start from linear algebra, then calculus, followed by probability and statistics. Phase 2 would be Fundamentals of ML. Phase 3 - Deep Learning and NN. And so on. I don't know how accurate these suggestions are. I'm an SDE.
Do you want to USE it or BUILD it? If the later, ChatGPT's recommendations are a good start. If the former, courses like this one are a good start.
Build. Thank you.
Re: Generative AI for Beginners
#78With the rate things are improving and all the new paradigms being explored, I feel like this course will be outdated fast. I learned about generative AI 2 years ago and all the tools I used then are outdated.
Re: Generative AI for Beginners
#79from microsoft, no red flags there
Re: Generative AI for Beginners
#80I think this is more than needed for beginner