Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

AI for AWS Documentation

awsdocsgpt.com

Post reply on HN
Print view View original

41–50 of 134 posts

Re: AI for AWS Documentation

#41

Post by scarface_74 »

WrtCdEvrydy wrote: post #38
klysm wrote: post #34

Earlier quoted context omitted.

Lol yeah no thanks. This is one of things that makes me nervous about using LLMs. If the internet contains shitty solutions for solving a problem, it’s going to recommend shitty solutions. Inexperienced folks won’t know better. There’s also the thing where that’s a positive feedback look and we overflow the worlds corpus with garbage.

> Inexperienced folks won’t know better. I've seen answers like this in Stack Overflow before. Technically correct, but basically broken in every other way: cybersecurity's future is gonna be interesting.

One of my pet peeves about almost every answer on Stack Overflow is that the answer always starts with

    client=boto3.client(, access-key,secret-key)
There is never a reason to include those last two parameters. It’s always a security risk no matter how you do it.

Re: AI for AWS Documentation

#42

Post by linguistbreaker »

jamestimmins wrote: post #35

What's the best current way to make a bunch of documents searchable via LLMs like this? I've tried the using OpenAI w embeddings (iirc), but this was slow, got expensive quickly, and it struggled to answer questions about the text accurately. Curious if there's better standard approaches now.

I just came across this project which seems to be aiming at streamlining exactly that :

https://github.com/Mintplex-Labs/anything-llm

Re: AI for AWS Documentation

#43

Post by vasili111 »

CSDude wrote: post #12

Well, I'll pass. Prompt: how to connect a lambda function to an RDS instance and query it safely? 1. Configure your RDS instance for outbound connections to AWS Lambda. This step involves ensuring that your DB instance is in a public subnet on your VPC and that the instance's "PubliclyAccessible" property is set to true.

I find the links from where AI got information more useful than answer of AI.

Re: AI for AWS Documentation

#44

Post by aradox66 »

scrum-treats wrote: post #21

Using ChatGPT for AWS service questions is actually pretty good. For instance, I asked it for a Cloud Practitioner study guide (using a small set of crafted prompts), and GPT performed quite well. While I have yet to query GPT about Solutions Architect or DevOps material, I know I can feed a set of URLs and GPT will "learn" the material and summarize it in ways meaningful and relevant to my prompts. In this way, Chat…

Agree, I've had great results asking chatgpt questions about AWS services. The interactivity is very helpful, and chatgpt will draft scripts too, although that's hit or miss. But for understanding concepts and services, it's great.

Re: AI for AWS Documentation

#45

Post by Jianghong94 »

vasili111 wrote: post #43
CSDude wrote: post #12

Well, I'll pass. Prompt: how to connect a lambda function to an RDS instance and query it safely? 1. Configure your RDS instance for outbound connections to AWS Lambda. This step involves ensuring that your DB instance is in a public subnet on your VPC and that the instance's "PubliclyAccessible" property is set to true.

I find the links from where AI got information more useful than answer of AI.

AWS has some great documentations

Re: AI for AWS Documentation

#46

Post by Jianghong94 »

jamestimmins wrote: post #35

What's the best current way to make a bunch of documents searchable via LLMs like this? I've tried the using OpenAI w embeddings (iirc), but this was slow, got expensive quickly, and it struggled to answer questions about the text accurately. Curious if there's better standard approaches now.

A couple of things come to mind: 1. embedding methods: there're a couple of ways to do that, the most used one is OpenAi's text-davinci-002, although in my use case(short sentence description of API) it didn't work pretty well; 2. how you truncate documents into pieces: for this langchain has some implementation and helpful pointers.

I think you have to do lots of experiment on this till you find your best information retrieval strategy

Re: AI for AWS Documentation

#47

Post by politician »

scarface_74 wrote: post #39
sovietmudkipz wrote: post #31

This is exactly the kind of software that people should be making. Even if this one is bad, the concept is very sound. I want to have a specialist AI that is trained to help me learn how to use the software. 100% what should be happening. General AI should know how to do stuff too but having an specialist AI implies that the company/group of people/person is making sure to tune the model. Just an IMO.

Why? You can ask the same questions to ChatGPT and get the same or better answers. I also know from personal experience with ChatGPT, that you can use it to: - convert Python/boto3 to any language that has an AWS SDK - convert CloudFormation to Terraform or the CDK - write scripts that use the SDK You will get the occasional hallucination.

Ideally, specialist models are small enough to run locally.

Re: AI for AWS Documentation

#49

Post by cle »

scarface_74 wrote: post #39
sovietmudkipz wrote: post #31

This is exactly the kind of software that people should be making. Even if this one is bad, the concept is very sound. I want to have a specialist AI that is trained to help me learn how to use the software. 100% what should be happening. General AI should know how to do stuff too but having an specialist AI implies that the company/group of people/person is making sure to tune the model. Just an IMO.

Why? You can ask the same questions to ChatGPT and get the same or better answers. I also know from personal experience with ChatGPT, that you can use it to: - convert Python/boto3 to any language that has an AWS SDK - convert CloudFormation to Terraform or the CDK - write scripts that use the SDK You will get the occasional hallucination.

Here's one example question that ChatGPT utterly fails at, but that this answers fine: "What is Amazon CodeCatalyst?"

ChatGPT: "I'm sorry, but as of my knowledge cut-off in September 2021, there was no service, tool, or product known as Amazon CodeCatalyst offered by Amazon Web Services (AWS). [...]"

Post reply on HN