51–60 of 78 posts
I think this kind of tooling is one positive aspect of integrating LLM tech in certain workflows/pipelines. Tools like k8sgpt are similar in purpose and show a strong potential to be useful. Look forward to seeing how this progresses.
Earlier quoted context omitted.
> it can be very reliable You need to quantify this. With actual numbers. I am getting very tired of seeing everyone pushing LLMs and being disingenuous about exactly how often it is getting things wrong. And what the impact of that is. There is a reason that AI is not taking off in the enterprise and that is because people who take their job seriously are getting tired too.
I understand your sentiment, but I also don't think it's fair to say people are being disingenuous. I don't work for an AI company, I just use it with decent results. My last project needed a way to tag certain types of business activity indicated in 17,000 user reviews. I wrote a prompt with 5 different tags along with descriptions for each business activity, took a few-shot approach by defining 8 different examples…
I was attempting to find formats that used a particular quoting style — SQL style double-the-character-to-espace — and bizarrely JSON came up.
Gemini:
> JSON: In JSON, double quotes are used to delimit strings. If a double quote needs to be included within the string itself, it's escaped by doubling it (e.g., "This is a string with a "quote" in it.").
That is,
"This is a string with a "quote" in it."
Gemini:
> Yes, the JSON example I provided ("This is a string with a "quote" in it.") is actually valid JSON.
> The reason it's valid is because the doubled quote within the string is interpreted as an escaped character, representing a single literal quote within the string itself. The JSON parser recognizes the double quotes at the beginning and end as delimiters for the entire string, not the escaped quote within.
It also called out,
> XML: Use a backslash (\) to escape characters, including quotes.
In a different context, and more towards "working with k8s" that the OP's AI is focused on,
Me: Regex to extract the replica number from a statefulset pod's name?
Gemini:
> Use kubectl: The kubectl get pods command with output formatting can directly show replica numbers. Here's an example:
kubectl get pods -o jsonpath='{.items[*].metadata.name}{" - replica: "}{.metadata.labels.replicaset-序号}'
Earlier quoted context omitted.
> it can be very reliable You need to quantify this. With actual numbers. I am getting very tired of seeing everyone pushing LLMs and being disingenuous about exactly how often it is getting things wrong. And what the impact of that is. There is a reason that AI is not taking off in the enterprise and that is because people who take their job seriously are getting tired too.
I understand your sentiment, but I also don't think it's fair to say people are being disingenuous. I don't work for an AI company, I just use it with decent results. My last project needed a way to tag certain types of business activity indicated in 17,000 user reviews. I wrote a prompt with 5 different tags along with descriptions for each business activity, took a few-shot approach by defining 8 different examples…
An AI agent to triage the production issues caused by code generated by some other startup's generative AI bot. I fucking love tech in 2024.
Earlier quoted context omitted.
> You need to set up your fine-tuning and prompts and then test well for consistent results. Tell that to Google... Seriously, it is well established that these systems hallucinate. Trying to say otherwise shows you are trying to push something that just is not true. They can be right, yes. But when they are wrong they can be catastrophically wrong. You could be wasting time looking into the wrong problem with someth…
If you're curious what the state of the art in multi-agent is looking like, I really recommend https://thinkwee.top/multiagent_ebook/
The answer is not, “let an ai figure it out.”
That is legitimately scary.
For god sakes, SREs need to give up on K8. It was a bad idea, just move on. The answer is not, “let an ai figure it out.” That is legitimately scary.
Earlier quoted context omitted.
What would you propose as an alternative to k8s?
go back to building monoliths
Earlier quoted context omitted.
I understand your sentiment, but I also don't think it's fair to say people are being disingenuous. I don't work for an AI company, I just use it with decent results. My last project needed a way to tag certain types of business activity indicated in 17,000 user reviews. I wrote a prompt with 5 different tags along with descriptions for each business activity, took a few-shot approach by defining 8 different examples…
(Reader beware: basically everything the LLM emits in here is wrong.) I was attempting to find formats that used a particular quoting style — SQL style double-the-character-to-espace — and bizarrely JSON came up. Gemini: > JSON: In JSON, double quotes are used to delimit strings. If a double quote needs to be included within the string itself, it's escaped by doubling it (e.g., "This is a string with a "quote" in it.…