I'm working towards this for actual infrastructure, for serving up AI compute.
"install kimi 2.5 on a 4x mi300x vm and connect the endpoint to opencode, shut it down in 4 hours"
We're getting close.
Claude Code for Infrastructure
111–120 of 190 posts
Re: Claude Code for Infrastructure
#112> LLMs are great at generating Terraform, OpenTofu, Ansible, etc. but bad at guessing how production systems work. Sorry, that last part is absolutely not the case from my experience. IaC also uses the API to inquire about the infrastructure, and there are existing import/export tools around it, so I’m not exactly sure what you are gaining by insisting on abandoning it. IaC also has the benefit of being reusable and…
People try to write plausible copy, then come to HN to learn it's not often reality
It's largely because every devops situation is a snowflake and humans love to generalize. Turns out we don't all have the same problems. I haven't seen a startup that's been successful in devops at a level above the HCL / yaml
Re: Claude Code for Infrastructure
#113I'm working towards this for actual infrastructure, for serving up AI compute. "install kimi 2.5 on a 4x mi300x vm and connect the endpoint to opencode, shut it down in 4 hours" We're getting close.
this is not the way to do devops, we have IaC, reviews, and promotion for a reason
it's clear infra level decisions are well beyond what LLMs / agents are capable of today, this is area is too high risk, devops is slow to adopt new tooling because of its role and nature
Re: Claude Code for Infrastructure
#114I'm working towards this for actual infrastructure, for serving up AI compute. "install kimi 2.5 on a 4x mi300x vm and connect the endpoint to opencode, shut it down in 4 hours" We're getting close.
this is not the way to do devops, we have IaC, reviews, and promotion for a reason it's clear infra level decisions are well beyond what LLMs / agents are capable of today, this is area is too high risk, devops is slow to adopt new tooling because of its role and nature
wow, you downvoted me.
this is still devops. we use cloud-init to setup the vm.
i run the underlying hardware infrastructure and we've automated the provisioning such that we have an api that can start/stop compute at will. even bare metal.
the point of this is that the current $/token model is awful, especially if you're using a lot of tokens. it should be $/minute. pay for what you use.
Re: Claude Code for Infrastructure
#115Earlier quoted context omitted.
For problems that can be solved with only a small amount of simple code that is true. However software can become very complex and the larger/more complex the problem is the more important software developers are. It quickly becomes easier to teach software developers enough of your domain than to teach domain experts software. In a complex project the hard parts about software are harder than the hard parts about th…
That's true both ways though: if a theoretical physicist wants to display a model for a new theorem, it'd be probably easier for them to learn some python or js than for a software engineer to understand the theorems.
If this is the case is discoverable, for at least one direction. Reproducability is known to be a problem in some of the sciences, for various reasons. Find a paper that includes its data and software/methodology used for analysis, and try to get it running and producing the same results. Evaluate the included software/methodology on whatever software quality standards you feel are necessary or appropriate.
Re: Claude Code for Infrastructure
#116I use Pulumi for work, and their AI solution (Pulumi Neo) works amazingly well in troubleshooting cloud issues. It's informed of the cloud state and recent changes right from their platform, which is pretty amazing. Compared to using Azure CoPilot for the same purposes, Pulumi Neo was faster in generating responses, and these responses were actionable and solved my issues. CoPilot was laughably useless comparably.
Re: Claude Code for Infrastructure
#117Earlier quoted context omitted.
this is not the way to do devops, we have IaC, reviews, and promotion for a reason it's clear infra level decisions are well beyond what LLMs / agents are capable of today, this is area is too high risk, devops is slow to adopt new tooling because of its role and nature
wow, you downvoted me. this is still devops. we use cloud-init to setup the vm. i run the underlying hardware infrastructure and we've automated the provisioning such that we have an api that can start/stop compute at will. even bare metal. the point of this is that the current $/token model is awful, especially if you're using a lot of tokens. it should be $/minute. pay for what you use.
> wow, you downvoted me.
1. No, I commented, it is not even possible to downvote a reply to your own comment, seems other people must disagree with what you said or how you said it
2. It's against HN guidelines to talk about your downvotes, especially making claims about who has done it
The most likely reason for your downvotes is promoting your own (incomplete) project under someone else's. What did you hope to bring to the conversation?
Re: Claude Code for Infrastructure
#118Earlier quoted context omitted.
this is not the way to do devops, we have IaC, reviews, and promotion for a reason it's clear infra level decisions are well beyond what LLMs / agents are capable of today, this is area is too high risk, devops is slow to adopt new tooling because of its role and nature
wow, you downvoted me. this is still devops. we use cloud-init to setup the vm. i run the underlying hardware infrastructure and we've automated the provisioning such that we have an api that can start/stop compute at will. even bare metal. the point of this is that the current $/token model is awful, especially if you're using a lot of tokens. it should be $/minute. pay for what you use.
tokens are a rough proxy for usage over time, so I am paying for what I use, less than running a TPU pod myself, required for the models I use, i.e. I don't saturate the compute so it's cheaper to pay-go
Re: Claude Code for Infrastructure
#119Earlier quoted context omitted.
It should be. This is the least friction way to do so as server Linux operating systems still have not agreed on a common application format / package manager.
> It should be. This is the least friction way to do so as server Linux operating systems still have not agreed on a common application format / package manager. Nowhere in your response did you mention security.
or reproducibility
Re: Claude Code for Infrastructure
#120All these tools to build something, but nothing to build. I feel like I am part of a Pyramid Scheme where every product is about building something else, but nothing reaches the end user. Note: nothing against fluid.sh, I am struggling to figure out something to build.
Steve Jobs used to say every product needs a killer feature
AI is a product in search of a killer feature
First AGI was anyday going to come. Gpt5 had showed intelligence apparently
Then got started adult chat with paying customers