Andromeda Cluster Clone?

#1

Post by whatsthenews » Fri, Oct 27, 2023, 5:13 PM UTC

https://twitter.com/mprkhrst/status/1717936411561591042

Looks like an exact clone of the Andromeda Cluster built by Nat Friedman and Daniel Gross (https://andromeda.ai/.

Last I checked, P5 EC2 instances on AWS (H100s on AWS) are insanely expensive. Not sure how this startup will be able to compete with on-prem prices without eating the cost themselves.

Re: Andromeda Cluster Clone?

#2

Post by EricButton » Fri, Oct 27, 2023, 5:30 PM UTC

Looks interesting, I wonder if this works for companies on AWS startup credits as well

Re: Andromeda Cluster Clone?

#3

Post by prestonb » Fri, Oct 27, 2023, 5:34 PM UTC

As a college student, I have a hard time getting access to GPUs through AWS. If I can deploy using this + my credits, would be huge

Re: Andromeda Cluster Clone?

#4

Post by antimimetics » Fri, Oct 27, 2023, 5:37 PM UTC

I love the nat.css! Would love to see more startups building simple landing pages like this

Re: Andromeda Cluster Clone?

#5

Post by whatsthenews » Fri, Oct 27, 2023, 5:38 PM UTC

antimimetics wrote: post #4

I love the nat.css! Would love to see more startups building simple landing pages like this

Same, so simple for a landing page. You really don't need more if it's done right

Re: Andromeda Cluster Clone?

#6

Post by whatsthenews » Fri, Oct 27, 2023, 5:39 PM UTC

EricButton wrote: post #2

Looks interesting, I wonder if this works for companies on AWS startup credits as well

Think that would be a game changer if so, afaik AWS prioritizes the large AI companies (Hugging Face, Anthropic, etc) when it comes to access for GPUs

Re: Andromeda Cluster Clone?

#7

Post by nikofoto86 » Fri, Oct 27, 2023, 6:21 PM UTC

AWS makes it almost impossible for startups to get access to GPUs, so this would help a lot of startups out significantly if done right. A lot depends on what “cheap” means though…

Re: Andromeda Cluster Clone?

#8

Post by KomoD » Fri, Oct 27, 2023, 6:47 PM UTC

> Not sure how this startup will be able to compete with on-prem prices without eating the cost themselves.

Well, if you look at the company behind it, their whole thing seems to be optimizing cloud costs so maybe that has some part in it?

But yeah they were definitely "inspired" by Andromeda Cluster

Re: Andromeda Cluster Clone?

#9

Post by whatsthenews » Fri, Oct 27, 2023, 6:53 PM UTC

nikofoto86 wrote: post #7

AWS makes it almost impossible for startups to get access to GPUs, so this would help a lot of startups out significantly if done right. A lot depends on what “cheap” means though…

True, nothing on AWS seems cheap these days :(

Re: Andromeda Cluster Clone?

#10

Post by whatsthenews » Fri, Oct 27, 2023, 6:54 PM UTC

KomoD wrote: post #8

> Not sure how this startup will be able to compete with on-prem prices without eating the cost themselves. Well, if you look at the company behind it, their whole thing seems to be optimizing cloud costs so maybe that has some part in it? But yeah they were definitely "inspired" by Andromeda Cluster

TBH i found the nat.css thing to be funny. Interesting to see so many tools like this building on top of AWS, wonder what AWS thinks about it given their most recent earnings report