Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS • Hacker News Board

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#191

Post by huntaub » Mon, Nov 18, 2024, 11:53 PM UTC

benatkin wrote: post #190

garganzol wrote: post #141

I used the same approach based on Rclone for a long time. I wondered what makes Regatta Storage different than Rclone. Here is the answer: "When performing mutating operations on the file system (including writes, renames, and directory changes), Regatta first stages this data on its high-speed caching layer to provide strong consistency to other file clients." [0]. Rclone, on the contrary, has no layer that would gu…

The headline seems misleading, then. rclone can work with AWS' different offerings, some of which at least partially address this: https://aws.amazon.com/blogs/aws/new-amazon-s3-express-one-z...

I'm not totally sure what you mean. I don't think that S3 Express One Zone offers any additional atomic semantics in the file system world.

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#192

Post by senderista » Tue, Nov 19, 2024, 12:07 AM UTC

If this product is successful, what prevents AWS from cloning it at a lower price (perhaps by leveraging access to their infrastructure) and putting you out of business?

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#193

Post by dangoodmanUT » Tue, Nov 19, 2024, 12:12 AM UTC

duidiip wrote: post #169

This sounds unnecessary and expensive. Why use this over similar self-managed open source offerings?

I bet this guy runs his own servers and databases in his basement too, because fk TCO amirite

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#194

Post by dangoodmanUT » Tue, Nov 19, 2024, 12:21 AM UTC

nwgo wrote: post #139

[flagged]

Because people are excited... All the positive comments didn't tip you off?

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#195

Post by gjmveloso » Tue, Nov 19, 2024, 12:32 AM UTC

Feels like FSx for Lustre without the complexity. Definitely what EFS could be.

Congrats on the launch!

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#196

Post by harshaw » Tue, Nov 19, 2024, 12:34 AM UTC

senderista wrote: post #192

If this product is successful, what prevents AWS from cloning it at a lower price (perhaps by leveraging access to their infrastructure) and putting you out of business?

There is room in storage for many kind of products with different sets of tradeoffs. And don't underestimate the ability of a startup to move much faster than AWS.

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#197

Post by Vishnu3014 » Tue, Nov 19, 2024, 12:41 AM UTC

Great product ! Congratulations on the launch !!

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#198

Post by hanslovsky » Tue, Nov 19, 2024, 12:47 AM UTC

that looks interesting. we spent a lot of money on FSxL and might save a lot with Weka. Unfortunately, our data access pattern is very random and will likely not benefit from caching unless we cache the entire dataset (100TB)

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#199

Post by bx376 » Tue, Nov 19, 2024, 1:00 AM UTC

Sounds similar to https://juicefs.com/

Re: Launch HN: Regatta Storage (YC F24) – Turn S3 into a local-like, POSIX cloud FS

#200

Post by neeleshs » Tue, Nov 19, 2024, 1:00 AM UTC

huntaub wrote: post #178

neeleshs wrote: post #176

Pretty cool. I'm excited about databases using this. Feels like Neon's PostgreSQL storage, but generalized to an FS. Is this like FUSE with a cache? How does cache invalidation work? All the best!

Yeah, I like to think of it in a similar vein. We want to empower people to create stateless workflows where they may have previously needed to think about state management. Today, Regatta is an NFS file system where the cache lives on our shared infrastructure. However, when we complete the work on our custom protocol, that will be a FUSE file system which offers additional caching on your instances to enable truly…

I am now inspired to build a toy project to learn how it all works!