Introducing S2 • Hacker News Board

Re: Introducing S2

#71

Post by ivankelly » Sat, Dec 21, 2024, 7:49 PM UTC

alanfranz wrote: post #9

ms7892 wrote: post #3

Can someone tell me what does this do? And why its better.

Sort of serverless Kafka, which natively uses object storage and promises better latencies than things like warpstream.

A interesting difference is the ability to have exclusive access to writes on the log (the fencing token). This allows you to use the logs as write ahead logs.

Re: Introducing S2

#72

Post by nsxwolf » Sat, Dec 21, 2024, 7:49 PM UTC

do_not_redeem wrote: post #26

shikhar wrote: post #18

Earlier quoted context omitted.

(Founder) well 50% of our name is different

You should have gone with S4 tbh. The suits love bigger numbers. Super Simple Stream Store.

How do you store a stream? Don’t they just spray around the internet here and there, and if you don’t catch them in the moment, they’re just gone?

Re: Introducing S2

#73

Post by shikhar » Sat, Dec 21, 2024, 7:50 PM UTC

adverbly wrote: post #31

Seems really good for IoT no? Been a while since I worked in that space, but having something like this would have been nice at the time.

(Founder) so many possibilities! That's what I love about building building blocks. I think we will create an open source layer for an IoT protocol over time (unless community gets to it first), e.g. MQTT. I have to admit I don't know too much about the space.

Re: Introducing S2

#74

Post by jaredwiener » Sat, Dec 21, 2024, 7:52 PM UTC

smitty1e wrote: post #34

do_not_redeem wrote: post #26

Earlier quoted context omitted.

You should have gone with S4 tbh. The suits love bigger numbers. Super Simple Stream Store.

Disagree. You have a marketing opportunity for a hipster character named "Stu" to be the spokesman.

Disco Stu don't advertise

Re: Introducing S2

#75

Post by nfm » Sat, Dec 21, 2024, 7:58 PM UTC

solatic wrote: post #20

Help me understand - you build on top of AWS, which charges $0.09/GB for egress to the Internet, yet you're charging $0.05/GB for egress to the Internet? Sounds like you're subsidizing egress from AWS? Or do you have access to non-public egress pricing?

List pricing is $0.05 per GB after 150TB and at high volume it’s cheaper than that

Re: Introducing S2

#76

Post by srik » Sat, Dec 21, 2024, 8:10 PM UTC

8n4vidtmkvmk wrote: post #38

shikhar wrote: post #22

Earlier quoted context omitted.

(Founder) We are not charging in preview. At the scale where it matters, we will work it out. Definitely some assumptions in here.

Just FYI, that doesn't give me confidence in the longevity of your service.

Cloud services offer giant discounts sometimes and the receiving party aren't allowed to talk about it concretely so that's probably what's happening here.

Re: Introducing S2

#77

Post by rcpt » Sat, Dec 21, 2024, 8:24 PM UTC

iambateman wrote: post #16

These folks knowingly chose to spend the rest of their careers explaining that they are not, in fact, S3.

Or this

https://github.com/google/s2geometry

Re: Introducing S2

#78

Post by MicolashKyoka » Sat, Dec 21, 2024, 8:28 PM UTC

solatic wrote: post #20

Help me understand - you build on top of AWS, which charges $0.09/GB for egress to the Internet, yet you're charging $0.05/GB for egress to the Internet? Sounds like you're subsidizing egress from AWS? Or do you have access to non-public egress pricing?

strat is likely just get users, then offboard aws if the product works.

Re: Introducing S2

#79

Post by ethbr1 » Sat, Dec 21, 2024, 8:30 PM UTC

edoceo wrote: post #67

blipvert wrote: post #63

Earlier quoted context omitted.

Why not just use SS? There can’t possibly be any negative connotations there.

Reserved by GM for the Super Sport

So that's why GM has been asking itself "Are we the baddies?" lately.

Re: Introducing S2

#80

Post by agallego » Sat, Dec 21, 2024, 8:32 PM UTC

shikhar wrote: post #44

shikhar wrote: post #17

Earlier quoted context omitted.

(Founder here) Managed cloud offerings for streaming limit ordered throughput pretty low, e.g. Kinesis at 1 MiBps, Redpanda serverless at 1 MiBps, Confluent's even higher-end clusters at 10-20 MiBps IIRC. If you really need ordering, this can indeed be a limit. S2 lets you push 125 MiBps currently, and we may grow that. Another factor is how many ordered streams you can have. Typically a few thousand at most with tho…

@agallego Yes in aggregate both Confluent and Redpanda can push GiBps throughputs, and I know Redpanda has amazing perf. I was referring to Redpanda Serverless :) And per-partition i.e. ordered throughput. ED: for some reason I wasn't seeing the reply link before on your comment, do see it now.

coo cool right on.