Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Jepsen: Redpanda 21.10.1

jepsen.io

Post reply on HN
Print view View original

21–30 of 61 posts

Re: Jepsen: Redpanda 21.10.1

#21

Post by agallego »

newman314 wrote: post #19

Redpanda (back when they were VectorizedIO) spammed my work email after I starred one of their repos, denied it after I called them out on it and I just noticed that they had deleted their response to me. Pretty sneaky to go back and delete the tweets first denying and then apologizing. Receipts: https://twitter.com/d11cc3s/status/1447573471152656389 https://twitter.com/d11cc3s/status/1450906855115354116

hi newman314 - i mentioned in the tweet this was a mistake and offered an apology there, an sdr reached out to you, when i realized that i apologize. no ill intent. feel free to test this with a fake github account. my tweets automatically delete after 6mo, all of them on a rolling window. nothing special about this interaction. there is no sneaky-ness, though feel free to disagree.

Re: Jepsen: Redpanda 21.10.1

#22

Post by excuses_ »

dhshshdhdgfff wrote: post #3

The first half is jepsen team trying to divine some actual testable guarantees from a pile of blog posts and a random Google doc. What a mess.

I wonder if Redpanda thinks about or offers some alternative protocol that would be better defined in terms of transaction guarantees. At this point it looks like Kafka’s protocol was a nice try but it needs a major refactoring.

Re: Jepsen: Redpanda 21.10.1

#23

Post by agallego »

hardwaresofton wrote: post #15
mandevil wrote: post #4

I was unfamiliar with Redpanda, and now I know and trust it. Whatever marketing budget Redpanda spent to get a Jepsen report was well worth it.

One of the clearest indications prices for a service should be raised I’ve ever seen. Can we get patio11 in here to say the thing?

interested! :D

Re: Jepsen: Redpanda 21.10.1

#24

Post by debarshri »

mandevil wrote: post #4

I was unfamiliar with Redpanda, and now I know and trust it. Whatever marketing budget Redpanda spent to get a Jepsen report was well worth it.

Thing that got my attention was that it has inline transform functions that can be added as wasm binary

Re: Jepsen: Redpanda 21.10.1

#25

Post by doommius »

Always great to read this. I preformed a jenkins test on Microsoft internal infra and it's a huge insight. From an academic side it's just as interesting looking into the lack of standards within consistently and the definitions of them.

Re: Jepsen: Redpanda 21.10.1

#26

Post by rystsov »

excuses_ wrote: post #22
dhshshdhdgfff wrote: post #3

The first half is jepsen team trying to divine some actual testable guarantees from a pile of blog posts and a random Google doc. What a mess.

I wonder if Redpanda thinks about or offers some alternative protocol that would be better defined in terms of transaction guarantees. At this point it looks like Kafka’s protocol was a nice try but it needs a major refactoring.

Documentation is a bit confusing: the protocol was evolved over time (new KIPs) and there is mismatch between the database model and kafka model. But we see a lot of potential in the Kafka transactional protocol.

At Redpanda we were able to push to 5k distributed transactions cross replicated shard. It's a mind-blowing for a database to achieve the same result.

Also Kafka transactional protocol works at low level it's very easy to build systems on top of it. For example, it's very easy to build a Calvin inspired system http://cs.yale.edu/homes/thomson/publications/calvin-sigmod1...

Re: Jepsen: Redpanda 21.10.1

#27

Post by titanomachy »

hardwaresofton wrote: post #15
mandevil wrote: post #4

I was unfamiliar with Redpanda, and now I know and trust it. Whatever marketing budget Redpanda spent to get a Jepsen report was well worth it.

One of the clearest indications prices for a service should be raised I’ve ever seen. Can we get patio11 in here to say the thing?

Do you have any information on what Jepsen charges? For all we know, it could be precisely the right amount.

Re: Jepsen: Redpanda 21.10.1

#29

Post by titanomachy »

The level of intellectual discipline and competence on display here is inspiring.

I'd love to take one of the Jepsen courses, but it seems they're offered only as corporate training. Maybe my employeer will agree to bring them in.

For now I'll have to satisfy myself with the YouTube videos.

Re: Jepsen: Redpanda 21.10.1

#30

Post by agallego »

titanomachy wrote: post #27
hardwaresofton wrote: post #15

Earlier quoted context omitted.

One of the clearest indications prices for a service should be raised I’ve ever seen. Can we get patio11 in here to say the thing?

Do you have any information on what Jepsen charges? For all we know, it could be precisely the right amount.

kyle is very friendly and I recommend reaching out. we can't and wouldn't disclose any pricing that is not public information. would be unethical on my part. all i can say is we wish to continue our work with him indefinitely as long as we keep making progress on the product :)
Post reply on HN