Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

news.ycombinator.com

Post reply on HN
Print view View original

31–40 of 40 posts

Re: Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

#31

Post by kahrensdd »

RabbitmqGuy wrote: post #30

Is this like goreplay[1]? How are you different? 1. https://github.com/buger/goreplay

Yes, I really like goreplay and it was an early inspiration for our sidecar. It uses gopacket (like tcpdump) to collect data, we currently use the TCP proxy route because we can use TLS libraries for HTTP/S support. There are similarities in that both can collect and replay data.

One of the early observations from my co-founder Nate was there are 3 key ingredients to testing in a SOA environment [1]

* Automation

* Dependencies

* Data

While goreplay has a form of automation, it doesn't help you with dependencies (no mocking), and the data is either streamed or locked in a special file format. Of course like any open source project there's pieces of the solution but you have to assemble them. For instance there is no UI, no reports, no pass/fail assertions, no integration with CI system, etc. I'm by no means an expert, there is likely a path to combine with other open source projects to fulfill those.

Our stuff isn't perfect, but we primarily see overlap with the automation capability of Speedscale and the goreplay project.

[1] https://speedscale.com/2020/02/06/triplethreat/

(edited formatting)

Re: Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

#33

Post by ab_goat »

There's another company that has a bit of an earlier start doing this: ProdPerfect (www.prodperfect.com)

"Reach new heights with weightless test automation. ProdPerfect is the first autonomous end-to-end (E2E) regression testing solution that continuously identifies, creates, maintains, and evolves E2E test suites via data-driven, machine-led analysis of live user traffic."

Re: Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

#34

Post by 2rsf »

mleray wrote: post #13
2rsf wrote: post #10

Sounds great, for using this in a financial environment it will need an option for data anonymization, I'm not sure how can you identify what needs to anonymized without human interaction though.

You're spot on :). We got this feedback from one of our financial services alphas so we built a DLP rules engine to cover it. That wasn't enough. So we offered to integrate with Google DLP. Still no. So in the end we architected for a split-plane architecture (similar to DataBricks) so big customers can host their own data but we can manage the control stack. It's not something we're doing during the alpha but it's p…

I'm only the end user so I can't judge the details

Re: Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

#38

Post by gkapur »

ab_goat wrote: post #33

There's another company that has a bit of an earlier start doing this: ProdPerfect (www.prodperfect.com) "Reach new heights with weightless test automation. ProdPerfect is the first autonomous end-to-end (E2E) regression testing solution that continuously identifies, creates, maintains, and evolves E2E test suites via data-driven, machine-led analysis of live user traffic."

These are very different; one is clickstream based and the other sits on the networking layer.

Re: Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

#39

Post by ab_goat »

gkapur wrote: post #38
ab_goat wrote: post #33

There's another company that has a bit of an earlier start doing this: ProdPerfect (www.prodperfect.com) "Reach new heights with weightless test automation. ProdPerfect is the first autonomous end-to-end (E2E) regression testing solution that continuously identifies, creates, maintains, and evolves E2E test suites via data-driven, machine-led analysis of live user traffic."

These are very different; one is clickstream based and the other sits on the networking layer.

Whoops! Failed to read past the first paragraph. Also should have added a "similar" in there. Thanks for pointing this out.

Re: Launch HN: Speedscale (YC S20) – Automatically create tests from actual traffic

#40

Post by decentCapitalYC »

Hi Ken, I have been researching your project for a while and would love to get early talk before Demo day starts. Will attend next Mon/Tue anyways, but timing for decision is critical in YC. Wanna have more time dig into SpeedScale. Really like you guys' solution can potentially bring huge value to complicated production release (how many times SpaceX tests even just combustion chamber pressure before the real launch?:). Your solution seems really a systematic one by the 3 pillars you mentioned and also go under the hood (vs Recording. 1st principle wins). Trust your 32M antenna lesson is scary enough long lasting in memory. :) I was physics background, and yes, definitely you should learn where is Panic Button before poking around in a sophisticated lab.:)

Anyways, was trying to email you to founders at your domain but no response. Can you reply to my email? Handle is lli at my company domain (also in my profile). Would love to have a quick chat this week to get well warmed up before thee Day.

Post reply on HN