Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Stormforger – Cloud-based Load Testing as a Service

stormforger.com

Post reply on HN
Print view View original

21–30 of 32 posts

Re: Stormforger – Cloud-based Load Testing as a Service

#21

Post by carlosdp »

evv wrote: post #14

Load testing as a service- thats a brilliant idea! But why tie yourself to Ruby? (My initial impression is "gross!", but I can't say I'm much of a language purist as I spend most of my time in JS) Would services like Stripe, Mailgun and Twilio have succeeded if they had forced their customers to use a Ruby DSL?

Heroku started with just Rails. It's better to start with one language and do it well and then expand than half-ass it with everything from JS to Erlang imo. The important part is the quality of the service and the information it provides, not the DSL.

Re: Stormforger – Cloud-based Load Testing as a Service

#23

Post by larsvegassynpro »

hnbascht wrote: post #20
evv wrote: post #14

Load testing as a service- thats a brilliant idea! But why tie yourself to Ruby? (My initial impression is "gross!", but I can't say I'm much of a language purist as I spend most of my time in JS) Would services like Stripe, Mailgun and Twilio have succeeded if they had forced their customers to use a Ruby DSL?

I saw basti's talk on stormforger at last month's interactive cologne – and I think he switched to JavaScript for the test definitions. Maybe the website is a bit outdated. :)

Indeed, the DSL is now in JavaScript.

Re: Stormforger – Cloud-based Load Testing as a Service

#25

Post by yoshida »

bigdubs wrote: post #24

How much better is this than a program like WRK on a couple laptops on different IPs?

WRK is a nice tool that can bring you quite far, for sure. But what about the orchestration of complex sessions? As I understood that blog post mentioned in another comment StormForger was actually able to play a game. A simple one, but there is still a lot of complexity involved.

But even if you can build something like this with WRK (which should be possible, due to the Lua support) you still need to setup your test environment (reproducibly), collect all the logs from the machines involved, monitor the test generators, create useful metrics from the test results and make it possible to interact with them. And I'm pretty sure I forget a whole bunch of stuff that needs to be done.

And I know, that I don't want to do all this stuff by myself. With a service providing all this, I can concentrate on the real work: Interpreting numbers and fixing problems ;-)

BTW: I'm pretty sure under the hood there is some load testing tool deployed. Cannot imagine someone runs such a large scale test without such thing.

Re: Stormforger – Cloud-based Load Testing as a Service

#26

Post by tisba »

opendais wrote: post #9
syntern wrote: post #5

Impressive. It's not their fault and they seem to be good and talented, but I can't stop thinking about a possible marketing line: "DDoS as a Service".

Normally services like this make you add a DNS record and/or file to the target to confirm you are the owner.

this is especially challenging actually. just because you own the domain name, doesn't mean you own the infrastructure you are pointing your DNS records to!

So adding DNS records is pretty useless to provide proof that you own the resources under test.

Re: Stormforger – Cloud-based Load Testing as a Service

#28

Post by lfuller »

I can't recommend Redline13 (https://www.redline13.com) highly enough. They act as a service that coordinates load testing using instances within your own AWS account.

Really easy to use, and I can run tests that used to cost upwards of $5,000 for under $5. I don't know how they aren't better known amongst DevOps types.

Re: Stormforger – Cloud-based Load Testing as a Service

#29

Post by opendais »

tisba wrote: post #26
opendais wrote: post #9

Earlier quoted context omitted.

Normally services like this make you add a DNS record and/or file to the target to confirm you are the owner.

this is especially challenging actually. just because you own the domain name, doesn't mean you own the infrastructure you are pointing your DNS records to! So adding DNS records is pretty useless to provide proof that you own the resources under test.

Yes but at that point you are theoretically traceable and can be found. It isn't like a botnet. Someone had to buy the domain.

Re: Stormforger – Cloud-based Load Testing as a Service

#30

Post by felixgallo »

mping wrote: post #22

The api looks alot like tsung. I'm almost willing to bet that either they got inspiration from it or are using it on the server. Anyway, tsung is great and these services are great too.

if you look at the 'your data - your results' piece of the carousel, it has a log which has 'pid' as a column and, e.g., '' as a value. So you're probably quite right.
Post reply on HN