Live data from Hacker News

Shopify has paid over $300k in security exploit bounties

hackerone.com

51–60 of 80 posts

Re: Shopify has paid over $300k in security exploit bounties

#51
post #50
post #46

Earlier quoted context omitted.

The penetration test that would have reliably generated the same outcome as this bug bounty program would have cost ~1/6th as much as the bounty did.

How many times do you need to repeat the pen test to catch new bugs in new releases?

The outcome of the project altered the design of Shopify Scripts to moot most of the bug classes people reported. So: not that often.

Re: Shopify has paid over $300k in security exploit bounties

#52
post #48

Earlier quoted context omitted.

Ahh indeed, that was kind of my initial question for the top-commentor. I'm interested in whether Shopify explored getting security consultants in to review this area before going for a bug bounty on it, or went straight to the bug bounty. My personal feeling is that the order of play should be Internal Security Review --> External Security Review --> Bug Bounty as you can use the first two stages to catch all the ba…

I think what 'xal is trying to say is that this bounty had more to do with security marketing than with accomplishing a particular tactical security goal. Their comment even concludes with a note that most or all the findings were accounted for with a sandboxing design they'd already planned.

Interesting approach to marketing, I'll give them that. Will be interesting to see how it works out for them in the medium-long term.

Re: Shopify has paid over $300k in security exploit bounties

#53
post #4
post #3

we expect most vulnerabilities will no longer be exploitable without additional bugs in the kernel or seccomp itself, and so we are lowering the payout amounts for our program to 10% of previous levels. I don't quite follow this logic. If bugs are now going to be more difficult to find, one would think they would be more valuable, not less.. and that by lowering the bounties they are lowering the incentive for people…

I suppose because the vulnerabilities would actually be vulnerabilities in someone else's code they don't feel it should come under their umbrella?

Imagine someone compromises your system and downloads the PIA of all of your customers. Does it really matter where the exploited vulnerability was in your stack? The business effect is the same: your customers are still pissed at you.

Re: Shopify has paid over $300k in security exploit bounties

#54

I don't know if it's the right place, but does anyone has feedbacks regarding the Hacker One platform? Especially for small SaaS (between 1-2M ARR)?

As someone who has used hackerone on both sides (managing and reporting bugs) I'd suggest starting a private program first. Select a small group of researches known to provide good reports and wait for them to start rolling in. Use this as a pilot, if you see value in what's being reported keep it open.

Keep in mind you're going to see a lot of reports in the beginning, it will level off as you apply fixes. You'll need to prioritize these bug fixes in your organization, if you do not fix them within a time period the researcher has the ability to disclose the bug publicly.

I recommend you review your program guidelines with a lawyer before starting it.

Re: Shopify has paid over $300k in security exploit bounties

#56
post #48

Earlier quoted context omitted.

I think what 'xal is trying to say is that this bounty had more to do with security marketing than with accomplishing a particular tactical security goal. Their comment even concludes with a note that most or all the findings were accounted for with a sandboxing design they'd already planned.

Interesting approach to marketing, I'll give them that. Will be interesting to see how it works out for them in the medium-long term.

It's security marketing, in particular: they're trying to increase engagement with their bug bounty program. A big problem bug bounty programs that run without promotion run into is that the median submission is of terrible quality, but the best submissions are so good it's hard to get them through any other vector.

If you're looking to run a bug bounty for a specific feature and want to maximize quality while minimizing effort triaging terrible submissions, I think there are much more cost-effective ways to accomplish that by structuring the bounty program (for instance: I might not run it on a platform like Hackeroni at all).

But if you're looking to run bounties for all your stuff in the future and want to maximize the likelihood that the good bounty hunters will pay attention to you to begin with, this might be a pretty cost effective way to do that.

Re: Shopify has paid over $300k in security exploit bounties

#57
post #49

I don't know if it's the right place, but does anyone has feedbacks regarding the Hacker One platform? Especially for small SaaS (between 1-2M ARR)?

I strongly urge you to find security management people at existing startups to talk to before starting a bug bounty program at your own startup. There are things about them that are good, but those things can be counterintuitive. I haven't had to manage one (yet), but because we'll no doubt be doing that for several startups this year I've been talking to friends about what their bounty programs have been like, and I…

> Frankly, bounties are something I might push back on for a lot of startups.

Care to elaborate why?

Re: Shopify has paid over $300k in security exploit bounties

#58
post #18

This wasn't unexpected outside of the extend of the bounties. What you have to realize is how important Security is to Shopify. We are a trust based business to an extreme extend. We host the livelihoods of hundreds of thousands of other businesses. If we are down or compromised all of them can't make money ( as some of you saw during Black Friday, to the tune of $300k+ a minute at times ). One of the best ways for u…

Not really related but as a Shopify customer of 5 years, we are unbelievably happy with the platform.

The thing I love the most is the customer service, we are UK based and it doesn't matter what time of day I call, I get through to someone and they are always incredibly well informed and helpful. I've never had to be transferred, it doesn't matter if I'm calling to talk through a weird DNS issue, ask what the current best way to work on our theme locally is or to simply add a specific feature from the top tier (real-time carrier rates) to our plan, the first person I speak to is the one that helps the whole way through. This is so rare with a tech, and frankly, any company and is the single biggest reason why we never look anywhere else or consider moving.

As far as stability goes we've never had an outage and never had a slow down due to high traffic even after national radio appearances.

And you're right about livelihoods being on the line - our Shopify store isn't our biggest revenue stream but it's the one that generates most of the profit as we make higher margins selling direct, if our store were to go down it would be a nightmare.

Re: Shopify has paid over $300k in security exploit bounties

#59
post #57
post #49

Earlier quoted context omitted.

I strongly urge you to find security management people at existing startups to talk to before starting a bug bounty program at your own startup. There are things about them that are good, but those things can be counterintuitive. I haven't had to manage one (yet), but because we'll no doubt be doing that for several startups this year I've been talking to friends about what their bounty programs have been like, and I…

> Frankly, bounties are something I might push back on for a lot of startups. Care to elaborate why?

I'd rather see if someone else wants to take a swing at that softball lob first.

Re: Shopify has paid over $300k in security exploit bounties

#60
The found vulnerabilities are mostly on mruby itself so it's pretty interesting.

A lot of PoC are very simple:

    a = Decimal.new
    a.initialize a
https://hackerone.com/reports/185775

    A ||= break while break
https://hackerone.com/reports/183356

    a = Symbol.new
    a.inspect
https://hackerone.com/reports/185957

etc.

Post reply on HN