Live data from Hacker News

Results from Candy Japan box design A/B test

candyjapan.com

61–70 of 98 posts

Re: Results from Candy Japan box design A/B test

#61
post #7
post #2

I much prefer the plain packaging because: - The anime picture is embarrassing to receive in the mail / at work. - The picture itself is kind of creepy, someone walking past my desk once even described it as 'rapey'. - I can reuse the box. - I am not 6.

Those are great points. I'm actually hoping to be convinced that I should stop using the new box, because it costs more. Maybe I should start calling this the plain vs. rapey test.

[deleted]

Re: Results from Candy Japan box design A/B test

#63
post #5

In a past life I founded/operated a conversion rate optimization company. One of our all time most successful tests was related to this story and happened almost by accident. The client had just rolled out new packaging and wanted help validating the change statistically, very similar to this situation. Their metric was measuring upsells to a premium product after a purchase, and like Candy Japan, found statistically…

Interesting story! I've long wondered if the (over)excited voice of many a startup's marketing/onboarding/help copy is justified by customers liking it more than the alternatives. This seems connected.

>10% bump.

>15% bump.

>40% bump in sales.

>50%+ bump in sales.

Was that cumulative (i.e., 1.1 * 1.15 * 1.4 * 1.5 ≈ 2.7 total) or relative to the base figure?

Re: Results from Candy Japan box design A/B test

#64
post #5

In a past life I founded/operated a conversion rate optimization company. One of our all time most successful tests was related to this story and happened almost by accident. The client had just rolled out new packaging and wanted help validating the change statistically, very similar to this situation. Their metric was measuring upsells to a premium product after a purchase, and like Candy Japan, found statistically…

Advertising is important to set a level of trust in the product

How many sales would Amazon have today if they went back to their 2000s website look?

The decorated box might not even have the best drawing, but indicates that the salespeople went the extra mile

Re: Results from Candy Japan box design A/B test

#65
post #15
post #5

In a past life I founded/operated a conversion rate optimization company. One of our all time most successful tests was related to this story and happened almost by accident. The client had just rolled out new packaging and wanted help validating the change statistically, very similar to this situation. Their metric was measuring upsells to a premium product after a purchase, and like Candy Japan, found statistically…

I wonder if you could have gotten a similar result from the same models holding the old box?

this is the million dollar question

Re: Results from Candy Japan box design A/B test

#67

> In a world where it makes no difference which package is sent, you would get a result as significant as this 80% of the time. I suddenly get p-values now. Why has no one ever explained it like this before?

Thank Marek Gibney of http://www.productchart.com, he contributed that line.

Re: Results from Candy Japan box design A/B test

#68
post #37

How about a plain box in some relevant color (sakura blossom pink? :) ), hand-stamped with the Candy Japan logo? In my mind's eye, that'd remain classy enough not to be creepy/cringy/embarrassing (as https://news.ycombinator.com/item?id=11641715 complains), but would also have sort of a personal touch to it. Having a couple rubber stamps made and stamping each box during packaging wouldn't probably cost an awful lot.…

[deleted]

Re: Results from Candy Japan box design A/B test

#69

> In a world where it makes no difference which package is sent, you would get a result as significant as this 80% of the time. I suddenly get p-values now. Why has no one ever explained it like this before?

I agree, I'm going to start using it unless someone can tell me that there's something wrong with or it is prone to misinterpretation.

Re: Results from Candy Japan box design A/B test

#70
post #6

Earlier quoted context omitted.

"Rapey"? Are you serious? I'm just really having trouble wrapping my head around this. How does that picture convey anything close to "rapey"?

I don't agree with the connotation, but unfortunately there are negative associations in American culture with older white men who are into anime or other Japanese cultural artifacts.

Sure, there's a certain stigma attached to anyone who enjoys Japanese culture -- older white men included. But even then, one of the words that pop into my mind when thinking about said stigma isn't rape. It's weeaboo, nerd, otaku, geek, parents basement, neckbeard, etc etc etc.... I say that as someone who enjoys japanese culture from time to time myself. Not anime, but j-dramas, movies and their music. Especially their music. It reminds me of how music was here in the 90s (not as manufactured, still a lot of experimenting going on, etc).
Post reply on HN