Live data from Hacker News

The $5 Guerrilla User Test

blog.bumblebeelabs.com

21–30 of 49 posts

Re: The $5 Guerrilla User Test

#21
post #19
post #15

Earlier quoted context omitted.

FTA: "Bars are wonderful at segmenting by demographic. Match the bar you’re going to with the user population you want to target. Different bars will produce slightly different results but the variation is not huge."

Yeah, I don't know a bar frequented by people interested in the Semantic Web or web-crawling.

Doesn't sound like a consumer application. Given that your profile mentions 80legs, I think you're in the B2B space.

Re: The $5 Guerrilla User Test

#22
post #13

Earlier quoted context omitted.

I believe there's at least one website review service that is build on top of Mechanical Turk, if that helps any.

Thanks, that's good to know. I know someone once mentioned using Mechanical Turk and that those sometimes ended up being their most loyal users, but I cannot recall the context. Has anyone used these services and what results did you see?

Some related FeedbackArmy-related posts, including some reviews:

http://news.ycombinator.com/item?id=785489

http://news.ycombinator.com/item?id=376956

http://news.ycombinator.com/item?id=373900

Re: The $5 Guerrilla User Test

#23
post #3

I call BS on this. It has no usage what so ever. You can't test for success you can only monitor it.

I notice that you are a design professional and have written lengthy articles on interface design. The point of this article is that buying a handful of beers will improve your product design immensely, when compared to doing nothing at all. It is an amateur move that probably looks useless from a professional standpoint, but like 24-grit sandpaper, makes a rough job look more polished.

Re: The $5 Guerrilla User Test

#24
post #21
post #19

Earlier quoted context omitted.

Yeah, I don't know a bar frequented by people interested in the Semantic Web or web-crawling.

Doesn't sound like a consumer application. Given that your profile mentions 80legs, I think you're in the B2B space.

Well, that was sort of the point of my original comment. The test will work if bar-people represent your target customer base. This won't be the case for B2B products and may not be the case for some Consumer products.

Re: The $5 Guerrilla User Test

#25
I'm kind of disappointed that Steve Krug didn't think up something like this for _Rocket Surgery Made Easy_ (http://www.sensible.com/rocketsurgery/index.html); this would be a very convenient source of manpower for his model of "hallway usability testing," and would allow even larger numbers of even more easily set-up tests than the model he describes.

It's good to see how usability testing is becoming de-mythologized these days; all of us should keep in mind, for current and future program development, that you really don't need a very sophisticated apparatus.

Re: The $5 Guerrilla User Test

#26
post #13

Earlier quoted context omitted.

I believe there's at least one website review service that is build on top of Mechanical Turk, if that helps any.

Thanks, that's good to know. I know someone once mentioned using Mechanical Turk and that those sometimes ended up being their most loyal users, but I cannot recall the context. Has anyone used these services and what results did you see?

I've tried Feedback Army and was disappointed w/ the results. Not that it isn't a cool idea, but I think the give and take of a good usability test requires that it be done in person. If you watch usability expert Steve Krug doing a demo test (http://network.businessofsoftware.org/video/steve-krug-on-th...), you'll see what I mean.

Re: The $5 Guerrilla User Test

#27
Start off approaching a group of the same sex as you so that the encounter isn’t sexualized. Next, move on to a mixed sex group and then finish the night with an opposite gender interaction so you get a nice demographic spread.

I wonder if that last bit is intentionally a double-entendre. Especially since the proposed environment involves a bar.

It's an interesting technique, and I'll definitely keep the strategy in mind for future endeavors.

Re: The $5 Guerrilla User Test

#28

What other types of guerrilla testing have people tried before? This sounds like a fairly witty idea for gathering user interaction information, but I wonder if it's actually functional.

Anything run by a 3rd party strikes me as immediately questionable for accurate testing. They necessarily use people more geared towards using applications, as otherwise they wouldn't be there in the first place, getting paid to do something that most people wouldn't touch. They can certainly provide extensively useful insight, so running through a UI-review company is still a good idea, but can there really be a guerrilla testing company? The idea of guerrilla testing is to get totally untainted results, isn't it?

Re: The $5 Guerrilla User Test

#29
post #4
post #3

I call BS on this. It has no usage what so ever. You can't test for success you can only monitor it.

Why no usage what so ever? Any process of getting user's feedback is better than doing nothing. We are so skewed of using our own apps that we think all is perfect. Nothing ever is. I think its a great idea how to get more usage data. If I try it I will let you know how it went. I am thinking of using some screenrecording software like SilverBackApp to archive and analyze results later when not drunk :) Janusz Founde…

Interesting site... if it works like it appears to, I wouldn't be one of the survey testers, but I'm sure it'd nab a lot of people, enough to at least get some ideas. Good luck with it!

Re: The $5 Guerrilla User Test

#30
post #27

Start off approaching a group of the same sex as you so that the encounter isn’t sexualized. Next, move on to a mixed sex group and then finish the night with an opposite gender interaction so you get a nice demographic spread. I wonder if that last bit is intentionally a double-entendre. Especially since the proposed environment involves a bar. It's an interesting technique, and I'll definitely keep the strategy in…

The double entendre was completely unintentional. Testing against women is important but one of the big hangups a lot of people have is the sexual component. This is one technique I've discovered to help ease out of that mindset.

As a strategy for picking up women, this is somewhere down the bottom in terms of effectiveness. As it turns out, asking someone to participate in a user study is about the least sexiest thing imaginable.

Post reply on HN