Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

UserTesting.com - 15 minute video of a user testing your site for $19

usertesting.com

Post reply on HN
Print view View original

21–30 of 30 posts

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#21

Post by [deleted] »

jcl wrote: post #12
run4yourlives wrote: post #7

Earlier quoted context omitted.

Why? The main deliverable in user testing is quality . It's much better to have 5 detailed pieces of data than 100 that don't say anything at all.

A smaller sample means a greater chance that it's not representative. If 10% of the population is colorblind (or left-handed, etc), you stand a greater-than-50% chance that a random group of five people won't identify a problem for this segment. A larger number of available testers means more fresh eyeballs, hence a better chance of repeat queries yielding accurate first-impression data. Feedback from people whose jo…

[deleted]

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#22

Post by kevintwohy »

robg wrote: post #13
picnichouse wrote: post #3

I've used it - really helpful. Wish they would send their testers eye tracking monitors - that would rock.

Agreed, but do they not show the cursor? Also, do they have a "more users, fewer minutes" option? I know I'd rather have 15 users for one minute each, or seven for two minutes each. After that, most users will have decided to stay or flee any ways. It would be good to get a sense of that early decision-making, especially across a statistically-reliable sample.

Tried it out -- shows the user's cursor fine in my experience.

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#24

Post by ckinnan »

wesley wrote: post #10

I love it, will definitely use this. But please add an affiliate program.

They offer a white label program:

Can our usability firm get a white label version of your service?

Yes, you can resell it to your clients with your logo (not UserTesting.com) so you can use your brand and set your pricing. Email us at resellerusertesting.com and we'll get you started.

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#25

Post by robg »

kevintwohy wrote: post #22
robg wrote: post #13

Earlier quoted context omitted.

Agreed, but do they not show the cursor? Also, do they have a "more users, fewer minutes" option? I know I'd rather have 15 users for one minute each, or seven for two minutes each. After that, most users will have decided to stay or flee any ways. It would be good to get a sense of that early decision-making, especially across a statistically-reliable sample.

Tried it out -- shows the user's cursor fine in my experience.

Cool. They could just give their testers instructions to use the cursor as a pointer to where they're looking. Or you could put that in your instructions to them. It's a decent enough proxy for eye movements any ways.

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#26

Post by [deleted] »

jcl wrote: post #5
staunch wrote: post #4

I've used it and it is good. Highly recommended. The videos you get aren't super great quality but they're useful and the price is right. The only complaint I have is that I'm a tad jealous I didn't start this site.

I wonder if one couldn't put together a software package that Mechanical Turk participants could use to generate similar (if lower-quality) data?

[deleted]

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#27

Post by raffi »

jcl wrote: post #5
staunch wrote: post #4

I've used it and it is good. Highly recommended. The videos you get aren't super great quality but they're useful and the price is right. The only complaint I have is that I'm a tad jealous I didn't start this site.

I wonder if one couldn't put together a software package that Mechanical Turk participants could use to generate similar (if lower-quality) data?

FYI, I've already done this. I started the project last week and am still testing it (it works though). http://www.feedbackarmy.com/

Visit the site, give it your URL and some specifics to focus on, dump a credit card number into paypal, and subscribe to an RSS feed for the results.

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#28

Post by bemmu »

plaggypig wrote: post #14

Can anybody share a video session that they themselves commissioned? I'd like to see how the quality of feedback compares with the "official" demo of tripadvisor. P.S. Somebody else mentioned eye tracking - I think commercial solutions for this are pretty expensive, but I've seen a few hobbyists roll their own using low cost webcams, though I'm not sure how they fair in terms of accuracy. P.P.S. And somebody else men…

It's possible from Javascript without extensions. I did a prototype of this, and while streaming the mouse x&y coords to a server was trivial, the hard part was making sure that what the user is seeing is the same layout I'm seeing myself.

For example if the user has a larger font size, then the layout might be different, so those coordinates would not mean what I think they mean. Faced with this I abandoned my own project on this, but I noticed that sites like http://robotreplay.com/ have appeared, not sure how they dealt with that issue.

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#29

Post by laut »

robg wrote: post #25
kevintwohy wrote: post #22

Earlier quoted context omitted.

Tried it out -- shows the user's cursor fine in my experience.

Cool. They could just give their testers instructions to use the cursor as a pointer to where they're looking. Or you could put that in your instructions to them. It's a decent enough proxy for eye movements any ways.

Have you seen footage from an eye tracking session? A user can't explain or point his mouse to where he is looking. The eyes move quickly and somewhat unconsciously.

Re: UserTesting.com - 15 minute video of a user testing your site for $19

#30

Post by jcl »

raffi wrote: post #27
jcl wrote: post #5

Earlier quoted context omitted.

I wonder if one couldn't put together a software package that Mechanical Turk participants could use to generate similar (if lower-quality) data?

FYI, I've already done this. I started the project last week and am still testing it (it works though). http://www.feedbackarmy.com/ Visit the site, give it your URL and some specifics to focus on, dump a credit card number into paypal, and subscribe to an RSS feed for the results.

Ha, that's great. I was thinking more along the lines of a piece of software that runs alongside the Turker's browsing session and keeps track of what they see and what they do with the mouse cursor, perhaps augmented by a video of the user's face taken by webcam, if available. But even simple feedback -- as you have built -- is extremely useful.
Post reply on HN