Hypothes.is: Taking peer review to the Internet

#1

Post by tilgovi » Sat, Nov 12, 2011, 7:21 PM UTC

Hypothes.is: Taking peer review to the Internet
kickstarter.com

Re: Hypothes.is: Taking peer review to the Internet

#2

Post by TheBiv » Sat, Nov 12, 2011, 8:24 PM UTC

I enjoy the spirit of this idea!

I simply fear that clout will ultimately drive it's growth, rather than the desire to correctly inform!

Maybe impart a "prick" score (for lack of a better term) that people can rate a comment based off of how accepting the author is at discussing their viewpoint rather than denigrating the person who has a "wrong" answer!

Best of luck!

-Ben

Re: Hypothes.is: Taking peer review to the Internet

#3

Post by tilgovi » Sat, Nov 12, 2011, 9:02 PM UTC

TheBiv wrote: post #2

I enjoy the spirit of this idea! I simply fear that clout will ultimately drive it's growth, rather than the desire to correctly inform! Maybe impart a "prick" score (for lack of a better term) that people can rate a comment based off of how accepting the author is at discussing their viewpoint rather than denigrating the person who has a "wrong" answer! Best of luck! -Ben

My understanding is that attempts will be made to algorithmically promote diversity and to reward/punish social behaviors in such as way as to discourage discursive protectionism.

Re: Hypothes.is: Taking peer review to the Internet

#4

Post by kandu » Sat, Nov 12, 2011, 9:03 PM UTC

It's a great vision, but their website does not disclose how will they implement it better than existing similar projects.

Re: Hypothes.is: Taking peer review to the Internet

#5

Post by keeptrying » Sat, Nov 12, 2011, 9:37 PM UTC

The founder previously founded GetThere.com which sold to Sabre for $757 million.

Wow.

Re: Hypothes.is: Taking peer review to the Internet

#6

Post by keeptrying » Sat, Nov 12, 2011, 9:38 PM UTC

Initially I thought this would be a free system for paper publishing which would let all new papers published to be available in public domain.

Why doesnt such a thing exist by the way?

Re: Hypothes.is: Taking peer review to the Internet

#7

Post by CarlBeckel » Sat, Nov 12, 2011, 9:45 PM UTC

keeptrying wrote: post #6

Initially I thought this would be a free system for paper publishing which would let all new papers published to be available in public domain. Why doesnt such a thing exist by the way?

I've had this same thought many times.

Re: Hypothes.is: Taking peer review to the Internet

#8

Post by 10dpd » Sat, Nov 12, 2011, 9:46 PM UTC

This is a great idea, however there is fundamental flaw in their hypothes.is, a flaw that is inherent in all comment-based sytems (Hacker News, Digg, Redit ).

The flaw is to score people based on past comments, thereby creating a meritocracy that will lead to those voices that need to be heard the most being lost in the noise.

Re: Hypothes.is: Taking peer review to the Internet

#9

Post by tilgovi » Sat, Nov 12, 2011, 10:34 PM UTC

10dpd wrote: post #8

This is a great idea, however there is fundamental flaw in their hypothes.is, a flaw that is inherent in all comment-based sytems (Hacker News, Digg, Redit ). The flaw is to score people based on past comments, thereby creating a meritocracy that will lead to those voices that need to be heard the most being lost in the noise.

That's only true under the assumption that popularity is the only factor in visibility. On hacker news that's not even true entirely because there's a temporal factor: new postings remain visible for at least a short time. However, there may exist other possible ways to artificially increase visibility in order to promote diversity. Some of these methods are the research subject of Paul Resnick at the University of Michigan who is listed as an advisor.

Re: Hypothes.is: Taking peer review to the Internet

#10

Post by CarlBeckel » Sat, Nov 12, 2011, 10:44 PM UTC

kandu wrote: post #4

It's a great vision, but their website does not disclose how will they implement it better than existing similar projects.

Their response to this concern on the FAQ at Kickstarter is as follows:

"No one has yet made an effective attempt to leverage the strengths of the Internet to improve the quality of information we consume, at the place that we consume it. In essence, we are bringing crowd-sourced peer-review to the event horizon where information is produced—the thousands of news sites and blogs on the Internet. To encourage quality, we will employ a reputation framework.

We’ve closely researched over 20 current and previous online projects such as ReframeIt, SpinSpotter, ThirdVoice, Stickis, Fleck, ShiftSpace, WebClipper, zBubbles, and others – as well as offline efforts such as FAIR and Media Matters. All have key conceptual flaws which ultimately are or were fatal limitations on their effectiveness and scalability. Hypothes.is is a direct result of our conclusion that previous efforts have missed the essential ingredients of success, and has been designed to address each of them."