tags:

views:

34

answers:

0
+1  Q: 

Evaluating ranks with crowdsourcing

I have three ordered ranks of web pages for a set of queries and would like to decide which rank performs better across all queries. Imagine that for 50 queries I have collected the top 10 results from Google, Bing and Yahoo.

I would like to design a crowdsourcing experiment to decide which rank is better. Thanks in advance for any comment or pointers to similar problems.

related questions

Database choice for large data volume?
Evaluating software estimates: sure signs of unrealistic figures?
SSIS Package fails on execute "Integration Services evaluation period has expired"
Evaluation of an IF statement in VB.NET
Expression Evaluation in C++
Why does 1+++2 = 3 in python?
Condition evaluation in loops ?
Having to set objectives for developers, even though objectives don't work
How to do a Software usability evaluation
is it possible to print all reductions in Haskell - using WinHugs?
Parameter evaluation order before a function calling in C
What usability evaluation methods do you use?
SSRS Expression Evaluation Issue
How do I detect circular logic or recursion in a custom expression evaluator?
Are you a good or bad programmer?
How will you evaluate a programmer in a company's annual evaluation?
Most Effective Way to Evaluate Talent
How Do You Evaluate Software Development Products and Technologies?
Whats the best way to create interactive application prototypes?
How do I choose a CMS/Portal solution for a small website(s)?
How do you evaluate a Software Architect?
How Can I Know Whether I Am a Good Programmer?
How to select an SQL database?
software: when to pay, when to use free?
How would you go about evaluating a programmer?