… on a random sample of queries, each with a corresponding value of the relevance metric . … untrue in practice, they continue to be the basis for simplifying the evaluation problem. … reproduc- ible conclusions with less manual effort [5]. There are many specific metrics available for …