In this poster we investigate the associations between perceived
ease of assessment of situational relevance made by a four-point
scale, perceived satisfaction with retrieval results and the actual
relevance assessments and retrieval performance made by test
collection assessors based on their own genuine information tasks.
Ease of assessment and search satisfaction are cross tabulated
with retrieval performance measured by Normalized Discounted
Cumulated Gain. Results show that when assessors find small
numbers of relevant documents they tend to regard the search
results with dissatisfaction and, in addition, they obtain lower
performance for all document types involved, except for
monographic records.