Developing a Test Collection for the Evaluation of Integrated Search
Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review
Documents
- ECIR poster2010 final
Submitted manuscript, 3.28 MB, PDF document
he poster discusses the characteristics needed in an information retrieval (IR) test collection to facilitate the evaluation of integrated search, i.e. search across a range of different sources but with one search box and one ranked result list, and describes and analyses a new test collection constructed for this purpose. The test collection consists of approx. 18,000 monographic records, 160,000 papers and journal articles in PDF and 275,000 abstracts with a varied set of metadata and vocabularies from the physics domain, 65 topics based on real work tasks and corresponding graded relevance assessments. The test collection may be used for systems- as well as user-oriented evaluation.
Original language | English |
---|---|
Title of host publication | Advances in Information Retrieval : 32nd European Conference on IR Research, ECIR 2010, Milton Keynes, UK, March 28-31, 2010, Proceedings |
Editors | Cathal Gurrin, Yulan He, Gabriella Kazai, Udo Kruschwitz, Suzanne Little, Thomas Roelleke, Stefan Rüger, Keith van Rijsbergen |
Volume | 5993 |
Publisher | Springer |
Publication date | 2010 |
Pages | 627-630 |
DOIs | |
Publication status | Published - 2010 |
Event | European Conference on IR Research - Milton Keynes, United Kingdom Duration: 28 Mar 2010 → 31 May 2010 Conference number: 32 |
Conference
Conference | European Conference on IR Research |
---|---|
Nummer | 32 |
Land | United Kingdom |
By | Milton Keynes |
Periode | 28/03/2010 → 31/05/2010 |
Series | Lecture notes in computer science |
---|---|
Number | 5993 |
ISSN | 0302-9743 |
- Test collection design, Task-based IR, Integrated search
Research areas
Number of downloads are based on statistics from Google Scholar and www.ku.dk
No data available
ID: 47047675