Research at Sofia University >
Faculty of Mathematics and Informatics >
Papers >

Please use this identifier to cite or link to this item: http://hdl.handle.net/10506/58

Title: Query-Based Document Skimming: A User-Centred Evaluation of Relevance Profiling
Authors: Harper, David
Koychev, Ivan
Sun, Yixing
Keywords: Within-document retrieval
; Interactive information retrieval
Issue Date: 2003
Publisher: Proceedings of 25-th European Conference on Information Retrieval. Lecture Notes in Computer Science
Citation: Harper, D.J., Koychev, I. and Sun, Y. (2003). Query-Based Document Skimming: A User-Centred Evaluation of Relevance Profiling. Proceedings of 25-th European Conference on Information Retrieval. Lecture Notes in Computer Science. Springer-Verlag, Berlin, Heidelberg, New York, p. 377-392.
Abstract: We present a user-centred, task-oriented, comparative evaluation of two query-based document skimming tools. ProfileSkim bases within-document retrieval on computing a relevance profile for a document and query; FindSkim provides similar functionality to the web browser Find-command. A novel simulated work task was devised, where experiment participants are asked to identify (index) relevant pages of an electronic book, given subjects from the existing book index. This subject index provides the ground truth, against which the indexing results can be compared. Our major hypothesis was confirmed, namely ProfileSkim proved significantly more efficient than Find-Skim, as measured by time for task. Moreover, indexing task effectiveness, measured by typical IR measures, demonstrated that ProfileSkim was better than FindSkim in identifying relevant pages, although not significantly so. The experiments confirm the potential of relevance profiling to improve query-based document skimming, which should prove highly beneficial for users trying to identify relevant information within long documents.
URI: http://hdl.handle.net/10506/58
Appears in Collections:Papers

Files in This Item:

File Description SizeFormat
ECIR2003.pdf215.4 kBAdobe PDFView/Open
View Statistics

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.


Valid XHTML 1.0! DSpace Software Copyright © 2002-2010  Duraspace - Feedback