Cumulated gain-based evaluation of IR techniques
Explore this paper's citation graph
Summary
This article proposes several novel measures that compute the cumulative gain the user obtains by examining the retrieval result up to a given ranked position, and test results indicate that the proposed measures credit IR methods for their ability to retrieve highly relevant documents and allow testing of statistical significance of effectiveness differences.
- Type
- article
- Published
- 2002-10-01
- Cited by
- 5,690
- References
- 44
- OpenAlex
- https://openalex.org/W2069870183
- Semantic Scholar
- https://api.semanticscholar.org/CorpusID:1981391
Keywords
Relevance (law), Computer science, Information retrieval, Precision and recall, Recall
References
- A Method for Measuring Wide Range Performance of Boolean Queries in Full-Text Databases
- Overview of the Seventh Text REtrieval Conference
- The Co-Effects of Query Structure and Expansion on Retrieval Performance in Probabilistic Text Retrieval
- Extensions to the STAIRS Study—Empirical Evidence for the Hypothesised Ineffectiveness of Boolean Queries in Large Full-Text Databases
- Text retrieval and filtering: analytic models of performance
- Evaluation of interactive information retrieval systems
- Introduction to Modern Information Retrieval
- Measures of relative relevance and ranked half-life: performance indicators for interactive IR
- Generic summaries for indexing in information retrieval
- Using statistical testing in the evaluation of retrieval experiments
- Practical Nonparametric Statistics (2nd ed.)
- Towards the Identification of the Optimal Number of Relevance Categories
- The impact of query structure and query expansion on retrieval performance
- Expected search length: A single measure of retrieval effectiveness based on the weak ordering action of retrieval systems
- Experimental components for the evaluation of interactive information retrieval systems
- Ranking in Principle
- Liberal relevance criteria of TREC -: counting on negligible documents?
- Evaluation by highly relevant documents
- Practical Nonparametric Statistics (2nd ed).
- Changes in relevance criteria and problem stages in task performance
Cited by
- Goal-driven collaborative filtering
- Functionality-Based Mobile App Recommendation by Identifying Aspects from User Reviews
- Social networks and collaborative filtering for large-scale requirements elicitation
- The Turn - Integration of Information Seeking and Retrieval in Context
- Advances in Understanding, Mining, and Using People-Tags
- Regularization methods for prediction in dynamic graphs and e-marketing applications
- Enhancing Web Search with Semantic Identification of User Preferences
- Convergence Analysis of Ranking Measures for Web Search
- WSColab: Structured Collaborative Tagging for Web Service Matchmaking
- 3D Object Retrieval via Range Image Queries based on SIFT descriptors on Panoramic Views
- INFERENCE-BASED FORENSICS FOR EXTRACTING INFORMATION FROM DIVERSE SOURCES
- FSMRank: Feature Selection Algorithm for Learning to Rank
- Adaptive dual control of topic-based information retrieval
- Differential geometry-based techniques for characterization of boundary roughness of pulmonary nodules in CT images
- Improving Content-Oriented XML Retrieval by Applying Structural Patterns
- Opportunities for Web-based Drug Repositioning: Searching for Potential Antihypertensive Agents with Hypotension Adverse Events
- A Probabilistic Model of Social Working Memory for Information Retrieval in Social Interactions
- Exploitation des contributions des usagers liées au social bookmarking pour améliorer la Recherche d'Information
- Ensemble Clustering for Result Diversification
- Seeking Variety: A Dynamic Model of Employee Blog Reading Behavior
Related papers
- Sound and complete relevance assessment for XML retrieval
- Relevance Feedback Query Refinement for PDF Medical Journal Articles
- Term proximity in document retrieval systems
- Comparison of Semantic and Syntactic Information Retrieval System on the Basis of Precision and Recall
- How similar is similar? An evaluation of "related articles" applications among health literature portals
- Proposal for an Automatic Recall Assistance System Using Face Recognition, Voice Recognition, and Conversational Content
- Using graded relevance assessments in IR evaluation
- Precision and Recall of Search Strategies for Identifying Studies on Work-Related Psychosocial Risk Factors in PubMed