Evaluating Answers to Definition Questions

Summary

An initial evaluation of systems that answer questions seeking definitions suggests that humans agree sufficiently as to what the basic concepts that should be included in the definition of a particular subject are to permit the computation of concept recall.

Keywords

Computer science, Recall, Subject (documents), Quality (philosophy), Computation

References

The TREC question answering trackEllen M. Voorhees — 2001
The DUC summarization evaluationsDonna Harman, Paul Over — 2002

Cited by

A Hybrid Approach for QA Track Definitional QuestionsSasha Blair-Goldensohn, Kathleen McKeown, Andrew Hazen Schlaikjer — 2003
Producing an Encyclopedic Dictionary using Patent DocumentsAtsushi Fujii — 2008
What You Seek Is What You Get: Extraction of Class Attributes from Query LogsMarius Paşca, Benjamin Van Durme — 2007
Approaches to implement and evaluate aggregated searchArlind Kopliku — 2011
Maximum Entropy Context Models for Ranking Biographical Answers to Open-Domain Definition QuestionsAlejandro Figueroa, John Atkinson — 2011
Off-line answer extraction for question answeringJori Mur — 2008
Definitional Question-Answering Using Trainable Text ClassifiersOren Tsur — 2003
CONTEXTUAL LANGUAGE MODELS FOR RANKING ANSWERS TO NATURAL LANGUAGE DEFINITION QUESTIONSAlejandro Figueroa, John Atkinson — 2012
Learning search engine specific query transformations for question answeringEugene Agichtein, Steve Lawrence, Luis Gravano — 2001
Aggregated search: A new information retrieval paradigmArlind Kopliku, Karen Pinel-Sauvagnat, Mohand Boughanem — 2014
The role of documents vs. queries in extracting class attributes from textMarius Paşca, Benjamin Van Durme, Nikesh Garera — 2007
Tolerance Rough Set Based Attribute Extraction Approach for Multiple Semantic Knowledge Base IntegrationHongzhi Guo, Qingcai Chen, Xuan Wang — 2011
Semantically driven snippet selection for supporting focused web searchesIraklis Varlamis, Sofia Stamou — 2009
Question Answering for the Operation of Software Applications: A Document Retrieval ApproachAtsushi Fujii, Seiji Takegata — 2010
A Supervised Learning Approach to Search of DefinitionsJun Xu, Yunbo Cao, Hang Li — 2006
A Formal Model for Information Selection in Multi-Sentence Text ExtractionElena Filatova, Vasileios Hatzivassiloglou — 2004
Organizing and searching the world wide web of facts -- step two: harnessing the wisdom of the crowdsMarius Paşca — 2007
Ranking definitions with supervised learning methodsJun Xu, Yunbo Cao, Hang Li — 2005
To Click or not to Click? The Role of Contextualized and User-Centric Web SnippetsΝικόλαος Ζώτος, Paraskevi Tzekou, George Tsatsaronis — 2009
Using Question Series to Evaluate Question Answering System EffectivenessEllen M. Voorhees — 2005

Related papers

On Subject And Subject′ s ConstructionYan Gao — 2005
A Comparative Study of Subject Headings in University Libraries in KarnatakaN. S. Harinarayana, Chandrappa — 2018
The Explore of Subject Setup in Three Different Type University——An investigation of 90 UniversityFang Ze-qiang — 2013
From the ‘poverty’ of the subject to the ‘fullness’ of the subject : Lacan and Žižek’s psychoanalytical analysis of the subject concept in the film, 〈First Reformed〉Chull Lee — 2021
Hu Feng Subject View and Subject Advance Thought ProbeMeng Zeng — 2006
On the Subject of the Imperative MoodGao Li-ping — 2002
Proposal for an Automatic Recall Assistance System Using Face Recognition, Voice Recognition, and Conversational ContentShunpei Chochi, Shiyuan Yang, Seiichi Serikawa — 2023