Improving multi-choice question answering by identifying essential terms in questions
Journal Title: Revista Romana de Interactiune Om-Calculator - Year 2018, Vol 11, Issue 2
Abstract
This paper describes a method for identifying the most relevant or essential terms in a question: the words that define the meaning of the question and whose removal makes it impossible to be answered correctly even by human agents. We use an artificial neural network architecture built upon semantic and syntactic features extracted from the question. The neural network prediction represents the degree to which the given term is essential to the question. The model has been trained and validated on a dataset consisting of 2233 questions and about human 18000 labeled terms with essentialness information. It achieves an F1 score of 0.80 which is similar to other state-of-the-art approaches but requires fewer features (15 compared to 120 features used by similar works) and is much easier to train. We further show how using only essential term information can improve the accuracy of a multi-choice question answering system, based on standard information retrieval (IR) techniques, by up to 4%.
Authors and Affiliations
George-Sebastian Pirtoaca, Stefan Ruseti, Traian Rebedea
Keywords
Related Articles
- EP ID EP673684
- DOI -
- Views 159
- Downloads 0
Usability Evaluation of Gesture-Based Interactions using a Smart Watch
This paper describes the testing methodology applied and the results obtained in evaluating the usability of a system for gesture recognition based on a smartwatch and a mobile phone. The data acquisition is performed us...
Computer Assisted Music Composition
The belief that computers cannot play a central role in music composition is wrong. Research has been conducted in this field for over 50 years. In this paper, we propose an application which can be of real help to a com...
Ranking of comments published on YouTube using natural language processing techniques
Publishing of comments is a form of interaction that has become an important part of the Social Web phenomenon. Comments are enhancing online interaction, however their visualization and ranking becomes extremely difficu...
An analysis of the quality and accessibility of suicide information available to the romanian-speaking user
As the potential impact of Internet use on suicidal behaviour is currently under questioned, experts have yet not conclusively ruled on the extent of this problem. At the moment, no one really knows what kind of informat...
Video Game Development Concepts
he paper represents a case study which provides an overview of the main concepts regarding the development of video games, and of the methods used by independent game developers to put these concepts into practice. The n...