Abstract
In this paper, the effect of using semantic class overlap evidence in enhancing the passage retrieval effectiveness of question answering (QA) systems is tested. The semantic class overlap between questions and passages is measured by evoking FrameNet semantic frames using a shallow term-lookup procedure. We use the semantic class overlap evidence in two ways: i) fusing passage scores obtained from a baseline retrieval system with those obtained from the analysis of semantic class overlap (fusion-based approach), and ii) revising the passage scoring function of the baseline system by incorporating semantic class overlap evidence (revision-based approach). Our experiments with the TREC 2004 and 2006 datasets show that the revision-based approach significantly improves the passage retrieval effectiveness of the baseline system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hovy, E., Gerber, L., Hermjakob, U., Junk, M., Lin, C.-Y.: Question answering in Webclopedia. In: The Ninth Text Retrieval Conference (TREC-9), pp. 655–665 (2000)
Clarke, C.L.A., Cormack, G.V., Lynam, T.R., Li, C.M., McLearn, G.L.: Web reinforced question answering (MultiText experiments for TREC 2001). In: Tenth Text Retrieval Conference (TREC 2001), pp. 673–679 (2001)
Clarke, C.L.A., Terra, E.L.: Passage retrieval vs. document retrieval for factoid question answering. In: The 26th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval. Toronto, Canada, pp. 427–428 (2003)
Baker, C.F., Fillmore, C.J., Lowe, J.B.: The Berkeley FrameNet project. In: The 17th International Conference on Computational Linguistics (COLING 1998), pp. 86–90. Universite de Montreal, Montreal (1998)
Clarke, C.L.A., Cormack, G.V., Kisman, D., Lynam, T.: Question answering by passage selection (MultiText experiments for TREC-9). In: The Ninth Text Retrieval Conference (TREC-9), pp. 673–684 (2000)
Cormack, G., Palmer, C., Biesbrouck, M., Clarke, C.: Deriving very short queries for high precision and recall (MultiText experiments for TREC-7). In: The Seventh Text Retrieval Conference (TREC-7), pp. 121–133 (1998)
Tellex, S., Katz, B., Lin, J., Fernandes, A., Marton, G.: Quantitative evaluation of passage retrieval algorithms for question answering. In: The 26th Annual International ACM-SIGIR Conference on Research and Development in Information Retrieval. Toronto, Canada, pp. 41–47 (2003)
Fillmore, C.J.: The case for case. Universals in Linguistic Theory, 1–88 (1968)
Cook, W.A.: Case grammar theory. Georgetown University Press (1989)
Fillmore, C.J.: Frame semantics and the nature of language. In: The Annals of the New York Academy of Sciences: Conference on the Origin and Development of Language and Speech, vol. 280, pp. 20–32 (1976)
Lowe, J.B., Baker, C.F., Fillmore, C.J.: A frame-semantic approach to semantic annotation. In: SIGLEX Workshop on Tagging Text with Lexical Semantics: Why, What, and How? (1997)
Petruck, M.R.L.: Frame semantics. Handbook of Pragmatics. John Benjamins, Philadelphia (1996)
Harabagiu, S., Maiorano, S.J.: Finding answers in large collections of texts: Paragraph indexing + abductive inference. In: AAAI 1999, pp. 63–71 (1999)
Lee, Y.-S., Hwang, Y.-S., Rim, H.-C.: Variable length passage retrieval for Q&A system. In: The 14th Hangul and Korean Information Processing, pp. 259–266 (2002)
Moldovan, D., Pasca, M., Harabagiu, S., Surdeanu, M.: Performance issue and error analysis in an open-domain question answering system. The ACM Transactions on Information Systems (TOIS) 21, 113–154 (2003)
Clarke, C.L.A., Cormack, G.V., Burkowski, F.: Shortest substring ranking (MultiText experiments for TREC-4). In: The Fourth Text Retrieval Conference (TREC-4), pp. 295–304 (1995)
Clarke, C.L.A., Cormack, G.V., Tudhope, E.A.: Relevance ranking for one to three term queries. Information Processing and Management 36, 291–311 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ofoghi, B., Yearwood, J. (2009). Can Shallow Semantic Class Information Help Answer Passage Retrieval?. In: Nicholson, A., Li, X. (eds) AI 2009: Advances in Artificial Intelligence. AI 2009. Lecture Notes in Computer Science(), vol 5866. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-10439-8_59
Download citation
DOI: https://doi.org/10.1007/978-3-642-10439-8_59
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-10438-1
Online ISBN: 978-3-642-10439-8
eBook Packages: Computer ScienceComputer Science (R0)