Bicici, Ergun ORCID: 0000-0002-2293-2031 and van Genabith, Josef ORCID: 0000-0003-1322-7944 (2013) CNGL: Grading student answers by acts of translation. In: SEMEVAL, 14-15 Jun 2013, Atlanta, Georgia.
Abstract
We invent referential translation machines (RTMs), a computational model for identifying the translation acts between any two data sets with respect to a reference corpus selected in the same domain, which can be used for automatically grading student answers. RTMs make quality and semantic similarity judgments possible by using retrieved relevant training data as interpretants for reaching shared semantics. An MTPP (machine translation performance predictor) model derives features measuring the closeness of the test sentences to the training data, the difficulty of translating them, and the presence of acts of translation involved. We view question answering as translation from the question to the answer, from the
question to the reference answer, from the answer to the reference answer, or from the question and the answer to the reference answer. Each view is modeled by an RTM model, giving us a new perspective on the ternary relationship between the question, the answer, and the reference answer. We show that all RTM models contribute and a prediction model based on all four perspectives performs the best. Our prediction model is the $2$nd best system on some tasks according to the official
results of the Student Response Analysis (SRA 2013) challenge.
Metadata
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Event Type: | Workshop |
Refereed: | Yes |
Uncontrolled Keywords: | computational semantics; machine translation; machine learning; computational linguistics |
Subjects: | Computer Science > Computational linguistics Computer Science > Machine translating Computer Science > Machine learning Computer Science > Artificial intelligence Computer Science > Information retrieval |
DCU Faculties and Centres: | Research Institutes and Centres > Centre for Next Generation Localisation (CNGL) DCU Faculties and Schools > Faculty of Engineering and Computing > School of Computing |
Published in: | Proceedings of *SEM 2013: The Second Joint Conference on Lexical and Computational Semantics and Proceedings of the Seventh International Workshop on Semantic Evaluation (SemEval 2013). . |
Official URL: | http://www.cs.york.ac.uk/semeval-2013/ |
Use License: | This item is licensed under a Creative Commons Attribution-NonCommercial-Share Alike 3.0 License. View License |
ID Code: | 18563 |
Deposited On: | 10 Jul 2013 08:55 by Mehmet Ergun Bicici . Last Modified 19 Jan 2022 12:41 |
Documents
Full text available as:
Preview |
PDF (CNGL: Grading Student Answers by Acts of Translation)
- Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
194kB |
Downloads
Downloads
Downloads per month over past year
Archive Staff Only: edit this record