Dzmitry Bahdanau, Kyunghyun Cho, and Yoshua Bengio. Neural machine translation by jointly learning to align and translate. In Proceedings of the International Conference on Learning Representations (ICLR) 2015, San Diego, CA, USA, 2015. 15pp. Satanjeev Banerjee and Alon Lavie. Meteor: An automatic metric for MT evaluation with improved correlation with human judgments. In Proceedings of the ACL workshop on intrinsic and extrinsic evaluation measures for machine translation and/or summarization, pages 65-72, Ann Arbor, Michigan, 2005. Yonatan Belinkov and Yonatan Bisk. Synthetic and natural noise both break neural machine transla tion. arXiv preprint arXiv:1711.02173, 2017. Luisa Bentivogli, Arianna Bisazza, Mauro Cet tolo, and Marcello Federico. Neural ver sus Phrase-Based Machine Translation Quality: a Case Study. In Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pages 257-267, Austin, Texas, USA, 2016. Ondrej Bojar and Ales Tamchyna. Improving translation model by monolingual data. In Proceedings of the Sixth Workshop on Statisti cal Machine Translation, WMT@EMNLP 2011, pages 330-336, Edinburgh, Scotland, 2011. Ondrej Bojar, Rajen Chatterjee, Christian Feder Varvara Logacheva, Christof Monz, Matteo Negri, Aurelie Neveol, Mariana Neves, Martin Popel, Matt Post, Raphael Rubino, Carolina Scarton, Lucia Specia, Marco Turchi, Karin Verspoor, and Marcos Zampieri. Findings of the 2016 conference on machine translation (wmt16). In Proceedings of the First Conference on Machine Translation, Volume 2: Shared Task Papers, pages 131-198, Berlin, Germany, 2016. Ondˇrej Bojar, Rajen Chatterjee, Christian Feder mann, Barry Haddow, Matthias Huck, Chris Hokamp, Philipp Koehn, Varvara Logacheva, Christof Monz, Matteo Negri, Matt Post, Carolina Scarton, Lucia Specia, and Marco Turchi. Findings of the 2015 Workshop on Statistical Machine Translation. In Proceedings of the Tenth Workshop on Statistical Machine Trans lation, pages 1-46, Lisbon, Portugal, 2015. Sheila Castilho, Joss Moorkens, Federico Gaspari, Iacer Calixto, John Tinsley, and Andy Way. Is neural machine translation the new state of the art? The Prague Bulletin of Mathematical Lin guistics, 108(1):109-120, 2017. Kyunghyun Cho, Bart van Merriënboer, C¸a˘glar Gülc¸ehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. Learn ing phrase representations using RNN encoder- decoder for statistical machine translation. In Proceedings of the 2014 Conference on Empir ical Methods in Natural Language Processing, EMNLP 2014, pages 1724-1734, Doha, Qatar, October 2014. Association for Computational Linguistics. URL http://www.aclweb. org/anthology/D14-1179. Jonathan H. Clark, Chris Dyer, Alon Lavie, and Noah A. Smith. Better hypothesis testing for statistical machine translation: Controlling for optimizer instability. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (Volume 2: Short Papers), page 176-181, Portland, Oregon, 2011. Mattia Antonino Di Gangi, Nicola Bertoldi, and Marcello Federico. FBK's participation to the English-to-German News Translation Task of WMT 2017. In Proceedings of the Second Conference on Machine Translation, pages 271- side monolingual data for neural machine trans lation through multi-task learning. In Proceed ings of the 2017 Conference on Empirical Meth ods in Natural Language Processing, pages 1500-1505, Copenhagen, Denmark, 2017. C¸aglar Gülc¸ehre, Orhan Firat, Kelvin Xu, Kyunghyun Cho, Lo¨ıc Barrault, Huei-Chi Lin, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. On using monolingual corpora in neu ral machine translation. CoRR, abs/1503.03535, 2015. Sepp Hochreiter, Jürgen Schmidhuber, and Corso Elvezia. Long short-term memory. Neural Com putation, 9(8):1735-1780, 1997. Marcin Junczys-Dowmunt, Tomasz Dwojak, and Hieu Hoang. Is Neural Machine Translation Ready for Deployment? A Case Study on 30 Translation Directions. In Proceedings of the 9th International Workshop on Spoken Lan guage Translation (IWSLT), Seattle, WA, 2016. 8pp. Alina Karakanta, Jon Dehdari, and Josef van Gen abith. Neural machine translation for low resource languages without parallel corpora. Machine Translation, 32, 2018. 23pp. Guillaume Klein, Yoon Kim, Yuntian Deng, Jean Senellart, and Alexander M. Rush. OpenNMT: Open-Source Toolkit for Neural Machine Trans lation. In Proceedings of ACL 2017, Sys tem Demonstrations, pages 67-72, Vancouver, Canada, 2017. Philipp Koehn. Statistical significance tests for machine translation evaluation. In Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing, pages 388-395, Barcelona, Spain, 2004. Philipp Koehn. Statistical Machine Translation. Cambridge University Press, New York, NY, USA, 1st edition, 2010. Philipp Koehn and Rebecca Knowles. Six chal lenges for neural machine translation. In Pro ceedings of the First Workshop on Neural Ma chine Translation, pages 28-39, Vancouver, Canada, 2017. Chi-kiu Lo, Boxing Chen, Colin Cherry, George Foster, Samuel Larkin, Darlene Stewart, and Roland Kuhn. NRC Machine Translation Sys 330-337, Copenhagen, Denmark, 2017. Thang Luong, Hieu Pham, and Christopher D. Manning. Effective approaches to attentionbased neural machine translation. In Proceed ings of the 2015 Conference on Empirical Meth ods in Natural Language Processing, pages 1412-1421, Lisbon, Portugal, 2015. Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for automatic evaluation of machine translation. In Proceed ings of 40th Annual Meeting of the Association for Computational Linguistics, pages 311-318, Philadelphia, Pennsylvania, USA, 2002. Jaehong Park, Byunggook Na, and Sungroh Yoon. Building a neural machine translation system using only synthetic parallel data. arXiv preprint arXiv:1704.00253, 2017. Maja Popovic. chrF: character n-gram F-score for automatic MT evaluation. In Proceedings of the Tenth Workshop on Statistical Machine Transla tion, pages 392-395, Lisbon, Portugal, 2015. Spencer Rarrick, Chris Quirk, and Will Lewis. Mt detection in web-scraped parallel corpora. In Proceedings of MT Summit XIII, pages 422- 429, Xiamen, China, 2011. Rico Sennrich, Barry Haddow, and Alexandra Birch. Neural machine translation of rare words with subword units. In Proceedings of the 54th Annual Meeting of the Association for Compu tational Linguistics (Volume 1: Long Papers), pages 1715-1725, Berlin, Germany, 2016a. Rico Sennrich, Barry Haddow, and Alexandra Birch. Improving neural machine translation models with monolingual data. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 86-96, Berlin, Germany, 2016b. Rico Sennrich, Barry Haddow, and Alexandra Birch. Edinburgh Neural Machine Translation Systems for WMT 16. In Proceedings of the First Conference on Machine Translation: Vol ume 2, Shared Task Papers, pages 371-376, Berlin, Germany, 2016c. Dimitar Shterionov, Pat Nagle, Laura Casanellas, Riccardo Superbo, and Tony O'Dowd. Em pirical evaluation of nmt and pbsmt quality for large-scale translation production. In User track pages 74-79, Prague, Czech Republic, 2017. Matthew Snover, Bonnie Dorr, Richard Schwartz, Linnea Micciulla, and John Makhoul. A study of translation edit rate with targeted human annotation. In Proceedings of the 7th Conference of the Association for Machine Translation in the Americas, pages 223-231, Cambridge, Mas sachusetts, USA, 2006. Harold Somers. Round-trip translation: What is it good for? In Proceedings of the Australasian Language Technology Workshop 2005 (ALTW 2005), pages 71-77, Sydney, Australia, 2005. Ilya Sutskever, Oriol Vinyals, and Quoc V. Le. Se quence to sequence learning with neural net works. In Proceedings of Advances in Neu ral Information Processing Systems 27: An nual Conference on Neural Information Pro cessing Systems 2014, pages 3104-3112, Mon treal, Quebec, Canada, 2014. Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. Atten tion is all you need. In Proceedings of the Thirty-first Annual Conference on Neural Infor mation Processing Systems, pages 5998-6008, Long Beach, CA., USA, 2017. Andy Way. Traditional and emerging use-cases for machine translation. In Proceedings of Translat ing and the Computer 35, London, 2013. 12pp. Yonghui Wu, Mike Schuster, Zhifeng Chen, Quoc V. Le, Mohammad Norouzi, Wolfgang Macherey, Maxim Krikun, Yuan Cao, Qin Gao, Klaus Macherey, Jeff Klingner, Apurva Shah, Melvin Johnson, Xiaobing Liu, Lukasz Kaiser, Stephan Gouws, Yoshikiyo Kato, Taku Kudo, Hideto Kazawa, Keith Stevens, George Kurian, Nishant Patil, Wei Wang, Cliff Young, Jason Smith, Jason Riesa, Alex Rudnick, Oriol Vinyals, Greg Corrado, Macduff Hughes, and Jeffrey Dean. Google's neural ma chine translation system: Bridging the gap be tween human and machine translation. CoRR, abs/1609.08144, 2016.