Abstract
Surveys with professional translators show that there is still a lot of frustration with translation tools, especially when it comes to the integration with machine translation (MT) in classic environments. As new MT integrations are developed, it becomes important to study user experience of a variety of users. During the final assignment for a postgraduate course on machine translation and post-editing, I let students reflect on features in different translation environments. Students are introduced to Lilt, currently the only translation environment to offer interactive and adaptive MT, and are asked to compare its features to those of other environments they are familiar with. Since the integration of interactive and adaptive MT are integral to the tool, students are explicitly asked to reflect on the quality of the MT output and the perceived usefulness of these features. To better assess the adaptivity of the system, students translated two texts using Lilt: one where the MT system is additionally trained on a relevant translation memory, one with the generic MT system. In this chapter, I analyse student reports from four academic years. Results show that Lilt’s minimalist interface and particularly the interactive and adaptive elements are received positively by the students, and that Lilt could be a good tool to include in future translation technology courses, perhaps especially for students less experienced with translation technology.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Alabau, Vicent, Christian Buck, Michael Carl, Francisco Casacuberta, Mercedes García-Martínez, Ulrich Germann, and Jesús González-Rubio, et al. 2014. ‘CASMACAT: A Computer-Assisted Translation Workbench’. In Proceedings of the Demonstrations at the 14th Conference of the European Chapter of the Association for Computational Linguistics, 25–28. Gothenburg, Sweden: Association for Computational Linguistics. https://doi.org/10.3115/v1/E14-2007.
Bertoldi, Nicola, Davide Caroselli, and Marcello Federico. 2018. The ModernMT project. In Proceedings of the 21st Annual Conference of the European Association for Machine Translation, ed. Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez, Miquel Esplà-Gomis, Maja Popović, Celia Rico, André Martins, Joachim Van den Bogaert, and Mikel L. Forcada, 365. Alicante, Spain. https://aclanthology.org/2018.eamt-main.46.
Briva-Iglesias, Vicent. 2023. Translation Technologies Advancements: From Inception to the Automation Age, 137–152.
Briva-Iglesias, Vicent, Sharon O’Brien, and Benjamin R. Cowan. 2023. The impact of traditional and interactive post-editing on machine translation user experience, quality, and productivity. Translation, Cognition & Behavior 6 (1): 60–86. https://doi.org/10.1075/tcb.00077.bri.
Carl, Michael. 2012. Translog-II: A program for recording user activity data for empirical reading and writing research. In Proceedings of the Eighth International Conference on Language Resources and Evaluation (LREC’12), ed. Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Mehmet Uğur Doğan, Bente Maegaard, Joseph Mariani, Asuncion Moreno, Jan Odijk, and Stelios Piperidis, 4108–4112. Istanbul, Turkey: European Language Resources Association (ELRA). http://www.lrec-conf.org/proceedings/lrec2012/pdf/614_Paper.pdf.
Chan, Sin-wai. 2023. The development of translation technology: 1967–2023. In Routledge Encyclopedia of Translation Technology, 2nd ed. Routledge.
Chan, Venus, and Mark Shuttleworth. 2023. Teaching translation technology. In Routledge Encyclopedia of Translation Technology, 2nd ed. Routledge.
Coppers, Sven, Jan Van Den Bergh, Kris Luyten, Karin Coninx, Iulianna Van Der Lek-Ciudin, Tom Vanallemeersch, and Vincent Vandeghinste. 2018. Intellingo: An intelligible translation environment. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, 1–13. Montreal QC Canada: ACM. https://doi.org/10.1145/3173574.3174098.
Cui, Ying, Xiao Liu, and Yuqin Cheng. 2023. A comparative study on the effort of human translation and post-editing in relation to text types: An eye-tracking and key-logging experiment. SAGE Open 13 (1): 21582440231155850. https://doi.org/10.1177/21582440231155849.
Daems, Joke, and Lieve Macken. 2019. Interactive adaptive SMT versus interactive adaptive NMT: A user experience evaluation. Machine Translation 33 (1): 117–134. https://doi.org/10.1007/s10590-019-09230-z.
Denkowski, Michael. 2015. Machine translation for human translators. Thesis, Carnegie Mellon University. https://doi.org/10.1184/R1/21671609.v1.
Dillon, Andrew. 2001. User acceptance of information technology.
Dillon, Sarah, and Janet Fraser. 2007. Translators and TM: An investigation of translators’ perceptions of translation memory adoption. Machine Translation 20 (2): 67.
ELIS Research. 2023. European language industry survey 2023.
EMT Competence Framework. 2022 https://commission.europa.eu/document/download/b482a2c0-42df-4291-8bf8-923922ddc6e1_en?filename=emt_competence_fwk_2022_en.pdf. Info on publication: https://commission.europa.eu/news/updated-version-emt-competence-framework-now-available-2022-10-21_en
European Master’s in Translation. 2022. EMT annual report 2022.
Fulford, Heather, and Joaquín Granell-Zafra. 2005. Translation and technology: A study of UK freelance translators. The Journal of Specialised Translation 4 (1): 2–17.
Green, Spence, Jason Chuang, Jeffrey Heer, and Christopher D. Manning. 2014. Predictive translation memory: A mixed-initiative system for human language translation. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, 177–187. Honolulu Hawaii USA: ACM. https://doi.org/10.1145/2642918.2647408.
Kappus, Martin, and Maureen Ehrensberger-Dow. 2020. The ergonomics of translation tools: Understanding when less is actually more. The Interpreter and Translator Trainer 14 (4): 386–404. https://doi.org/10.1080/1750399X.2020.1839998.
Koehn, Philipp. 2009. A web-based interactive computer aided translation tool. In Proceedings of the ACL-IJCNLP 2009 Software Demonstrations, 17–20. Suntec, Singapore: Association for Computational Linguistics. https://aclanthology.org/P09-4005.
Lagoudaki, Elina. 2006. Translation memories survey 2006: User’s perceptions around TM usage. In Proceedings of Translating and the Computer, 28. London, UK: Aslib. https://aclanthology.org/2006.tc-1.2.
Läubli, Samuel, and Spence Green. 2019. Translation technology research and Human–Computer Interaction (HCI). In The Routledge Handbook of Translation and Technology, ed. Minako O’Hagan, 1st ed., 370–83. Abingdon, Oxon; New York, NY: Routledge (2020). https://doi.org/10.4324/9781315311258-22.
Läubli, Samuel, Patrick Simianer, Joern Wuebker, Geza Kovacs, Rico Sennrich, and Spence Green. 2020. The impact of text presentation on translator performance. http://arxiv.org/abs/2011.05978.
Macklovitch, Elliott. 2006. TransType2: The last word.
Martikainen, Hanna. 2022. Ghosts in the machine: Can adaptive MT help reclaim a place for the human in the loop?
Moorkens, Joss, and Sharon O’Brien. 2017. Assessing user interface needs of post-editors of machine translation. In Human Issues in Translation Technology, 127–148. The IATIS Yearbook. Routledge.
O’Brien, Sharon, Maureen Ehrensberger-Dow, Megan Connolly, and Marcel Hasler. 2017. Irritating CAT tool features that matter to translators. HERMES—Journal of Language and Communication in Business, 56: 145–162. https://doi.org/10.7146/hjlcb.v0i56.97229.
Pastor, Diana González. 2021. Introducing machine translation in the translation classroom: A survey on students’ attitudes and perceptions. Revista Tradumàtica. Tecnologies De La Traducció 19: 47–65. https://doi.org/10.5565/rev/tradumatica.273.
Pielmeier, Hélène, and Paul O’Mara. 2020. The state of the linguist supply chain.
Rothwell, Andrew, and Tomáš Svoboda. 2019. Tracking translator training in tools and technologies: Findings of the EMT survey 2017. Journal of Specialised Translation 32: 26.
Simianer, Patrick, Joern Wuebker, and John DeNero. 2019. Measuring immediate adaptation performance for neural machine translation. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, vol 1. Long and Short Papers, 2038–2046. Minneapolis, Minnesota: Association for Computational Linguistics. https://doi.org/10.18653/v1/N19-1206.
Su, Wenchao, and Defeng Li. 2023. The effectiveness of translation technology training: A mixed methods study. Humanities and Social Sciences Communications 10 (1): 1–12. https://doi.org/10.1057/s41599-023-02066-2.
Sun, Sanjun. 2021. Measuring the user experience of computer-aided translation systems: A comparative study. In Advances in Cognitive Translation Studies, ed. Ricardo Muñoz Martín, Sanjun Sun, and Defeng Li, 67–88. New Frontiers in Translation Studies. Singapore: Springer. https://doi.org/10.1007/978-981-16-2070-6_4.
Teixeira, Carlos, and Sharon O’Brien. 2017. Investigating the cognitive ergonomic aspects of translation tools in a workplace setting. Translation Spaces 6: 79–103. https://doi.org/10.1075/ts.6.1.05tei.
Tian, Sha, Lingxiao Jia, and Zhining Zhang. 2023. Investigating students’ attitudes towards translation technology: The status quo and structural relations with translation mindsets and future work self. Frontiers in Psychology 14: 1122612. https://doi.org/10.3389/fpsyg.2023.1122612.
Tiedemann, Jörg. 2009. News from OPUS—a collection of multilingual parallel corpora with tools and interfaces. In Recent Advances in Natural Language Processing V: Selected Papers from RANLP 2007, ed. Nicolas Nicolov, Galia Angelova, and Ruslan Mitkov, 237–248. Current Issues in Linguistic Theory. John Benjamins Publishing Company. https://doi.org/10.1075/cilt.309.19tie.
Van Brussel, Laura, Arda Tezcan, and Lieve Macken. 2018. ‘A fine-grained error analysis of NMT, SMT and RBMT Output for English-to-Dutch’. In Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). Miyazaki, Japan: European Language Resources Association (ELRA). https://aclanthology.org/L18-1600.
Vandeghinste, Vincent, Tom Vanallemeersch, Liesbeth Augustinus, Bram Bulté, Frank Van Eynde, Joris Pelemans, Lyan Verwimp, et al. 2019. Improving the translation environment for professional translators. Informatics 6 (2): 24. https://doi.org/10.3390/informatics6020024.
Wang, Xiangling, Tingting Wang, Ricardo Muñoz Martín, and Yanfang Jia. 2021. Investigating usability in postediting neural machine translation: Evidence from translation trainees. Self-Perception and Performance:’ across Languages and Cultures 22 (1): 100–123. https://doi.org/10.1556/084.2021.00006.
Yang, Yanxia, Xiangling Wang, and Qingqing Yuan. 2021. Measuring the usability of machine translation in the classroom context. Translation and Interpreting Studies 16 (1): 101–123. https://doi.org/10.1075/tis.18047.yan.
Zaretskaya, Anna, Gloria Corpas Pastor, and Miriam Seghiri. 2015. Integration of machine translation in CAT tools: state of the art, evaluation and user attitudes. SKASE Journal of Translation and Interpretation 8(1).
Zetzsche, Jost. 2015. ‘Lilt’. MultiLingual, Dec 15. https://multilingual.com/articles/lilt-2/.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Daems, J. (2024). Students’ Attitudes Towards Interactive and Adaptive Translation Technology: Four years of Working with Lilt. In: Peng, Y., Huang, H., Li, D. (eds) New Advances in Translation Technology. New Frontiers in Translation Studies. Springer, Singapore. https://doi.org/10.1007/978-981-97-2958-6_12
Download citation
DOI: https://doi.org/10.1007/978-981-97-2958-6_12
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2957-9
Online ISBN: 978-981-97-2958-6
eBook Packages: EducationEducation (R0)