Beyond the black mirror effect: the impact of machine translation in the audiovisual translation environment
DOI:
https://doi.org/10.52034/lans-tts.v22i.790Keywords:
neural machine translation, post-editing, subtitling, audiovisual translation , dubbingAbstract
In an increasingly globalized world, technological advancements and artificial intelligence (AI) have catalysed the proliferation of audiovisual productions and their translation, leading to new dynamics in the professional landscape. Tools and practices such as machine translation (MT) and post-editing (PE) are becoming widespread, augmenting and diversifying translators’ tasks and creating new professional profiles and educational needs. While some specialized fields with more restrictive languages and terminology have readily incorporated MT, recent developments in neural MT (NMT) engines have led to their use in more creative areas such as literary or audiovisual translation (AVT). However, this trend raises concerns about the quality of both the raw and the final output, user perceptions, ethics and working conditions. Academic studies which explore the convergence of MT and AVT therefore become crucial to understanding the implications of this technology for all stakeholders: professionals, students and instructors, researchers, audiences and society at large. This article delves into the impact of neural MT and other AI-based tools on AVT workflows, both professionally and academically, and stresses the need for further research in this area. It then proceeds to outline the main research directions in this field as evidenced by the contributions included in this special issue, particularly those regarding the incorporation of MT into different AVT modes.
References
AENOR (Agencia Española de Normalización) (2020). UNE-ISO 18587. Servicios de traducción. Posedición del resultado de una traducción automática. Requisitos. AENOR.
Asscher, O. (2023). The position of machine translation in translation studies. Translation Spaces, 12(1), 1–20. https://doi.org/10.1075/ts.22035.ass
Bolaños-García-Escribano, A., Díaz-Cintas, J., & Massidda, S. (2021). Latest advancements in audiovisual translation education. The Interpreter and Translator Trainer, 15(1), 1–12. https://doi.org/10.1080/1750399X.2021.1880308
Brannon, W., Virkar, Y., & Thompson, B. (2023). Dubbing in practice: A large scale study of human localization with insights for automatic dubbing. Transactions of the Association for Computational Linguistics, 11, 419–435. https://doi.org/10.1162/tacl_a_00551
Brooker, C., & Jones, A. (Executive Producers). (2011-present). Black Mirror [TV series]. Zeppotron; House of Tomorrow; Broke & Bones.
Cerezo Merchán, B., & Artusi, A. (2023). Percepciones y usos de la traducción automática por parte de los docentes de traducción audiovisual en España: Resultados del proyecto DITAPE. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. 129–150). Comares.
Chaume, F. (2012). Audiovisual translation: Dubbing. St. Jerome.
Chaume, F., & Díaz Cintas, J. (2023). Tiempos modernos: Desafíos y oportunidades de la traducción automática en los medios audiovisuales. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. xi–xii). Comares.
Cid-Leal, P., Espín-García, M.-C., & Presas, M. (2019). Traducción automática y posedición: Perfiles y competencias en los programas de formación de traductores. MonTI. Monografías de Traducción e Interpretación, 11, 187–214. https://doi.org/10.6035/monti.2019.11.7
de Higes Andino, I. (2023). Estudio del subtitulado automático bilingüe en la Comunitat Valenciana: El caso de L’Informatiu – Comunitat Valenciana de RTVE. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. 95–112). Comares.
de los Reyes Lozano, J., & Mejías-Climent, L. (2023). La norma UNE-18587 sobre posedición y traducción automática: Intersecciones con la industria del doblaje. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. 81–93). Comares.
Deryagin, M., Pošta, M., Landes, D., Wells, V., Carrington, C., Carraud, E., & Renard, E. (2021). AVTE machine translation manifesto. https://avteurope.eu/wp-content/uploads/2022/10/Machine-Translation-Manifesto_ENG.pdf
Díaz-Cintas, J. (2013). The technology turn in subtitling. In M. Thelen & B. Lewandowska-Tomaszczyk (Eds.), Translation and meaning Part 9 (pp. 119–132). Maastricht School of Translation and Interpreting.
Díaz Cintas, J., & Massidda, S. (2019). Technological advances in audiovisual translation. In M. O’Hagan (Ed.), The Routledge handbook of translation and technology (pp. 255–270). Routledge. https://doi.org/10.4324/9781315311258
Di Gangi, M., Rossenbach, N., Pérez, A., Bahar, P., Beck, E., Wilken, P., & Matusov, E. (2022). Automatic video dubbing at AppTek. Proceedings of the 23rd Annual Conference of the European Association for Machine Translation, 351–352. https://aclanthology.org/2022.eamt-1.65.pdf
do Carmo, F. (2020). ‘Time is money’ and the value of translation. Translation Spaces, 9(1), 35–57. https://doi.org/10.1075/TS.00020.CAR
do Carmo, F., & Moorkens, J. (2020). Differentiating editing, post-editing and revision. In M. Koponen, B. Mossop, I. S. Robert, & G. Scocchera (Eds.), Translation revision and post-editing: Industry practices and cognitive processes (pp. 35–49). Routledge. https://doi.org/10.4324/9781003096962-4
do Carmo, F., & Moorkens, J. (2022). Translation’s new high-tech clothes. In G. Massey, E. Huertas-Barros, & D. Katan (Eds.), The human translator in the 2020s (pp. 11–26). Routledge. https://doi.org/10.4324/9781003223344-2
ELIS (2022). European Language Industry Survey 2022. Trends, expectations and concerns of the European language industry. Directorate-General for Translation. https://elis-survey.org/
Federici, F. M., Declercq, C., Díaz Cintas, J., & Baños Piñero, R. (2023). Ethics, automated processes, machine translation, and crises. In H. Moniz & C. Parra Escartín (Eds.), Towards responsible machine translation: Ethical and legal considerations in machine translation (pp. 135–156). Springer. https://doi.org/10.1007/978-3-031-14689-3_8
Federico, M., Enyedi, R., Barra-Chicote, R., Giri, R., Isik, U., Krishnaswamy, A., & Sawaf, H. (2020a). From speech-to-speech translation to automatic dubbing. arXiv. https://doi.org/10.48550/arXiv.2001.06785
Federico, M., Virkar, Y., Enyedi, R., & Barra-Chicote, R. (2020b). Evaluating and optimizing prosodic alignment for automatic dubbing. Interspeech 2020, 1481–1485. https://doi.org/10.21437/Interspeech.2020-2983
Fernández-Torné, A., & Matamala, A. (2015). Text-to-speech vs. human voiced audio descriptions: A reception study in films dubbed into Catalan. The Journal of Specialised Translation, 24, 61–88.
Georgakopoulou, P. (2018). Technologization of audiovisual translation. In L. Pérez-González (Ed.), The Routledge handbook of audiovisual translation (pp. 516–539). Routledge. https://doi.org/10.4324/9781315717166-32
Georgakopoulou, P. (2020). The faces of audiovisual translation. The many faces of translation: from video games to the Vatican. DG TRAD Conference 2019, 16–33. https://doi.org/10.2861/898773
Georgakopoulou, P., & Bywood, L. (2014). MT in subtitling and the rising profile of the post-editor. Multilingual, 25(1), 24–28.
Guerberof Arenas, A., & Moorkens, J. (2019). Machine translation and post-editing training as part of a master’s programme. The Journal of Specialised Translation, 31, 217–238.
Hurtado Albir, A. (2019). La investigación en didáctica de la traducción: Evolución, enfoques y perspectivas. MonTI. Monografías de Traducción e Interpretación, 11(11), 47–76. https://doi.org/10.6035/monti.2019.11.2
ISO (International Organization for Standardization) (2017). ISO 18587: 2017, Translation services – Post-editing of machine translation output – requirements. ISO.
Karakanta, A., Bhattacharya, S., Nayak, S., Baumann, T., Negri, M., & Turchi, M. (2021). The two shades of dubbing in neural machine translation. Proceedings of the 28th International Conference on Computational Linguistics, 4327–4333. https://doi.org/10.18653/v1/2020.coling-main.382
Kenny, D., Moorkens, J., & do Carmo, F. (2020). Towards ethical, sustainable machine translation. Translation Spaces, 9(1), 1–11, https://doi.org/10.1075/ts.00018.int
Kottahachchi, B., & Abeysinghe, S. (2022). Overcoming the language barrier in videos with Aloud. https://blog.google/technology/area-120/aloud/
Künzli, A. (2022). How subtitling professionals perceive changes in working conditions: An interview study in German-speaking countries. Translation and Interpreting Studies, 18, 91–112. https://doi.org/10.1075/tis.20107.kun
Lakew, S. M., Federico, M., Wang, Y., Hoang, C., Virkar, Y., Barra-Chicote, R., & Enyedi, R. (2021). Machine translation verbosity control for automatic dubbing. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, 7538–7542. https://doi.org/10.48550/arxiv.2110.03847
Leiva Rojo, J. (2018). Aspects of human translation: The current situation and an emerging trend. Herm?neus: Revista de Traducción e Interpretación, 20, 257–294. https://doi.org/10.24197/HER.20.2018.257-294
Massida, S., & Sandrelli, A. (2023). ¡Sub! localisation workflows (th)at work. Translation and Translanguaging in Multilingual Contexts, 9(3), 298–315. https://doi.org/10.1075/ttmc.00115.mas
Matousek, J., & Vít, J. (2012). Improving automatic dubbing with subtitle timing optimisation using video cut detection. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). https://doi.org/10.1109/ICASSP.2012.6288395
Menezes, R. (2023). Paradójico o complementario: La revisión de subtítulos en el flujo de trabajo de traducción automática y posedición. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. 115–128). Comares.
Mejías-Climent, L., & de los Reyes Lozano, J. (Eds.). (2023). La traducción audiovisual a través de la traducción automática y la posedición: prácticas actuales y futuras. Comares.
Moniz, H., & Parra Escartín, C. (2023). Towards responsible machine translation: Ethical and Legal considerations in machine translation. Springer. https://doi.org/10.1007/978-3-031-14689-3
Moorkens, J. (2018). What to expect from neural machine translation: A practical in-class translation evaluation exercise. The Interpreter and Translator Trainer, 12(4), 375–387. https://doi.org/10.1080/1750399X.2018.1501639
Nitzke, J., Tardel, A., & Hansen-Schirra, S. (2019) Training the modern translator: The acquisition of digital competencies through blended learning. The Interpreter and Translator Trainer, 13(3), 292–306. https://doi.org/10.1080/1750399X.2019.1656410
Pedersen, J. (2017). The FAR model: Assessing quality in interlingual subtitling. The Journal of Specialised Translation, 28, 210–229.
Pérez Colomé, J. (2023, September 15). Feijóo, Belén Esteban y El Fary hablan en perfecto inglés: El doblaje automático en vídeo ya arrasa y confunde. El País. https://elpais.com/tecnologia/2023-09-15/belen-esteban-y-el-fary-hablan-en-perfecto-ingles-el-doblaje-automatico-en-video-ya-arrasa.html
Pérez González De Martos, A. M., Giménez Pastor, A., Jorge Cano, J., Iranzo Sánchez, J., Silvestre Cerdà, J. A., Garcés Díaz-Munío, G. V., Baquero Arnal, P., Sanchis, A., Civera, J., Juan, A., & Turró, C. (2022). Doblaje automático de vídeo-charlas educativas en UPV[Media]. Proceedings of the In-Red 2022 – VIII Congreso Nacional de Innovación Educativa y Docencia en Red. https://doi.org/10.4995/INRED2022.2022.15844
Pérez Macías, L. (2017). Análisis de las percepciones en torno a la práctica de la posedición en el sector profesional de la traducción en España [Unpublished doctoral dissertation]. Universidad Pablo de Olavide.
Pym, A. (2013). Translation skill-sets in a machine-translation Age. Meta: Journal des traducteurs, 58(3), 487–503. https://doi.org/10.7202/1025047ar
Rico Pérez, C. (2017). La formació de traductors en Traducció Automàtica. Tradumàtica: Traducció i Tecnologies de la Informació i la Comunicació, 15, 75–96. https://doi.org/10.5565/rev/tradumatica.200
Rico Pérez, C. (2023). Caminos convergentes en traducción audiovisual, traducción automática y posedición. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. 1–14). Comares.
Romero-Fresco, P., & Chaume, F. (2022). Creativity in audiovisual translation and media accessibility. The Journal of Specialised Translation, 78, 75–101.
Romero-Fresco, P., & Martínez, J. (2015). Accuracy rate in live subtitling: The NER Model. In J. Díaz Cintas & R. Baños Piñero (Eds.), Audiovisual translation in a global context: Mapping an ever-changing landscape (pp. 28–50). Palgrave Macmillan. https://doi.org/10.1057/9781137552891_3
Sánchez-Gijón, P. (2016). La posedición: Hacia una definición competencial del perfil y una descripción multidimensional del fenómeno. Sendebar, 27, 151–162.
Sánchez Ramos, M. M., & Rico Pérez, C. (2020). Traducción automática: Conceptos clave, procesos de evaluación y técnicas de posedición. Comares.
Sánchez Ramos, M. M., & Rico Pérez, C. (Eds.). (in press). La traducción automática en contextos especializados. Peter Lang.
Spiteri-Miggiani, G. (2023). Cloud studios and scripts: Evolving workspaces and workflows in dubbing. In C. Pena-Díaz (Ed.), The making of accessible audiovisual translation (pp. 145–175). Peter Lang.
Tam, D., Lakew, S. M., Virkar, Y., Mathur, P., & Federico, M. (2022). Isochrony-aware neural machine translation for automatic dubbing. Interspeech 2022. https://doi.org/10.21437/Interspeech.2022-11136
Taylor, S., Theobald, B. -J., & Matthews, I. (2015). A mouth full of words: Visually consistent acoustic redubbing. Proceedings of the 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 4904–4908. https://doi.org/10.1109/ICASSP.2015.7178903
Toral, A. (2020). Reassessing claims of human parity and super-human performance in machine translation at WMT 2019. Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, EAMT 2020, 185–194. https://doi.org/https://doi.org/10.48550/arXiv.2005.05738
Villanueva Jordán, I. A., & Romero-Muñoz, A. (2023). Nociones metodológicas para el análisis comparativo de traducciones automáticas para el doblaje. In L. Mejías-Climent & J. de los Reyes Lozano (Eds.), La traducción audiovisual a través de la traducción automática y la posedición: Prácticas actuales y futuras (pp. 17–36). Comares.
Wang, Y. (2023). Artificial intelligence technologies in college English translation teaching. Journal of Psycholinguistic Research, 52(5), 1525–1544. https://doi.org/10.1007/s10936-023-09960-5
Wang, Y., Liang, W., Huang, H., Zhang, Y., Li, D., & Yu, L.-F. (2021). Toward automatic audio description generation for accessible videos. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21), article 277, 1–12. https://doi.org/10.1145/3411764.3445347
Wyndham, A. (2022, December 14). The art of dubbing: As demand rises, creativity remains key. Slator. https://shorturl.at/abiyH
Yang, Y., Shillingford, B., Assael, Y., Wang, M., Liu, W., Chen, Y., Zhang, Y., Sezener, E., Cobo, L.C., Denil, M., Aytar, Y., & Freitas, N.D. (2020). Large-scale multilingual audio visual dubbing. ArXiv, abs/2011.03530. https://doi.org/10.48550/arXiv.2011.03530
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Julio de los Reyes Lozano, Laura Mejías-Climent
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under the CC BY-NC 4.0 Deed that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal. The material cannot be used for commercial purposes.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
