The application of machine translation in automatic dubbing in China: A case study of the feature film Mulan

Authors

DOI:

https://doi.org/10.52034/lans-tts.v22i.771

Keywords:

automatic dubbing, FAS model, Mulan, audiovisual translation, quality assessment

Abstract

The use of artificial intelligence (AI) for audiovisual dubbing has become increasingly popular due to its ability to improve content production and dissemination. In particular, the application of machine translation (MT) to audiovisual content has resulted in more efficient and productive AI content generation. To assess the quality of MT-dubbed videos, this study proposed the use of the new FAS model. This model adapts the FAR model put forward by Pedersen (2017), with the “R (Readability)” parameter replaced with “S” to include synchrony: this amendment responds to research on dubbing quality that identifies the need to explore better methods for synchronization between audio and video. Using Mulan (Caro, 2020) – an English-language Disney feature film released in 2020 – as a case study, this article evaluates the quality of automatically dubbed videos generated by YSJ (Ren Ren Yi Shi Jie), an MT platform for audiovisual products in China. By analysing errors in functional equivalence, acceptability, and synchrony, the study assesses whether China’s latest MT engine can meet the demand for quality dubbing and improve cross-cultural communication. The findings show that whereas China’s present MT platform can generate a moderately acceptable result, there are still semantic errors, idiomaticity problems, and synchrony errors which may lead to incorrect translations and consequently possible misunderstanding by viewers. Overall, this study sheds light on the current state of AI-dubbing technology in China and highlights areas for improvement.

References

Bellés-Calvera, L., & Quintana, R. C. (2021). Audiovisual translation through NMT and subtitling in the Netflix series ‘Cable Girls’. Proceedings of the Translation and Interpreting Technology Online Conference, Online, 142–148. https://doi.org/10.26615/978-954-452-071-7_015

Burchardt, A., Lommel, A., Bywood, L., Harris, K., & Popovi?, M. (2016). Machine translation quality in an audiovisual context. Target, 28(2), 206–221. https://doi.org/10.1075/target.28.2.03bur

Bywood, L. (2020). Technology and audiovisual translation. In ?. Bogucki & Deckert, M. (Eds.), The Palgrave handbook of audiovisual translation and media accessibility (pp. 503–517). Palgrave Macmillan. https://doi.org/10.1007/978-3-030-42105-2_25

Caro, N. (Director). (2020). Mulan [Film]. Walt Disney Pictures.

Chaume, F. (2004). Synchronization in dubbing: A translational approach. In P. Orero (Ed.), Topics in audiovisual translation (pp. 35–52). John Benjamins. https://doi.org/10.1075/btl.56.07cha

González Martínez, R. (2019). Audiovisual translation: A contrastive analysis of The Lord of the Rings: The Two Towers [Bachelor’s thesis, Universidad de Valladolid]. UvA Campus Repository. https://uvadoc.uva.es/handle/10324/39485

Matamala, A. (2016). Terminological challenges in the translation of science documentaries: A case-study. Across Languages and Cultures, 11(2), 255–272. https://doi.org/10.1556/Acr.11.2010.2.7

Matamala, A., & Ortiz-Boix, C. (2016). Accessibility and multilingualism: An exploratory study on the machine translation of audio descriptions. https://doi.org/10.24310/TRANS.2016.v0i20.2059

Pedersen, J. (2017). The FAR model: Assessing quality in interlingual subtitling. The Journal of Specialised Translation, 28, 210–229.

Xiao, W., & Gao, J. (2020). ????????????——?“????”???????[Assessing machine translation quality in interlingual subtitling: A case study of ArcTime. Artificial Intelligence and Robotics Research, 2021, 10(2), 206–213. https://doi.org/10.12677/AIRR.2021.102020

Downloads

Published

13-12-2023

How to Cite

Yuan, Z., & Jin, H. (2023). The application of machine translation in automatic dubbing in China: A case study of the feature film Mulan. Linguistica Antverpiensia, New Series – Themes in Translation Studies, 22. https://doi.org/10.52034/lans-tts.v22i.771

Issue

Vol. 22 (2023): The impact of Machine Translation in the Audiovisual Translation environment: professional and academic perspectives

Section

Articles

License

Copyright (c) 2023 Zichen Yuan, Haina Jin

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.

Authors who publish with this journal agree to the following terms:

  • Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under the CC BY-NC 4.0 Deed that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal. The material cannot be used for commercial purposes.
  • Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  • Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).