Login | Register

Using Translation Tools for L2-Learning in a Self-Regulated Environment

Title:

Using Translation Tools for L2-Learning in a Self-Regulated Environment

Hendry, Clinton (2023) Using Translation Tools for L2-Learning in a Self-Regulated Environment. PhD thesis, Concordia University.

[thumbnail of Hendry_PhD_S2023.pdf]
Preview
Text (application/pdf)
Hendry_PhD_S2023.pdf - Accepted Version
Available under License Spectrum Terms of Access.
1MB

Abstract

The goal of this dissertation is to investigate the use of Google Translate (GT), a free online translation software that includes translation, Text-to-Speech (TTS), and Automatic Speech Recognition (ASR) functionalities, for online self-regulated learning of Mandarin Chinese within an interactionist approach. It also explores how GT can be used for pedagogical purposes within a complex learning environment that combines computer-assisted language learning (CALL), online self-regulated learning (SRL), and informed by interactionist theories. This dissertation begins with a review of the literature around the importance of interaction in language learning, followed by how a fully online interactionist approach using GT as a language partner and interlocutor allows learners to practice language use whenever and wherever they please (Chapter 1). Next, the dissertation contains three manuscript-based chapters (Chapters 2, 3, and 4) and a concluding chapter (Chapter 5). Each manuscript explores one aspect of using GT for pedagogical purposes by addressing the following overarching research questions: 1) Can GT provide the necessary computer-assisted interaction including input, output, and feedback to promote second language (L2) learning (Manuscripts 1 and 2), and 2) Are learners willing and able to use GT in an online, self-regulated environment for the learning of Mandarin and its associated tones? (Manuscript 3).
The first manuscript investigates the use of GT’s TTS as a source of Mandarin Chinese input when compared with a native speaker in terms of Intelligibility (how much is understood), Comprehensibility (how challenging something is to be understood), and Naturalness (how much does a synthesized voice differ from a human speaker). The second manuscript further explores GT’s ability to interact with a human interlocutor by investigating how much Mandarin Chinese speech can GT recognize at various language levels (intermediate, advanced, and native) and whether it can provide transcriptions accurate enough to be used as feedback by the language learner. The third and final manuscript investigate the pedagogical feasibility of using GT and its built-in features (translation, TTS, ASR) in an online, self-regulated environment by exploring how a small group of participants acquire language features, develop self-regulated learning strategies, and perceive the GT-enhanced pedagogical environment as a venue for language learning.
This dissertation will contribute to the literature around using translation, TTS, and ASR software for language learning, as well as interaction theories, SRL, CALL, and the acquisition of Mandarin Chinese in general. This research innovates on existing online language learning research and interactionist approaches by positioning GT as an interlocutor despite its intrinsic limitations (it is after all, not a human). This dissertation will further help guide future research into how human beings can interact with computers for language learning and will only become more relevant as translation, TTS, and ASR software becomes more intelligent, capable, and life-like.

Divisions:Concordia University > Faculty of Arts and Science > Education
Item Type:Thesis (PhD)
Authors:Hendry, Clinton
Institution:Concordia University
Degree Name:Ph. D.
Program:Education
Date:21 January 2023
Thesis Supervisor(s):Cardoso, Walcir
Keywords:text-to-speech synthesis, TTS, automatic speech recognition, ASR, self-regulated learning, translation, L2 pronunciation, Mandarin Chinese
ID Code:991740
Deposited By: CLINTON HENDRY
Deposited On:21 Jun 2023 14:20
Last Modified:21 Jun 2023 14:20

References:

Abdullah, F. & Ward, R. (2016). Developing a general extended technology acceptance model or e-learning (GETAMEL) by analysing commonly used external factors. Computers in Human Behavior, 56, 238–256.
Alphabet Inc. (2020). Google Translate. Retrieved April 2nd, 2020.
Al-Adwan, A. S. (2020). Investigating the drivers and barriers to MOOCs adoption: The perspective of TAM. Education and Information Technologies, 25, 5771–5795.
Andrade, M. & Bunker E. (2009). A model for self-regulated distance language learning. Distance Education, 30(1), 47–61.
Baker, R., D’Mello, S., Rodrigo, M. & Graesser, A. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computer-based learning environments. International Journal of Human-Computer Studies, 68(4), 223–241.
Barrett, A., Pack, A., Guo, Y., & Wang, N. (2020). Technology acceptance model and multi-user virtual reality learning environments for Chinese language education. Interactive Learning Environments, 1–18.
Bibauw, S., François, T., & Desmet, P. (2015). Dialogue-based CALL: An overview of existing research. In F. Helm, L. Bradley, M. Guarda, & S. Thouësny (Eds.), Critical CALL – Proceedings of the 2015 EUROCALL Conference, Padova, Italy (pp. 57–64). Dublin: Research-publishing.net. https://doi.org/10.14705/rpnet.2015.000310
Bione, T., & Cardoso, W. (2020). Synthetic voices in the foreign language context. Language Learning & Technology, 24(1), 169–186.
Cardoso, W. (2018). Learning L2 pronunciation with a text-to-speech synthesizer. In P. Taalas, L. Bradley, and S. Thouësny (Eds.), Language Learning as Exploration and Encounters; Selected papers from EuroCALL (pp. 16–21). Research-publishing.net.
Cardoso, W. (2022). Technology for Speaking Development. In T. Derwing, M. Munro, & R. Thomson (Eds), Routledge Handbook on Second Language Acquisition and Speaking (p. 299-313). Routledge, Taylor & Francis Group.
Cardoso, W., Collins, L., & White, J. (2012). Phonological input enhancement via text-to-speech synthesizers: The L2 acquisition of English simple past allomorphy [conference presentation]. AAAL 2012, Boston, MA, United States.
Cardoso, W., Smith, G., & Garcia Fuentes, C. (2015). Evaluating text-to-speech synthesizers. In F. Helm, L. Bradley, M. Guarda, & S. Thouseny (Eds.), Proceedings of Eurocall (pp. 108–113). Research-publishing.net.
Celce-Murcia, M., Brinton, D., & Goodwin, J. (2010). Teaching pronunciation: A course book and reference guide (2nd ed.). Cambridge University Press.
Chao, Y. (1968). A grammar of spoken Chinese. Los Angeles: University of California Press.
Chapelle, C. (2001). Computer applications in second language acquisition: Foundations for teaching, testing and research. Cambridge University Press.
Chapelle, C. (2003). English language learning and technology. John Benjamins.
Chapelle, C. (2005). Interactionist SLA theory in CALL research. In J. Egbert and G. Petrie (Eds.), Research perspectives on CALL (pp. 53–64). Laurence Erlbaum Associates.
Chapelle, C. A. & Jamieson, J. (2008). What is Call? In C. A. Chapelle & J. Jamieson (Eds.), Tips for teaching with CALL: Practical approaches to computer-assisted language learning (pp. 1–9). Pearson Education.
Chen, N. F., Shivakumar, V., Harikumar, M., Ma, B. & Li, H. (2013). Large-scale characterization of mandarin pronunciation errors made by native speakers of European languages. Proceedings of Interspeech 2013, France, 2370–2374.
Collins, L. & Muñoz, C. (2016). The foreign language classroom: Current perspectives and future considerations. The Modern Language Journal, 100, 133–147.
Dabbagh, N. & Kitsantas, A. (2005). Using web-based pedagogical tools as scaffolds for self-regulated learning. Instructional Science, 33, 513–540.
Davis, F. D. (1989). Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Quarterly, 13(3), 319–340.
De Paepe, L., Zhu, C., & Depryck, K. (2018). Online language teaching: Teacher perceptions of effective communication tools, required skills and challenges of online teaching. Journal of Interactive Learning Research, 29(1), 129–142.
Delogu, C., Conte, S., & Sementina, C. (1998). Cognitive factors in the evaluation of synthetic speech. Speech Communication, 24(2), 153–168.
Dembo, M., Junge, L., & Lynch, R. (2006). Becoming a self-regulated learner: Implications for web-based education. In H. F. O’Neil & R. S. Perez (Eds.), Web-based learning: Theory, research, and practice (pp. 185–202). Lawrence Erlbaum.
Derwing, T. & Munro, M. (2009). Putting accent in its place: Rethinking obstacles to communication. Language Teaching, 42(4), 476–490.
Derwing, T., Munro, M., & Carbonaro, M. (2000). Does popular speech recognition software work with ESL speech? TESOL Quarterly, 34(3), 592–603.
Deterding, S., Dixon, D., Khaled, R., & Nacke L. (2011). From game design elements to gamefulness: Defining “Gamification”. MindTrek '11: Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, 9–15.
Dizon, G. (2020). Evaluating intelligent personal assistants for L2 listening and speaking development. Language Learning & Technology, 24(1), 16–26.
Egbert, J. & Shahrokni, S. A. (2018). CALL principles and practices. OER. Retrieved from https://opentext. wsu. edu/call/chapter/principles-of-call.
Ellis, N. C. (1999). Cognitive approaches to SLA. Annual Review of Applied Linguistics, 19, 22–42.
Ellis, N. C. (2002). Frequency effects in language processing: A review with implications for theories of implicit and explicit language acquisition. Studies in Second Language Acquisition, 24(2), 143–188.
Ellis, N. C. (2012). Formulaic language and second language acquisition: Zipf and the phrasal teddy bear. Annual Review of Applied Linguistics, 32, 17–44.
Erlam, R. & Tolosam, C. (2022). Pedagogical realities of implementing task-based language teaching. Benjamins.
Flege J. (1999) The relation between L2 production and perception. In: Ohala J, Hasegawa Y, Ohala M, Granville D, and Bailey A (Eds.), Proceedings of the XIV International Congress of the Phonetic Sciences: Volume 2 (pp. 1273–76). University of California.
Foote, J., Trofimovich, P., Collins, L., & Soler Urzúa, F. (2013). Pronunciation teaching practices in communicative second language classes. The Language Learning Journal, 44(2), 1–16.
Forsyth, C., Luce, C., Zapata-Rivera, D., Jackson, G., Evanini, K., & So, Y. (2019). Evaluating English language learners’ conversations: Man vs. machine. Computer-assisted Language Learning, 32(4), 398–417.
Gass, S. (1997). Input, interaction and the second language learner. Lawrence Erlbaum Associates.
Gibbons, P. (2002). Scaffolding language, scaffolding learning. Heinemann.
Godwin-Jones, R. (2015). The evolving roles of language teachers: Trained coders, local researchers, global citizens. Language Learning & Technology, 19(1), 10–22.
Goldschneider, J. M. & DeKeyser, R. M. (2001). Explaining the “Natural order of L2 morpheme acquisition” in English: A meta-analysis of multiple determinants. Language Learning, 51(1), 1–50.
Hadwin, A. F. & Winne, P. H. (2001). CoNoteS2: A software tool for promoting self-regulation. Educational Research and Evaluation, 7(2), 313–334.
Hakuta, K. & D’Andrea, D. (1992). Some properties of bilingual maintenance and loss in Mexican background high school students. Applied Linguistics, 13(1), 72–99.
Halle, P., Chang, Y., & Best, C. T. (2004). Identification and discrimination of mandarin Chinese tones by mandarin Chinese vs. French listeners. Journal of Phonetics, 32(3), 395–421.
Hamari, J., Koivisto, J., & Sarsa, H. (2014). Does Gamification work? A literature review of empirical studies on Gamification. In R. H. Sprague (Ed.), Proceedings of the 47th Annual Hawaii International Conference on System Sciences (pp. 3025–3034). IEEE.
Hatch, E. M. (1978). Discourse analysis and second language acquisition. In E. Hatch (Ed.), Second language acquisition: A book of readings (pp. 401–435). Newbury House.
Hendry, C. (2017). The effects of type of instruction on the initial stages of L2 perception and production of tones in Mandarin Chinese (Unpublished MA thesis). Concordia University, Montreal.
Hsu, L. (2016). An empirical examination of EFL learners' perceptual learning styles and acceptance of ASR-based computer-assisted pronunciation training. Computer-assisted Language Learning, 29(5), 881–900.
Isaacs, T. & Thomson, R. I. (2013). Rater Experience, Rating Scale Length, and Judgments of L2 Pronunciation: Revisiting Research Conventions. Language Assessment Quarterly, 10(2), 135–159.
Kang, O., Moran, M., Ahn, H. & Park, S. (2020). Proficiency as a mediating variable of intelligibility for different varieties of accents. Studies in Second Language Acquisition, 42, 471–487.
Kennedy, S. & Trofimovich, P. (2008). Intelligibility, Comprehensibility, and Accentedness of L2 Speech: The Role of Listener Experience and Semantic Context. The Canadian Modern Language Review, 64(3), 459–489.
Krashen, S. D. (1982). Principles and practice in second language acquisition. Pergamon.
Larsen-Freeman, D. (2009). Adjusting expectations: The study of complexity, accuracy, and fluency in second language acquisition. Applied Linguistics, 30(4), 579–589.
Levis, J. (2018). Intelligibility, oral communication, and the teaching of pronunciation. Cambridge University Press.
Liakin, D., Cardoso, W., & Liakina, N. (2015). Learning L2 pronunciation with a mobile speech recognizer: French /y/. CALICO Journal, 32(1), 1–25.
Liakin, D., Cardoso, W. & Liakina, N. (2017a). The pedagogical use of mobile speech synthesis (TTS): Focus on French liaison. Computer-assisted Language Learning, 30(3–4), 348–365.
Liakin, D., Cardoso, W. & Liakina, N. (2017b). Mobilizing instruction in a second-language context: Learners’ perceptions of two speech technologies. Languages, 2(11), 1–21.
Lightbown, P. M. & Spada, N. (2013). How languages are learned. Oxford University Press.
Li, C., & Thompson, S. (1976). The acquisition of tone in Mandarin-speaking children. Journal of Child Language, 4, 185–99.
Li, R., Meng, Z., Tian, M., Zhang, Z., Ni, C., & Xiao, W. (2019). Examining EFL learners’ individual antecedents on the adoption of automated writing evaluation in China. Computer-assisted Language Learning, 32(7), 784–804.
Liu, Y. (2000). Focus on form as a pedagogical framework for fostering a native-like mandarin tonal identification system. Language and Linguistics, 12(3), 627–667.
Long, M. H. (1983). Native speaker/non-native speaker conversation and the negotiation of comprehensible input. Applied Linguistics, 4(2), 126–141.
Long, M. H. (1996). The role of linguistic environment in second language acquisition. In W. C. Ritchie & T. K. Bhatia (Eds.), Handbook of second language acquisition (pp. 413–468). Academic Press.
Luc, G. & Bialystok, E. (2013). Bilingualism is not a categorical variable: Interaction between language proficiency and usage. Journal of Cognitive Psychology, 25(5), 605–621.
Lyster, R. & Ranta, L. (1996). Corrective feedback and learner uptake. Studies in Second Language Acquisition, 19(1), 37–66.
Lyster, R., Saito, K., & Sato, M. (2013). Oral corrective feedback in second language classrooms. Language Teaching, 46(1), 1–40.
Ma, L. & Lee, C-S. (2017). Investigating the adoption of MOOCs: A technology-user-environment perspective. Journal of Computer-assisted Learning, 35, 89–98.
Mackey, A., & Goo, J. (2007). Interaction research: A meta-analysis and research synthesis. In A. Mackey (Ed.), Conversational interaction in second language acquisition: A collection of empirical studies (pp. 407–452). Oxford University Press.
Maddieson, I. (1978). Universals of tone. In J. H. Greenberg (Ed.), Universals of human language (Vol. 2): Phonology (pp. 335–366). Stanford: Stanford University Press.
McCrocklin, S. M. (2016). Pronunciation learner autonomy: The potential of automatic speech recognition. System, 57, 25–42.
McCrocklin, S., Humaidan, A., & Edalatishams, E. (2019). ASR dictation program accuracy: Have current programs improved? In J. Levis, C. Nagle, & E. Todey (Eds.), Proceedings of the 10th Pronunciation in Second Language Learning and Teaching Conference (pp. 191–200). Iowa State University.
McDonough, K. & Mackey, A. (2008). Syntactic priming and ESL question development. SSLA, 30, 31–47.
Mlott, S.R., Marcotte, D.B. & Lira, F.T. (1976). The efficacy of programmed instruction in the training of paraprofessionals. Journal of Clinical Psychology, 32, 419–424.
Moussalli, S., & Cardoso, W. (2016). Are commercial ‘personal robots’ ready for language learning? Focus on second language speech. In S. Papadima-Sophocleous, L. Bradley, & S. Thouësny (Eds.), CALL communities and culture – short papers from EUROCALL 2016 (pp. 325–329).
Moussalli, S., & Cardoso, W. (2019). Intelligent personal assistants: can they understand and be understood by accented L2 learners? Computer-assisted Language Learning, 33(8), 865–890.
Mroz, A. (2020). Aiming for advanced intelligibility and proficiency using mobile ASR. Journal of Second Language Pronunciation, 6(1), 12–38.
Munro, M., & Derwing, T. (1995). Foreign Accent, Comprehensibility, and Intelligibility in the Speech of Second Language Learners. Language Learning, 45(1), 73–97.
Munro, M., & Derwing, T. (2006). The functional load principle in ESL pronunciation instruction: An exploratory study. SYSTEM, 34, 520–531.
Nassaji, H. & Kartchava, E. (2017). Corrective feedback and good language teachers. second language teaching and learning. In C. Griffiths and Z. Tajeddin (Eds.), Lessons from Good Language Teaching (pp. 151–164). Cambridge University Press.
Neri, A., Cucchiarini, C., Strik, H., & Boves, L. (2002). The pedagogy-technology interface in computer-assisted pronunciation training. Computer-assisted Language Learning, 15(5), 441–467.
Neri, A., Mich, O., Gerosa, M., & Giuliani, D. (2008). The effectiveness of computer-assisted pronunciation training for foreign language learning by children. Computer-assisted Language Learning, 21(5), 393–408.
Park, S-Y. (2009). An analysis of the technology acceptance model in understanding university students' behavioral intention to use e-learning. Journal of Educational Technology & Society, 12(3), 150–162.
O’Brien, M. G. (2014). L2 Learners’ Assessments of Accentedness, Fluency, and Comprehensibility of Native and Nonnative German Speech. Language Learning, 64(4), 715–748.
Patel, A. D., Xu, Y. & Wang, B. (2010). The role of F0 variation in the intelligibility of Mandarin sentences. Speech Prosody. Chicago, IL: ISCA.
Penning de Vries, B., Cucchiarni, C., Bodnar, S., Strik, H., & van Hout, R. (2015). Spoken grammar practice and feedback in an ASR-based CALL system. Computer-assisted Language Learning, 28(6), 550–576.
Pelzl, E. (2021). Foreign accent in second language Mandarin Chinese. In C. Yang (Ed.), The acquisition of Chinese as a second language pronunciation: Segments and prosody (pp. 257–280). Springer.
Pica, T. (1994). Research on negotiation: What does it reveal about second language learning conditions, processes, and outcomes? Language Learning, 44, 493–527.
Pienemann, M. (2015). An outline of Processability Theory and its relationship to other approaches to SLA. Language Learning, 65(1), 123–151. https://doi.org/10.1111/lang.12095
Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (MSLQ). Educational and psychological measurement, 53, 801–813.
Ruivivar, J. & Collins, L. (2019). Nonnative accent and the perceived grammaticality of spoken grammar forms. Journal of Second Language Pronunciation, 5(2), 269–293.
Saito, K., & Wu, X. (2014). Communicative focus on form and second language suprasegmental learning: Teaching Cantonese learners to perceive Mandarin tones. Studies in Second Language Acquisition, 36, 647–680.
Saito, K., Trofimovich, P., Isaacs, T., & Webb, S. (2016). Re-examining Phonological and Lexical Correlates of Second Language Comprehensibility: The Role of Rater Experience. In T. Isaacs, & P. Trofimovich (Eds.), Second Language Pronunciation Assessment: Interdisciplinary Perspectives (pp. 141-156). Bristol: Multilingual Matters.
Saldaña, J. (2009). The coding manual for qualitative researchers. Sage.
Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129–58.
Song, C. (2021). What is in the final stage of inter-language? Tone errors and phonological constraints in spontaneous speech in very advanced learners of Mandarin. In C. Yang (Ed.), The acquisition of Chinese as a second language pronunciation: Segments and prosody (pp. 21–54). Springer.
Strachan, L. & Trofimovich, P. (2019). Now you hear it, now you don’t: Perception of English regular past –ed in naturalistic input. Canadian Modern Language Journal, 74(1), 84–104.
Surendran, D. & Levow, G-A. (2004). The Functional Load of Tone in Mandarin is as High as that of Vowels. University of Chicago.
Swain, M. (1985). Communicative competence: Some roles of comprehensible input and comprehensible output in its development. In S. M. Gass and C. G. Madden (Eds.), Input in second language acquisition. Newbury House, 235–53.
Swain, M. (1995). Three functions of output in second language learning. In G. Cook and B. Seidlhofer (Eds.), Principle and practice in applied linguistics: Studies in honour of henry G. Widdowson (pp. 125–144). Oxford University Press.
Trofimovich, P. & Isaacs, T. (2012). Disentangling accent from comprehensibility. Bilingualism: Language and Cognition, 15(4), 905–916.
Tuncay, H. (2020). App Attrition in Computer-Assisted Language Learning: Focus on Duolingo (Master's thesis, McGill University, Montreal, Canada). Retrieved from https://escholarship.mcgill.ca/concern/theses/nv935746n?locale=en
Van Doremalen, J., Boves, L., Colpaert, J., Cucchiarini, C., & Strik, H. (2016). Evaluating automatic speech recognition-based language learning systems: A case study. Computer-assisted Language Learning, 29(4), 833–851.
Van Lieshout, C. & Cardoso, W. (2022). Google Translate as a tool for self-directed language learning. Language Learning & Technology.
Venkatesh, V. & Davis, F. D. (1996). A model of the antecedents of perceived ease of use: Developments and Test. Decision Sciences, 27(3), 451–481.
Venkatesh, V. & Davis, F. D. (2000). A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal Field Studies. Management Science, 46(2), 169–332.
Vygotsky, L. (1978). Mind in society. Harvard University Press.
Wan, I., & Jaeger, J. (1998). Speech errors and the representation of tone in mandarin Chinese. Phonology, 15(3), 417–461.
Winne, P. H. (2001). Self-regulated learning viewed from models of information processing. In B. J. Zimmerman & D. H. Schunk (Eds.), Self-regulated learning and academic achievement: Theoretical perspectives (pp. 153–189). Mahwah, NJ: Erlbaum.
Winne, P. (2018). Theorizing and researching levels of processing in self-regulated learning. British Journal of Educational Technology, 88, 9–20.
Yip, M. (2002). Tone. Cambridge: Cambridge University Press.
Zimmerman, B. (1998). Academic studying and the development of personal skill: A self-regulatory perspective. Educational Psychologist, 33(2), 73–86
All items in Spectrum are protected by copyright, with all rights reserved. The use of items is governed by Spectrum's terms of access.

Repository Staff Only: item control page

Downloads per month over past year

Research related to the current document (at the CORE website)
- Research related to the current document (at the CORE website)
Back to top Back to top