Abstract
Game-based learning has gained recognition for enhancing learner engagement and outcomes, while humanoid robots have shown promise in boosting motivation. However, the potential of sound recognition in humanoid robots to enhance learner engagement, motivation, and enjoyment remains relatively unexplored. This study explores the impact of incorporating sound recognition technology into humanoid robots in a game-based learning setting. Using the robot Pepper, participants engaged in interactive learning sessions featuring robot animations, background music, and scoring. Afterward, participants provided feedback through an online survey. The research findings shed light on how sound recognition enhances learner engagement, motivation, and enjoyment in educational games, offering valuable insights for educators and researchers.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Gee, J.P.: Learning by design: games as learning machines. Interact. Educ. Multimed. 10, 15–23 (2005)
Kennedy, J., Baxter, P., Belpaeme, T.: The robot who tried too hard: social behavior of a robot tutor can negatively affect child learning. In: Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction, pp. 67–74 (2016)
Serholt, S., Barendregt, W., Alklind Taylor, A.S.: Affective expressions in a humanoid robot tutor for children’s second language skills. Interact. Stud. 15(2), 277–298 (2014)
Aylett, R., Vargas, P.A., Lim, M.Y., Hall, L.: Sound and interaction in virtual and augmented reality. IEEE Multimed. 24(2), 11–15 (2017)
SoftBank Pepper spec page. https://www.softbank.jp/en/robot/
Lee, S.J., Park, S.W., Lee, K.H.: The effects of background music on math problem-solving performance and perceived immersion in a game-based learning environment. Comput. Educ. 99, 14–28 (2016)
Shi, S., Wang, Y.: The impact of background music on learning and cognitive performance in older adults: a systematic review. J. Adult Dev. 26(4), 233–248 (2019)
Kory-Westlund, J.M., Breazeal, C., DePalma, N.: Robotics as a vehicle for broadening participation in computing: the missing story of Ella. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, p. 162 (2018)
Buchem, I., Tutul, R., Jakob, A. Pinkwart, N.: Non-verbal sound detection by humanoid educational robots in game-based learning. Multiple-talker tracking in a buzzer quiz game with the pepper robot. In: Balogh, R., Obdržálek, D., Christoforou, E. (eds.) RiE 2023. LNNS, vol 747, pp. 185–196. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-38454-7_16. ISBN 9783031384530
Tutul, R., Jakob, A., Buchem, I., Pinkwart, N.: Sound recognition with a humanoid robot for a quiz game in an educational environment. In: Fortschritte der Akustik - DAGA 2023, pp. 938–941 (2023)
Fokides, E., Kaimara, P., Deliyannis, I., Atsikpasi, P.: Development of a scale for measuring the learning experience in serious games. Preliminary results. In: Proceedings of the Digital 2qayyCulture & Audiovisual Challenges: Interdisciplinary Creativity in Arts and Technology (DCAC 2018), Corfu, Greece (2018)
Buchem, I.: Scaling-up social learning in small groups with robot supported collaborative learning (RSCL): effects of learners’ prior experience in the case study of planning poker with the robot NAO. Appl. Sci. 13(7), 4106 (2023). https://doi.org/10.3390/app13074106
Clark, L.A., Watson, D.: Constructing validity: basic issues in objective scale development. Psychol. Assess. 7, 309–319 (1995)
Wu, H.K., Lee, S.W.Y., Chang, H.Y., Liang, J.C.: Current status, opportunities and challenges of augmented reality in education. Comput. Educ. 59(2), 559–569 (2012)
O’Hare, G.M., O’Grady, M.J., Muldoon, C., O’Hare, G.M.: Investigating engagement and learning in social robotics: a game-based approach. Int. J. Soc. Robot. 8(4), 527–541 (2016)
Nowakowski, K., Ptaszynski, M., Masui, F.: Spicing up the game for underresourced language learning: preliminary experiments with Ainu language-speaking pepper robot. In: The 6st Workshop on Linguistic and Cognitive Approaches to Dialog Agents (LaCATODA 2020) (2020)
Dannecker, A., Hertig, D.: Automation of KAHOOT! By the humanoid robot pepper comparing results from classes – robot vs. lecturers. In: INTED2023 Proceedings, pp. 4361–4368 (2023)
Balzotti, A., De Carolis, B., Massaro, S., Perla, L., Rossano, V.: Healthy pepper: nutritional education through social robotics and storytelling. In: 2023 IEEE International Conference on Advanced Learning Technologies (ICALT), Orem, UT, USA, pp. 121–123 (2023)
Tourangeau, R., Rips, L.J., Rasinski, K.: The Psychology of Survey Response. Cambridge University Press, Cambridge (2000)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Tutul, R., Buchem, I., Jakob, A., Pinkwart, N. (2024). Enhancing Learner Motivation, Engagement, and Enjoyment Through Sound-Recognizing Humanoid Robots in Quiz-Based Educational Games. In: Biele, C., et al. Digital Interaction and Machine Intelligence. MIDI 2023. Lecture Notes in Networks and Systems, vol 1076. Springer, Cham. https://doi.org/10.1007/978-3-031-66594-3_13
Download citation
DOI: https://doi.org/10.1007/978-3-031-66594-3_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-66593-6
Online ISBN: 978-3-031-66594-3
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)