research-article

Presentation Trainer, your Public Speaking Multimodal Coach

Authors:

Peter van Rosmalen,

Marcus SpechtAuthors Info & Claims

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

Pages 539 - 546

https://doi.org/10.1145/2818346.2830603

Published: 09 November 2015 Publication History

Abstract

The Presentation Trainer is a multimodal tool designed to support the practice of public speaking skills, by giving the user real-time feedback about different aspects of her nonverbal communication. It tracks the user's voice and body to interpret her current performance. Based on this performance the Presentation Trainer selects the type of intervention that will be presented as feedback to the user. This feedback mechanism has been designed taking in consideration the results from previous studies that show how difficult it is for learners to perceive and correctly interpret real-time feedback while practicing their speeches. In this paper we present the user experience evaluation of participants who used the Presentation Trainer to practice for an elevator pitch, showing that the feedback provided by the Presentation Trainer has a significant influence on learning.

References

[1]

Anderson, T., Shattuck, J.: Design-Based Research A Decade of Progress in Education Research Educational Researcher, 41(1) (2012), pp. 16--25

[2]

Barthelmess, P. Kaiser, E., Huang, X, Demirdjian, D. Distributed pointing for multimodal collaboration over sketched diagrams. Proceedings of the Seventh International Conference on Multimodal Interfaces, ACM: (New York 2005), pp. 10--17.

Digital Library

[3]

Batrinca, L., Stratou, G., Shapiro, A., Morency, L.-P., Scherer, S. Cicero - towards a multimodal virtual audience platform for public speaking training. In Proc. IVA, vol. 8108. Springer, 2013, 116--128.

[4]

Baur, T., Damian, I., Gebhard, P., Porayska-Pomsta, K., Andre, E. A job interview simulation: Social cue-based interaction with a virtual character. In Proc. SocialCom. IEEE, (2013), pp. 220--227.

Digital Library

[5]

Bjerregaard, M., Compton, E. Public Speaking Handbook. Snow College, Supplement for Public Speaking (2011)

[6]

Bolt, R. A. Put-that-there: Voice and gesture at the graphics interface. Computer Graphics, 14 (3) (1980), pp. 262--270.

Digital Library

[7]

Brouwers, J. Implementation and Testing of an Improved Automated Presentation Trainer. Master Thesis, Maastricht University, Faculty of Humanities and Sciences, Department of Knowledge Engineering, Aug-Sept. 2015.

[8]

Cohen, P.R., McGee, D. (2004) Tangible multimodal interfaces for safety critical applications. Communications of the ACM, vol. 47 (January 2004) 41--46.

Digital Library

[9]

Damian I., Tan C.S.S., Baur T., Schöning J., Luyten K., André E. Augmenting Social Interactions: Realtime Behavioural Feedback using Social Signal Processing Techniques. In CHI '15 Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. (Seul 2015), pp. 565--574.

Digital Library

[10]

Darves, C., Oviatt, S. Talking to digital fish: Designing effective conversational interfaces for educational software. In Evaluating Embodied Conversational Agents, Z. Ruttkay, C. Pelachaud, Eds., (Dordrecht 2004), pp. 271--292.

Digital Library

[11]

DeVito J.A. The Essential Elements of Public Speaking. Pearson (2014)

[12]

Hattie, J., & Timperley, H., The power of feedback. Review of Educational Research (2007), pp. 81--112

[13]

Hoque, M. E., Courgeon, M., Martin, J., Mutlu, B., and Picard, R. W. Mach: My automated conversation coach. In Proc. UbiComp (2013).

Digital Library

[14]

Kerby, D. & Romine, J.: Develop Oral Presentation Skills Through Accounting Curriculum Design and CourseEmbedded Assessment. Journal of Education for Business. Vol. 85, Iss. 3. (2009).

[15]

King, P., Young, M., & Behnke, R. Public speaking performance improvement as a function of information processing in immediate and delayed feedback interventions. Communication Education, 49(4) (2000), pp. 365--374.

[16]

Li, X., and Rekimoto, J. Smartvoice: a presentation support system for overcoming the language barrier. In Proc. CHI'14, ACM (2014), pp. 1563--1570.

Digital Library

[17]

Mehrabian, A. Nonverbal communication. Oxford, UK: Aldine-Atherton, 1972.

[18]

Oviatt, S. Multimodal Interfaces. The human-computer interaction handbook. 3rd edition Lawrence Erlbaum: New Jersey, 2012.

[19]

Ruiz, N., Chen, F. and Oviatt S., "Multimodal Input", in Multimodal Signal Processing: Theory and Applications for Human-Computer Interaction. Edited by Thiran, J.P., Marques, F. and Bourlard, H., Academic Press, 2010, Chapter 12, pp. 231--255.

[20]

Schneider, J., Börner, D., van Rosmalen, P., Specht, M. Augmenting the senses: a review on sensor-based learning support. Sensors 15(2) (February 2015), pp. 4097--4133.

[21]

Schneider, J., Börner, D., van Rosmalen, P., Specht, M. Stand Tall and Raise your Voice! A Study on the Presentation Trainer. In EC-TEL'15 Proceedings of the tenth European Conference on Technology enhanced learning (Toledo 2015).

[22]

Sweller, J. Cognitive Load Theory, learning difficulty, and instructional design. Learning and Instruction 4 (4) (1994), pp. 295--312.

[23]

Tam, D., MacLean, K., McGrenere, J., and K. J. Kuchenbecker, K. J. The design and field observation of a haptic notification system for timing awareness during oral presentations. In Proc. CHI '13. ACM, 2013.

Digital Library

[24]

Toastmasters International. Gestures: your body speaks. http://www.toastmasters.org/ (2011)

Cited By

Chiba MYamada WOchiai K(2024)Shadowed Speech: An Approach for Slowing Speech Rate Using Adaptive Delayed Auditory FeedbackJournal of Information Processing10.2197/ipsjjip.32.93832(938-947)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.938
Di Mitri DLimbu BSchneider JIren DGiannakos MKlemke R(2024)Multimodal and immersive systems for skills development and educationBritish Journal of Educational Technology10.1111/bjet.13483Online publication date: 15-May-2024
https://doi.org/10.1111/bjet.13483
Cardenas Hernandez FSchneider JDi Mitri DJivet IDrachsler H(2024)Beyond hard workout: A multimodal framework for personalised running training with immersive technologiesBritish Journal of Educational Technology10.1111/bjet.13445Online publication date: 26-Feb-2024
https://doi.org/10.1111/bjet.13445
Show More Cited By

Index Terms

Presentation Trainer, your Public Speaking Multimodal Coach

Recommendations

Exploring feedback strategies to improve public speaking: an interactive virtual audience framework
UbiComp '15: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing

Good public speaking skills convey strong and effective communication, which is critical in many professions and used in everyday life. The ability to speak publicly requires a lot of training and practice. Recent technological developments enable new ...
Towards Automated Assessment of Public Speaking Skills Using Multimodal Cues
ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

Traditional assessments of public speaking skills rely on human scoring. We report an initial study on the development of an automated scoring model for public speaking performances using multimodal technologies. Task design, rubric development, and ...
Multimodal Public Speaking Performance Assessment
ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

The ability to speak proficiently in public is essential for many professions and in everyday life. Public speaking skills are difficult to master and require extensive training. Recent developments in technology enable new approaches for public ...

Comments

comments powered by Disqus.

Information & Contributors

Information

Published In

ICMI '15: Proceedings of the 2015 ACM on International Conference on Multimodal Interaction

November 2015

678 pages

ISBN:9781450339124

DOI:10.1145/2818346

General Chairs:
Zhengyou Zhang
Microsoft Research, USA
,
Phil Cohen
VoiceBox Technologies, USA
,
Program Chairs:
Dan Bohus
Microsoft Research, USA
,
Radu Horaud
INRIA Grenoble Rhone-Alpes, France
,
Helen Meng
Chinese University of Hong Kong, China

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Seventh Framework Programme collaborative project funded by

Conference

ICMI '15

Sponsor:

SIGCHI

ICMI '15: INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION

November 9 - 13, 2015

Washington, Seattle, USA

Acceptance Rates

ICMI '15 Paper Acceptance Rate 52 of 127 submissions, 41%;

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

75
Total Citations
View Citations
919
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)11

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chiba MYamada WOchiai K(2024)Shadowed Speech: An Approach for Slowing Speech Rate Using Adaptive Delayed Auditory FeedbackJournal of Information Processing10.2197/ipsjjip.32.93832(938-947)Online publication date: 2024
https://doi.org/10.2197/ipsjjip.32.938
Di Mitri DLimbu BSchneider JIren DGiannakos MKlemke R(2024)Multimodal and immersive systems for skills development and educationBritish Journal of Educational Technology10.1111/bjet.13483Online publication date: 15-May-2024
https://doi.org/10.1111/bjet.13483
Cardenas Hernandez FSchneider JDi Mitri DJivet IDrachsler H(2024)Beyond hard workout: A multimodal framework for personalised running training with immersive technologiesBritish Journal of Educational Technology10.1111/bjet.13445Online publication date: 26-Feb-2024
https://doi.org/10.1111/bjet.13445
Lee EYang EHuh JOh U(2024)EcoScript: A Real-Time Presentation Supporting Tool using a Speech Recognition Model2024 IEEE International Conference on Information Reuse and Integration for Data Science (IRI)10.1109/IRI62200.2024.00031(96-101)Online publication date: 7-Aug-2024
https://doi.org/10.1109/IRI62200.2024.00031
Ferreira LCerqueira JJonassi JJesus AAmaral CMateus-Coelho N(2024)Virtual Reality on Public Speaking Phobia mitigationProcedia Computer Science10.1016/j.procs.2024.06.416239(2251-2259)Online publication date: 2024
https://doi.org/10.1016/j.procs.2024.06.416
Spyridonis FDaylamani-Zad DNightingale J(2024)PublicVR: a virtual reality exposure therapy intervention for adults with speech anxietyVirtual Reality10.1007/s10055-024-00998-x28:2Online publication date: 30-Apr-2024
https://doi.org/10.1007/s10055-024-00998-x
Li TVorvoreanu MDebellis DAmershi S(2023)Assessing Human-AI Interaction Early through Factorial Surveys: A Study on the Guidelines for Human-AI InteractionACM Transactions on Computer-Human Interaction10.1145/351160530:5(1-45)Online publication date: 23-Sep-2023
https://dl.acm.org/doi/10.1145/3511605
Kwon SLee HPark SHeo YLee KKang Y(2023)‘Um, so like, is this how I speak?’: design implications for automated visual feedback systems on speechBehaviour & Information Technology10.1080/0144929X.2023.2271997(1-20)Online publication date: 9-Nov-2023
https://doi.org/10.1080/0144929X.2023.2271997
Saga TTanaka HMatsuda YMorimoto TUratani MOkazaki KFujimoto YNakamura S(2023)Automatic evaluation-feedback system for automated social skills trainingScientific Reports10.1038/s41598-023-33703-013:1Online publication date: 26-Apr-2023
https://doi.org/10.1038/s41598-023-33703-0
Arushi Dillon RTeoh ADillon D(2023)Detecting Public Speaking Stress via Real-Time Voice Analysis in Virtual Reality: A ReviewInnovation-Driven Business and Sustainability in the Tropics10.1007/978-981-99-2909-2_7(117-152)Online publication date: 5-Aug-2023
https://doi.org/10.1007/978-981-99-2909-2_7
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.

Alternative Proxies:

Alternative Proxy