Abstract
Online one-on-one tutoring serves as a personalized approach to supplement classroom instruction. However, with the growing tutoring market, a single tutor often handles inquiries from students across primary, middle, and high school levels. Consequently, the extent of tutors’ interactions with students of varying grades and their use of tutoring strategies to enhance student learning remains unclear. To address this gap, we collected and analyzed 1500 tutoring dialogues from amateur mathematics tutors concurrently instructing students from primary, middle, and high school levels. These dialogues were annotated using a coding scheme and a well-trained powerful artificial intelligence (AI) model. The interaction dynamics were subsequently examined using epistemic network analysis and lag sequential analysis, yielding findings on the occurrences, co-occurrences, and sequential patterns of dialogic strategies. First, the results reveal that tutors frequently engaged in off-topic behaviors and direct instruction, regardless of students’ educational level. Second, tutors’ constructive questions and knowledge sharing and instruction were more associated with greater constructive expressions from students at higher educational levels, while primary students primarily demonstrated simple acknowledgment. Third, tutors exhibited limited sequential patterns of dialogic strategies when tutoring primary and middle school students, mainly focusing on question-asking behaviors and evaluation and feedback. In contrast, tutors displayed diverse patterns across various categories of dialogic strategies when instructing high school students, emphasizing the facilitation of students’ reasoning and metacognition. These findings underscore the importance of training tutors to develop dialogic skills and adopt tailored pedagogical approaches for different educational levels, ensuring effective and efficient online one-on-one mathematics tutoring.









Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Data Availability
The data and materials that support the findings of this study are available from the first author, Deliang Wang, upon reasonable request.
References
Bakeman, R., & Gottman, J. M. (1997). Observing interaction: An introduction to sequential analysis. Cambridge University Press.
Bates, S. P., Galloway, R. K., Riise, J., & Homer, D. (2014). Assessing the quality of a student-generated question repository. Physical Review Special Topics-Physics Education Research, 10(2), 020105. https://doi.org/10.1103/PhysRevSTPER.10.020105
Bloom, B. S. (1984). The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring. Educational Researcher, 13(6), 4–16.
Booth, B. M., Jacobs, J., Bush, J. B., Milne, B., Fischaber, T., & D’Mello, S. K. (2024). Human-tutor coaching technology (htct): Automated discourse analytics in a coached tutoring model. The 14th Learning Analytics and Knowledge Conference (LAK’24), March 18–22, 2024, Kyoto, Japan.
Boyer, K., Phillips, R., Wallis, M., Vouk, M., & Lester, J. (2008). Learner characteristics and feedback in tutorial dialogue. Proceedings of the Third Workshop on Innovative Use of NLP for Building Educational Applications (pp. 53–61).
Chappell, S., Arnold, P., Nunnery, J., & Grant, M. (2015). An examination of an online tutoring program’s impact on low-achieving middle school students’ mathematics achievement. Online Learning, 19(5), 37–53.
Chen, G. (2020). A visual learning analytics (vla) approach to video-based teacher professional development: Impact on teachers’ beliefs, self-efficacy, and classroom talk practice. Computers & Education, 144, 103670.
Chi, M. T., Siler, S. A., Jeong, H., Yamauchi, T., & Hausmann, R. G. (2001). Learning from human tutoring. Cognitive Science, 25(4), 471–533.
Chi, M. T., & Wylie, R. (2014). The icap framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243.
Chin, C. (2007). Teacher questioning in science classrooms: Approaches that stimulate productive thinking. Journal of Research in Science Teaching: The Official Journal of the National Association for Research in Science Teaching, 44(6), 815–843.
Correnti, R., Stein, M. K., Smith, M. S., Scherrer, J., McKeown, M., Greeno, J., & Ashley, K. (2015). Improving teaching at scale: Design for the scientific measurement and learning of discourse practice (pp. 303–320). American Educational Research Association: Socializing intelligence through academic talk and dialogue.
De Ree, J., Maggioni, M. A., Paulle, B., Rossignoli, D., Ruijs, N., & Walentek, D. (2023). Closing the income-achievement gap? Experimental evidence from high-dosage tutoring in Dutch primary education. Economics of Education Review, 94, 102383.
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
Eagan, B., & Hamilton, E. (2018). Epistemic network analysis of an international digital makerspace in Africa, Europe, and the US. In Annual Meeting of the American Education Research Association, New York City.
Feng, X., Xie, J., & Liu, Y. (2017). Using the community of inquiry framework to scaffold online tutoring. International Review of Research in Open and Distributed Learning, 18(2), 162–188.
Fournier-Viger, P., Lin, J. C. W., Kiran, R. U., Koh, Y. S., & Thomas, R. (2017). A survey of sequential pattern mining. Data Science and Pattern Recognition, 1(1), 54–77.
Fuchs, L. S., Seethaler, P. M., Powell, S. R., Fuchs, D., Hamlett, C. L., & Fletcher, J. M. (2008). Effects of preventative tutoring on the mathematical problem solving of third-grade students with math and reading difficulties. Exceptional Children, 74(2), 155–173.
Gao, L., Li, X., Li, Y., & Hu, W. (2023). Capturing temporal and sequential patterns of socio-emotional interaction in high-and low-performing collaborative argumentation groups. The Asia-Pacific Education Researcher, 32(6), 817–831.
Garrison, D. R., Anderson, T., & Archer, W. (1999). Critical inquiry in a text-based environment: Computer conferencing in higher education. The Internet and Higher Education, 2(2–3), 87–105.
Graesser, A. C., D’Mello, S., & Cade, W. (2011). In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (pp. 408–426). Routledge Press.
Graesser, A. C., Person, N. K., & Magliano, J. P. (1995). Collaborative dialog patterns in naturalistic one-to-one tutoring. Applied Cognitive Psychology, 9(6), 495–522.
Graesser, A. C., VanLehn, K., Rosé, C. P., Jordan, P. W., & Harter, D. (2001). Intelligent tutoring systems with conversational dialogue. AI magazine, 22(4), 39–39. https://doi.org/10.1609/aimag.v22i4.1591
Grand View Research. (2024). Online tutoring services market size & trends report, 2030. Retrieved February 1, 2024, from https://www.grandviewresearch.com/industry-analysis/online-tutoring-services-market
Hampel, R., & Stickler, U. (2005). New skills for new classrooms: Training tutors to teach languages online. Computer Assisted Language Learning, 18(4), 311–326.
Hanham, J., Lee, C. B., & Teo, T. (2021). The influence of technology acceptance, academic self-efficacy, and gender on academic achievement through online tutoring. Computers & Education, 172, 104252.
Hardt, D., Nagler, M., & Rincke, J. (2023). Tutoring in (online) higher education: Experimental evidence. Economics of Education Review, 92, 102350.
Hennessy, S., Howe, C., Mercer, N., & Vrikki, M. (2020). Coding classroom dialogue: Methodological considerations for researchers. Learning, Culture and Social Interaction, 25, 100404.
Hennessy, S., Rojas-Drummond, S., Higham, R., Márquez, A. M., Maine, F., Ríos, R. M., García-Carrión, R., Torreblanca, O., & Barrera, M. J. (2016). Developing a coding scheme for analysing classroom dialogue across educational contexts. Learning, Culture and Social Interaction, 9, 16–44.
Howe, C., & Abedin, M. (2013). Classroom dialogue: A systematic review across four decades of research. Cambridge Journal of Education, 43(3), 325–356.
Hrastinski, S., Cleveland-Innes, M., & Stenbom, S. (2018). Tutoring online tutors: Using digital badges to encourage the development of online tutoring skills. British Journal of Educational Technology, 49(1), 127–136.
Hume, G., Michael, J., Rovick, A., & Evens, M. (1996). Hinting as a tactic in one-on-one tutoring. The Journal of the Learning Sciences, 5(1), 23–47.
Hung, M.-L. (2021). Exploring the perspectives and readiness of undergraduate tutors regarding synchronous online one-to-one tutoring for pupils in rural areas. The Asia Pacific Education Researcher, 31(5), 553–561. https://doi.org/10.1007/s40299-021-00607-4
Joshi, P. (2020). Private schooling and tutoring at scale in South Asia. In P. Sarangapani, & R. Pappu (Eds.), Handbook of Education Systems in South Asia. Global Education Systems. Springer. https://doi.org/10.1007/978-981-13-3309-5_23-1
Joubert, Y. T., & Snyman, A. M. (2017). Challenges experienced with online tutoring in an ODL institution. Progressio, 39(1), 126–145.
Kim, M.-Y., & Wilkinson, I. A. (2019). What is dialogic teaching? Constructing, deconstructing, and reconstructing a pedagogy of classroom talk. Learning, Culture and Social Interaction, 21, 70–86.
Lin, J., Rakovic, M., Lang, D., Gasevic, D., & Chen, G. (2022a). Exploring the politeness of instructional strategies from human-human online tutoring dialogues. LAK22: 12th International Learning Analytics and Knowledge Conference, 282–293.
Lin, J., Singh, S., Sha, L., Tan, W., Lang, D., Gašević, D., & Chen, G. (2022b). Is it a good move? Mining effective tutoring strategies from human–human tutorial dialogues. Future Generation Computer Systems, 127, 194–207.
Litman, D., & Forbes-Riley, K. (2006). Correlations between dialogue acts and learning in spoken tutoring dialogues. Natural Language Engineering, 12(2), 161–176.
Liu, Y., Ott, M., Goyal, N., Du, J., Joshi, M., Chen, D., Levy, O., Lewis, M., Zettlemoyer, L., & Stoyanov, V. (2019). Roberta: A robustly optimized bert pretraining approach. arXiv preprint arXiv:1907.11692.
Ma, X., Xie, Y., Yang, X., Wang, H., Li, Z., & Lu, J. (2024). Teacher-student interaction modes in smart classroom based on lag sequential analysis. Education and Information Technologies (pp. 1–25). https://doi.org/10.1007/s10639-024-12487-4
Mameli, C., Mazzoni, E., & Molinari, L. (2015). Patterns of discursive interactions in primary classrooms: An application of social network analysis. Research Papers in Education, 30(5), 546–566. https://doi.org/10.1080/02671522.2015.1027727
McFarlane, K. J. (2016). Tutoring the tutors: Supporting effective personal tutoring. Active Learning in Higher Education, 17(1), 77–88. https://doi.org/10.1177/14697874156167
McPherson, M., & Nunes, M. B. (2004). The role of tutors as an integral part of online learning support. Retrieved February 2, 2024, from https://eprints.whiterose.ac.uk/999/
Mercer, N. (2010). The analysis of classroom talk: Methods and methodologies. British Journal of Educational Psychology, 80(1), 1–14.
Michaels, S., O’Connor, M. C., Hall, M. W., & Resnick, L. B. (2010). Accountable talk® sourcebook. Pittsburg, PA: Institute for Learning University of Pittsburgh. Murphy, PK, Wilkinson, IAG, Soter, AO, Hennessey, MN, & Alexander, JF.
Michaels, S., O’Connor, C., & Resnick, L. B. (2008). Deliberative discourse idealized and realized: Accountable talk in the classroom and in civic life. Studies in Philosophy and Education, 27, 283–297.
Mitchell, C. M., Ha, E. Y., Boyer, K. E., & Lester, J. C. (2012). Recognizing effective and student-adaptive tutor moves in task-oriented tutorial dialogue. Twenty-Fifth International FLAIRS Conference.
Nguyen, D. Q., Vu, T., & Nguyen, A. T. (2020). Bertweet: A pre-trained language model for English tweets. arXiv preprint arXiv:2005.10200.
Nickow, A., Oreopoulos, P., & Quan, V. (2024). The promise of tutoring for prek–12 learning: A systematic review and meta-analysis of the experimental evidence. American Educational Research Journal, 61(1), 74–107. https://doi.org/10.3102/00028312231208687
Omarchevska, Y., Lachner, A., Richter, J., & Scheiter, K. (2022). It takes two to tango: How scientific reasoning and self-regulation processes impact argumentation quality. Journal of the Learning Sciences, 31(2), 237–277. https://doi.org/10.1080/10508406.2021.1966633
Ouyang, F., Tang, Z., Cheng, M., & Chen, Z. (2023). Using an integrated discourse analysis approach to analyze a group’s collaborative argumentation. Thinking Skills and Creativity, 47, 101227. https://doi.org/10.1016/j.tsc.2022.101227
Reichenberg, R., Avissar, G., & Sagee, R. (2015). ‘I owe to my tutor much of my professional development’: Looking at the benefits of tutoring as perceived by the tutees. Professional Development in Education, 41(1), 40–56.
Resnick, L. B., Asterhan, C. S., Clarke, S. N., & Schantz, F. (2018). Next generation research in dialogic learning. In G. E. Hall, L. F. Quinn, & D.M. Gollnick (Eds.), Wiley handbook of teaching and learning (pp. 323–338). John Wiley & Sons, Inc.
Robinette, R. L. (2024). Understanding and meeting the professional development needs of English educators at a private tutoring organization in China. Teaching and Teacher Education, 138, 104403.
Shaffer, D., & Ruis, A. (2017). Epistemic network analysis: A worked example of theory-based learning analytics. Handbook of learning analytics. Society for Learning Analytics Research (SoLAR).
Shaffer, D. W. (2017). Quantitative ethnography. Cathcart Press.
Shaffer, D., & Ruis, A. (2016). A tutorial on epistemic network analysis: Analyzing the structure of connections in cognitive, social, and interaction data. Journal of Learning Analytics, 3(3), 9–45. https://doi.org/10.18608/jla.2016.33.3
Shan, D., Bhattacharya, P., Kao, B., & Phan, T. (2021). Characterizing amateur tutoring behavior on a large online learning platform. In Proceedings of the Eighth ACM Conference on Learning@ Scale (pp. 239–242).
Snapask. (2024). A school squeezed into snapask. Retrieved February 1, 2024, from https://snapask.com/
Song, Y., Hao, T., Liu, Z., & Lan, Z. (2020). A systematic review of frameworks for coding towards classroom dialogue. Emerging Technologies for Education: 4th International Symposium, SETE 2019, Held in Conjunction with ICWL 2019, Magdeburg, Germany, September 23–25, 2019, Revised Selected Papers 4, (pp. 226–236).
Song, Y., Cheng, B., Zhu, J., & Hu, X. (2022). Exploring the collective process of classroom dialogue using sequential pattern mining technique. International Journal of Educational Research, 115, 102050.
Št’astny`, V. (2017). Private tutoring lessons supply: Insights from online advertising in the Czech Republic. Compare: A Journal of Comparative and International Education, 47(4), 561–579.
Tao, Y., & Chen, G. (2023). Coding schemes and analytic indicators for dialogic teaching: A systematic review of the literature. Learning, Culture and Social Interaction, 39, 100702.
Teakel, S., Linden, K., van der Ploeg, N., & Roman, N. (2023). Embedding equity: Online tutor support to provide effective feedforward on assessments. Assessment & Evaluation in Higher Education, 49(3), 320–333. https://doi.org/10.1080/02602938.2023.2232955
Tlili, A., Wang, H., Gao, B., Shi, Y., Zhiying, N., Looi, C. K., & Huang, R. (2023). Impact of cultural diversity on students’ learning behavioral patterns in open and online courses: A lag sequential analysis approach. Interactive Learning Environments, 31(6), 3951–3970.
Trygstad, P. J., Malzahn, K. A., Banilower, E. R., Plumley, C. L., & Bruce, A. D. (2020). Are all students getting equal access to high-quality science education? Data from the 2018 NSSME+. Horizon Research, Inc.
Tsuei, M. (2017). Learning behaviours of low-achieving children’s mathematics learning in using of helping tools in a synchronous peer-tutoring system. Interactive Learning Environments, 25(2), 147–161. https://doi.org/10.1080/10494820.2016.1276078
Tu, C. H., & McIsaac, M. (2002). The relationship of social presence and interaction in online classes. American Journal of Distance Education, 16(3), 131–150. https://doi.org/10.1207/S15389286AJDE1603_2
Vail, A. K., Grafsgaard, J. F., Boyer, K. E., Wiebe, E. N., & Lester, J. C. (2016). Predicting learning from student affective response to tutor questions. Intelligent Tutoring Systems: 13th International Conference, ITS 2016, Zagreb, Croatia, June 7–10, 2016. Proceedings 13, 154–164.
Vail, A. K., & Boyer, K. E. (2014). Identifying effective moves in tutoring: On the refinement of dialogue act annotation schemes (pp. 199–209). International conference on intelligent tutoring systems: Springer International Publishing.
Vista, A., Awwal, N., & Care, E. (2016). Sequential actions as markers of behavioural and cognitive processes: Extracting empirical pathways from data streams of complex tasks. Computers & Education, 92, 15–36.
Vrikki, M., Kershner, R., Calcagni, E., Hennessy, S., Lee, L., Hernández, F., Estrada, N., & Ahmed, F. (2019). The teacher scheme for educational dialogue analysis (t-seda): Developing a research-based observation tool for supporting teacher inquiry into pupils’ participation in classroom dialogue. International Journal of Research & Method in Education, 42(2), 185–203.
Wang, D., Tao, Y., & Chen, G. (2024). Artificial intelligence in classroom discourse: A systematic review of the past decade. International Journal of Educational Research, 123, 102275.
Wood, D., Bruner, J. S., & Ross, G. (1976). The role of tutoring in problem solving. Journal of Child Psychology and Psychiatry, 17(2), 89–100.
Wu, S. Y., Chen, S. Y., & Hou, H. T. (2015). A study of users’ reactions to a mixed online discussion model: A lag sequential analysis approach. International Journal of Human-Computer Interaction, 31(3), 180–192.
Xu, S., Ding, W., & Liu, Z. (2020). Automatic dialogic instruction detection for k-12 online one-on-one classes. Artificial Intelligence in Education: 21st International Conference, AIED 2020, Ifrane, Morocco, July 6–10, 2020, Proceedings, Part II 21, 340– 345.
Zhang, L., Pan, M., Yu, S., Chen, L., & Zhang, J. (2023). Evaluation of a student-centered online one-to-one tutoring system. Interactive Learning Environments, 31(7), 4251–4269. https://doi.org/10.1080/10494820.2021.1958234
Zhang, S., Chen, J., Wen, Y., Chen, H., Gao, Q., & Wang, Q. (2021). Capturing regulatory patterns in online collaborative learning: A network analytic approach. International Journal of Computer-Supported Collaborative Learning, 16, 37–66. https://doi.org/10.1007/s11412-021-09339-5
Author information
Authors and Affiliations
Contributions
Deliang Wang and Lei Gao: conceptualization, methodology, investigation, formal analysis, writing—original draft, writing—reviewing and editing; Dapeng Shan, Gaowei Chen, Chenwei Zhang, and Ben Kao: methodology, reviewing and editing.
Corresponding author
Ethics declarations
Ethical Approval
Ethical approval was issued by the Human Research Ethics Committee of the University of Hong Kong.
Consent to Participate
Not applicable.
Consent for Publication
Not applicable.
Competing Interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, D., Gao, L., Shan, D. et al. When Tutors Simultaneously Instruct Students from the Primary, Middle, and High School Levels in Online One-on-One Tutoring: Investigating the Interaction Dynamics Using AI, ENA, and LSA Methods. J Sci Educ Technol (2024). https://doi.org/10.1007/s10956-024-10154-4
Accepted:
Published:
DOI: https://doi.org/10.1007/s10956-024-10154-4