Abstract
When learning to code, children and novice programmers often transition from block-based to traditional text-based programming environments. This paper explores the usability problems within a block-based authoring environment, EduBlocks, that may hinder children’s learning. Using domain-specific heuristics, a usability evaluation was performed by expert evaluators, which was later combined with data from an analysis of problems reported in Forums, to produce a corpus of usability problems. The corpus was subsequently analysed using thematic analysis, and seven design guidelines were synthesized. Using the guidelines, a model of interaction was created to inform the design of block-based authoring environments that support the transition to text-based authoring. The model examines the interplay between learning within a school environment to independently using the authoring environment and how the interface can support these differing scenarios. This paper contributes to the design of effective user interfaces to support children learning to code and provides guidelines for developers of hybrid authoring environments to support the transition away from blocks.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
EduBlocks Curriculum https://curriculum.edublocks.org/.
- 2.
EduBlocks Feedback Forum https://app.edublocks.org/feedback.
References
Maloney, J., Resnick, M., Rusk, N., Silverman, B., Eastmond, E.: The scratch programming language and environment. ACM Trans. Comput. Educ. (TOCE) 10, 1–15 (2010)
Papert, S.A.: Mindstorms: Children, Computers, and Powerful Ideas. Basic Books, New York (2020)
Papavlasopoulou, S., Sharma, K., Giannakos, M.N.: How do you feel about learning to code? Investigating the effect of children’s attitudes towards coding using eye-tracking. Int. J. Child-Comput. Interact. 17, 50–60 (2018)
Park, Y., Shin, Y.: Comparing the effectiveness of scratch and app inventor with regard to learning computational thinking concepts. Electronics 8, 1269 (2019)
Tanrikulu, E., Schaefer, B.C.: The users who touched the ceiling of scratch. Procedia Soc. Behav. Sci. 28, 764–769 (2011)
Jimenez, Y., Kapoor, A., Gardner-McCune, C.: Usability challenges that novice programmers experience when using scratch for the first time. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 327–328. IEEE (2018)
Leßenich, O., Sobernig, S.: Usefulness and usability of heuristic walkthroughs for evaluating domain-specific developer tools in industry: evidence from four field simulations. Inf. Softw. Technol. 107220 (2023)
Denny, P., et al.: On designing programming error messages for novices: readability and its constituent factors. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. Article 55, Yokohama, Japan. Association for Computing Machinery (2021)
Dijkstra, E.W.: How do we tell truths that might hurt? ACM Sigplan Notices 17, 13–15 (1982)
Robinson, W.: From scratch to patch: easing the blocks-text transition. In: Proceedings of the 11th Workshop in Primary and Secondary Computing Education, Münster, Germany, pp. 96–99. Association for Computing Machinery (2016)
Konecki, M., Petrlic, M.: Main problems of programming novices and the right course of action. In: Central European Conference on Information and Intelligent Systems, p. 116. Faculty of Organization and Informatics Varazdin (2014)
Khalife, J.T.: Threshold for the introduction of programming: providing learners with a simple computer model. In: 28th International Conference on Information Technology Interfaces, pp. 71–76. IEEE (2006)
Du Boulay, B.: Some difficulties of learning to program. J. Educ. Comput. Res. 2, 57–73 (1986)
Sorva, J.: Notional machines and introductory programming education. Trans. Comput. Educ 13, 1–31 (2007)
Becker, B.A., et al.: Compiler error messages considered unhelpful: the landscape of text-based programming error message research. In: Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education, pp. 177–210 (2019)
Moors, L., Luxton-Reilly, A., Denny, P.: Transitioning from block-based to text-based programming languages. In: 2018 International Conference on Learning and Teaching in Computing and Engineering (LaTICE), pp. 57–64. IEEE (2018)
Resnick, M., et al.: Scratch: programming for all. Commun. ACM 52, 60–67 (2009)
Lin, Y., Weintrop, D.: The landscape of Block-based programming: characteristics of block-based environments and how they support the transition to text-based programming. J. Comput. Lang. 67, 101075 (2021)
Kölling, M., Brown, N.C., Altadmri, A.: Frame-based editing: easing the transition from blocks to text-based programming. In: Proceedings of the Workshop in Primary and Secondary Computing Education, pp. 29–38 (2015)
Storey, M.-A., et al.: Improving the usability of Eclipse for novice programmers. In: Proceedings of the 2003 OOPSLA Workshop on Eclipse Technology eXchange, pp. 35–39 (2003)
Kölling, M., Brown, N.C., Hamza, H., McCall, D.: Stride in BlueJ--computing for all in an educational IDE. In: Proceedings of the 50th ACM Technical Symposium on Computer Science Education, pp. 63–69 (2019)
Weintrop, D., Wilensky, U.: To block or not to block, that is the question: students’ perceptions of blocks-based programming. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 199–208 (2015)
Bak, N., Chang, B.-M., Choi, K.: Smart Block: A visual block language and its programming environment for IoT. J. Comput. Lang. 60, 100999 (2020)
Kim, C., Yuan, J., Vasconcelos, L., Shin, M., Hill, R.B.: Debugging during block-based programming. Instr. Sci. 46, 767–787 (2018)
Strong, G., North, B.: Pytch—an environment for bridging block and text programming styles (Work in progress). In: The 16th Workshop in Primary and Secondary Computing Education, pp. 1–4 (2021)
Burnett, M.M., McIntyre, D.W.: Visual programming. In: COMPUTER-LOS ALAMITOS, vol. 28, p. 14 (1995)
Mountapmbeme, A., Okafor, O., Ludi, S.: Accessible Blockly: an accessible block-based programming library for people with visual impairments. In: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–15 (2022)
Shepherd, D., Francis, P., Weintrop, D., Franklin, D., Li, B., Afzal, A.: [Engineering Paper] An IDE for easy programming of simple robotics tasks. In: 2018 IEEE 18th International Working Conference on Source Code Analysis and Manipulation (SCAM), pp. 209–214. IEEE (2018)
Morales, J., Rusu, C.: Usability perception of visual programming language: a case study. In: CEUR Workshop Proceedings, pp. 83–88 (2020)
Toro-Guajardo, S., Lizama, E., Gutierrez, F.J.: Gesture coding: easing the introduction to block-based programming languages with motion controls. In: Bravo, J., Ochoa, S., Favela, J. (eds.) Ubiquitous Computing and Ambient Intelligence, pp. 840–851. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-21333-5_84
De Siqueira, A.G., Feijóo-García, P.G., Stanley, S.P.: BlockXR: a novel tangible block-based programming platform. In: 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 1–4. IEEE (2021)
Okafor, O., Ludi, S.: Voice-enabled blockly: usability impressions of a speech-driven block-based programming system. In: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–5 (2022)
Koitz, R., Slany, W.: Empirical comparison of visual to hybrid formula manipulation in educational programming languages for teenagers. In: Proceedings of the 5th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 21–30 (2014)
Holwerda, R., Hermans, F.: A usability analysis of blocks-based programming editors using cognitive dimensions. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 217–225. IEEE (2018)
Harvey, B., Mönig, J.: Bringing “no ceiling” to scratch: can one language serve kids and computer scientists. Proc. Constructionism 1–10 (2010)
Monig, J., Ohshima, Y., Maloney, J.: Blocks at your fingertips: blurring the line between blocks and text in GP. In: 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond), pp. 51–53. IEEE (2015)
Pasternak, E., Fenichel, R., Marshall, A.N.: Tips for creating a block language with blockly. In: 2017 IEEE blocks and beyond workshop (B&B), pp. 21–24. IEEE (2017)
Patton, E.W., Tissenbaum, M., Harunani, F.: MIT app inventor: objectives, design, and development. In: Kong, S.-C., Abelson, H. (eds.) Computational thinking education, pp. 31–49. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-6528-7_3
Fraser, N.: Ten things we've learned from Blockly. In: 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond), pp. 49–50. IEEE (2015)
Weintrop, D., Shepherd, D.C., Francis, P., Franklin, D.: Blockly goes to work: block-based programming for industrial robots. In: 2017 IEEE Blocks and Beyond Workshop (B&B), pp. 29–36. IEEE (2017)
Zubair, M.S., Brown, D., Hughes-Roberts, T., Bates, M.: Evaluating the accessibility of scratch for children with cognitive impairments. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2018. LNCS, vol. 10907, pp. 660–676. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92049-8_49
Lowe, J.: Hello World. The Magazine for Computing and Digital Making Educators. Raspberry Pi Foundation (2020)
Youtube. https://www.youtube.com/watch?v=Sp6o6S15sPM&ab_channel=CASTV
Kölling, M., McKay, F.: Heuristic evaluation for novice programming systems. ACM Trans. Comput. Educ. (TOCE) 16, 1–30 (2016)
Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 373–380. ACM (1992)
Nielsen, J., Molich, R.: Heuristic evaluation of the user interface. In: SIGCHI Conference on Human Factors in Computing Systems: Empowering People, Seattle, pp. 249–256. ACM (1990)
Woolrych, A., Cockton, G.: Testing a conjecture based on the DR-AR model of usability inspection method effectiveness. In: 16th British HCI Group Annual Conference, pp. 1–4. British HCI Group (2002)
Zhang, J., Johnson, T.R., Patel, V.L., Paige, D.L., Kubose, T.: Using usability heuristics to evaluate patient safety of medical devices. J. Biomed. Inform. 36, 23–30 (2003)
Kiger, M.E., Varpio, L.: Thematic analysis of qualitative data: AMEE Guide No. 131. Med. Teach. 42, 846–854 (2020)
Shen, Y., Qiu, Y., Li, K., Liu, Y.: Beelight: helping children discover colors. In: Proceedings of the 12th International Conference on Interaction Design and Children, pp. 301–304 (2013)
Quinlan, O.: Young Digital Makers: Surveying Attitudes and Opportunities for Digital Creativity Across the UK [online]. London (2015). Accessed 7 Feb 2018
McKnight, L., Read, J.C.: PLU-E: a proposed framework for planning and conducting evaluation studies with children. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction, Newcastle-upon-Tyne, United Kingdom, pp. 126–131. British Computer Society (2011)
Read, J.C., Bekker, M.M.: The nature of child computer interaction. In: Proceedings of HCI 2011 the 25th BCS Conference on Human Computer Interaction, vol. 25, pp. 1–9 (2011)
Blythe, M.A., Monk, A.F., Overbeeke, K., Wright, P.C.: Funology: From Usability to Enjoyment. Human Computer Interaction Series. Kluwer Academic Publishers, Dordecht (2003)
Malone, T.W., Lepper, M.R.: Making learning fun: a taxonomy of intrinsic motivations for learning. In: Snow, R.E., Farr, M.J. (eds.) Aptitude, Learning and Instruction. Volume 3: Cognitive and Affective Process Analysis. Erlbaum, Hillsdale (1987)
Sim, G., MacFarlane, S., Read, J.C.: All work and no play: measuring fun, usability and learning in software for children. Comput. Educ. 46, 235–248 (2006)
Sim, G., Nouwen, M., Vissers, J., Horton, M., Slegers, K., Zaman, B.: Using the Memoline to capture changes in user experience over time with children. Int. J. Child-Comput. Interact. (2016)
Tisza, G., Markopoulos, P.: Understanding the role of fun in learning to code. Int. J. Child-Comput. Interact. 28, 100270 (2021)
Liu, J., Wong, C.K., Hui, K.K.: An adaptive user interface based on personalized learning. IEEE Intell. Syst. 18, 52–57 (2003)
Rieman, J.: A field study of exploratory learning strategies. ACM Trans. Comput.-Hum. Interact. (TOCHI) 3, 189–218 (1996)
Henrie, C.R., Halverson, L.R., Graham, C.R.: Measuring student engagement in technology-mediated learning: a review. Comput. Educ. 90, 36–53 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Sim, G., Lochrie, M., Zubair, M.S., Kerr, O., Bates, M. (2023). Moving Away from the Blocks: Evaluating the Usability of EduBlocks for Supporting Children to Transition from Block-Based Programming. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-031-42280-5_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-42279-9
Online ISBN: 978-3-031-42280-5
eBook Packages: Computer ScienceComputer Science (R0)