Skip to main content

Moving Away from the Blocks: Evaluating the Usability of EduBlocks for Supporting Children to Transition from Block-Based Programming

  • Conference paper
  • First Online:
Human-Computer Interaction – INTERACT 2023 (INTERACT 2023)

Abstract

When learning to code, children and novice programmers often transition from block-based to traditional text-based programming environments. This paper explores the usability problems within a block-based authoring environment, EduBlocks, that may hinder children’s learning. Using domain-specific heuristics, a usability evaluation was performed by expert evaluators, which was later combined with data from an analysis of problems reported in Forums, to produce a corpus of usability problems. The corpus was subsequently analysed using thematic analysis, and seven design guidelines were synthesized. Using the guidelines, a model of interaction was created to inform the design of block-based authoring environments that support the transition to text-based authoring. The model examines the interplay between learning within a school environment to independently using the authoring environment and how the interface can support these differing scenarios. This paper contributes to the design of effective user interfaces to support children learning to code and provides guidelines for developers of hybrid authoring environments to support the transition away from blocks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 79.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    EduBlocks Curriculum https://curriculum.edublocks.org/.

  2. 2.

    EduBlocks Feedback Forum https://app.edublocks.org/feedback.

References

  1. Maloney, J., Resnick, M., Rusk, N., Silverman, B., Eastmond, E.: The scratch programming language and environment. ACM Trans. Comput. Educ. (TOCE) 10, 1–15 (2010)

    Article  Google Scholar 

  2. Papert, S.A.: Mindstorms: Children, Computers, and Powerful Ideas. Basic Books, New York (2020)

    Google Scholar 

  3. Papavlasopoulou, S., Sharma, K., Giannakos, M.N.: How do you feel about learning to code? Investigating the effect of children’s attitudes towards coding using eye-tracking. Int. J. Child-Comput. Interact. 17, 50–60 (2018)

    Article  Google Scholar 

  4. Park, Y., Shin, Y.: Comparing the effectiveness of scratch and app inventor with regard to learning computational thinking concepts. Electronics 8, 1269 (2019)

    Article  Google Scholar 

  5. Tanrikulu, E., Schaefer, B.C.: The users who touched the ceiling of scratch. Procedia Soc. Behav. Sci. 28, 764–769 (2011)

    Article  Google Scholar 

  6. Jimenez, Y., Kapoor, A., Gardner-McCune, C.: Usability challenges that novice programmers experience when using scratch for the first time. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 327–328. IEEE (2018)

    Google Scholar 

  7. Leßenich, O., Sobernig, S.: Usefulness and usability of heuristic walkthroughs for evaluating domain-specific developer tools in industry: evidence from four field simulations. Inf. Softw. Technol. 107220 (2023)

    Google Scholar 

  8. Denny, P., et al.: On designing programming error messages for novices: readability and its constituent factors. In: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. Article 55, Yokohama, Japan. Association for Computing Machinery (2021)

    Google Scholar 

  9. Dijkstra, E.W.: How do we tell truths that might hurt? ACM Sigplan Notices 17, 13–15 (1982)

    Article  Google Scholar 

  10. Robinson, W.: From scratch to patch: easing the blocks-text transition. In: Proceedings of the 11th Workshop in Primary and Secondary Computing Education, Münster, Germany, pp. 96–99. Association for Computing Machinery (2016)

    Google Scholar 

  11. Konecki, M., Petrlic, M.: Main problems of programming novices and the right course of action. In: Central European Conference on Information and Intelligent Systems, p. 116. Faculty of Organization and Informatics Varazdin (2014)

    Google Scholar 

  12. Khalife, J.T.: Threshold for the introduction of programming: providing learners with a simple computer model. In: 28th International Conference on Information Technology Interfaces, pp. 71–76. IEEE (2006)

    Google Scholar 

  13. Du Boulay, B.: Some difficulties of learning to program. J. Educ. Comput. Res. 2, 57–73 (1986)

    Article  Google Scholar 

  14. Sorva, J.: Notional machines and introductory programming education. Trans. Comput. Educ 13, 1–31 (2007)

    Google Scholar 

  15. Becker, B.A., et al.: Compiler error messages considered unhelpful: the landscape of text-based programming error message research. In: Proceedings of the Working Group Reports on Innovation and Technology in Computer Science Education, pp. 177–210 (2019)

    Google Scholar 

  16. Moors, L., Luxton-Reilly, A., Denny, P.: Transitioning from block-based to text-based programming languages. In: 2018 International Conference on Learning and Teaching in Computing and Engineering (LaTICE), pp. 57–64. IEEE (2018)

    Google Scholar 

  17. Resnick, M., et al.: Scratch: programming for all. Commun. ACM 52, 60–67 (2009)

    Article  Google Scholar 

  18. Lin, Y., Weintrop, D.: The landscape of Block-based programming: characteristics of block-based environments and how they support the transition to text-based programming. J. Comput. Lang. 67, 101075 (2021)

    Article  Google Scholar 

  19. Kölling, M., Brown, N.C., Altadmri, A.: Frame-based editing: easing the transition from blocks to text-based programming. In: Proceedings of the Workshop in Primary and Secondary Computing Education, pp. 29–38 (2015)

    Google Scholar 

  20. Storey, M.-A., et al.: Improving the usability of Eclipse for novice programmers. In: Proceedings of the 2003 OOPSLA Workshop on Eclipse Technology eXchange, pp. 35–39 (2003)

    Google Scholar 

  21. Kölling, M., Brown, N.C., Hamza, H., McCall, D.: Stride in BlueJ--computing for all in an educational IDE. In: Proceedings of the 50th ACM Technical Symposium on Computer Science Education, pp. 63–69 (2019)

    Google Scholar 

  22. Weintrop, D., Wilensky, U.: To block or not to block, that is the question: students’ perceptions of blocks-based programming. In: Proceedings of the 14th International Conference on Interaction Design and Children, pp. 199–208 (2015)

    Google Scholar 

  23. Bak, N., Chang, B.-M., Choi, K.: Smart Block: A visual block language and its programming environment for IoT. J. Comput. Lang. 60, 100999 (2020)

    Article  Google Scholar 

  24. Kim, C., Yuan, J., Vasconcelos, L., Shin, M., Hill, R.B.: Debugging during block-based programming. Instr. Sci. 46, 767–787 (2018)

    Article  Google Scholar 

  25. Strong, G., North, B.: Pytch—an environment for bridging block and text programming styles (Work in progress). In: The 16th Workshop in Primary and Secondary Computing Education, pp. 1–4 (2021)

    Google Scholar 

  26. Burnett, M.M., McIntyre, D.W.: Visual programming. In: COMPUTER-LOS ALAMITOS, vol. 28, p. 14 (1995)

    Google Scholar 

  27. Mountapmbeme, A., Okafor, O., Ludi, S.: Accessible Blockly: an accessible block-based programming library for people with visual impairments. In: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–15 (2022)

    Google Scholar 

  28. Shepherd, D., Francis, P., Weintrop, D., Franklin, D., Li, B., Afzal, A.: [Engineering Paper] An IDE for easy programming of simple robotics tasks. In: 2018 IEEE 18th International Working Conference on Source Code Analysis and Manipulation (SCAM), pp. 209–214. IEEE (2018)

    Google Scholar 

  29. Morales, J., Rusu, C.: Usability perception of visual programming language: a case study. In: CEUR Workshop Proceedings, pp. 83–88 (2020)

    Google Scholar 

  30. Toro-Guajardo, S., Lizama, E., Gutierrez, F.J.: Gesture coding: easing the introduction to block-based programming languages with motion controls. In: Bravo, J., Ochoa, S., Favela, J. (eds.) Ubiquitous Computing and Ambient Intelligence, pp. 840–851. Springer, Cham (2023). https://doi.org/10.1007/978-3-031-21333-5_84

  31. De Siqueira, A.G., Feijóo-García, P.G., Stanley, S.P.: BlockXR: a novel tangible block-based programming platform. In: 2021 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 1–4. IEEE (2021)

    Google Scholar 

  32. Okafor, O., Ludi, S.: Voice-enabled blockly: usability impressions of a speech-driven block-based programming system. In: Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 1–5 (2022)

    Google Scholar 

  33. Koitz, R., Slany, W.: Empirical comparison of visual to hybrid formula manipulation in educational programming languages for teenagers. In: Proceedings of the 5th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 21–30 (2014)

    Google Scholar 

  34. Holwerda, R., Hermans, F.: A usability analysis of blocks-based programming editors using cognitive dimensions. In: 2018 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 217–225. IEEE (2018)

    Google Scholar 

  35. Harvey, B., Mönig, J.: Bringing “no ceiling” to scratch: can one language serve kids and computer scientists. Proc. Constructionism 1–10 (2010)

    Google Scholar 

  36. Monig, J., Ohshima, Y., Maloney, J.: Blocks at your fingertips: blurring the line between blocks and text in GP. In: 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond), pp. 51–53. IEEE (2015)

    Google Scholar 

  37. Pasternak, E., Fenichel, R., Marshall, A.N.: Tips for creating a block language with blockly. In: 2017 IEEE blocks and beyond workshop (B&B), pp. 21–24. IEEE (2017)

    Google Scholar 

  38. Patton, E.W., Tissenbaum, M., Harunani, F.: MIT app inventor: objectives, design, and development. In: Kong, S.-C., Abelson, H. (eds.) Computational thinking education, pp. 31–49. Springer, Singapore (2019). https://doi.org/10.1007/978-981-13-6528-7_3

    Chapter  Google Scholar 

  39. Fraser, N.: Ten things we've learned from Blockly. In: 2015 IEEE Blocks and Beyond Workshop (Blocks and Beyond), pp. 49–50. IEEE (2015)

    Google Scholar 

  40. Weintrop, D., Shepherd, D.C., Francis, P., Franklin, D.: Blockly goes to work: block-based programming for industrial robots. In: 2017 IEEE Blocks and Beyond Workshop (B&B), pp. 29–36. IEEE (2017)

    Google Scholar 

  41. Zubair, M.S., Brown, D., Hughes-Roberts, T., Bates, M.: Evaluating the accessibility of scratch for children with cognitive impairments. In: Antona, M., Stephanidis, C. (eds.) UAHCI 2018. LNCS, vol. 10907, pp. 660–676. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-92049-8_49

    Chapter  Google Scholar 

  42. Lowe, J.: Hello World. The Magazine for Computing and Digital Making Educators. Raspberry Pi Foundation (2020)

    Google Scholar 

  43. Youtube. https://www.youtube.com/watch?v=Sp6o6S15sPM&ab_channel=CASTV

  44. Kölling, M., McKay, F.: Heuristic evaluation for novice programming systems. ACM Trans. Comput. Educ. (TOCE) 16, 1–30 (2016)

    Article  Google Scholar 

  45. Nielsen, J.: Finding usability problems through heuristic evaluation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 373–380. ACM (1992)

    Google Scholar 

  46. Nielsen, J., Molich, R.: Heuristic evaluation of the user interface. In: SIGCHI Conference on Human Factors in Computing Systems: Empowering People, Seattle, pp. 249–256. ACM (1990)

    Google Scholar 

  47. Woolrych, A., Cockton, G.: Testing a conjecture based on the DR-AR model of usability inspection method effectiveness. In: 16th British HCI Group Annual Conference, pp. 1–4. British HCI Group (2002)

    Google Scholar 

  48. Zhang, J., Johnson, T.R., Patel, V.L., Paige, D.L., Kubose, T.: Using usability heuristics to evaluate patient safety of medical devices. J. Biomed. Inform. 36, 23–30 (2003)

    Article  Google Scholar 

  49. Kiger, M.E., Varpio, L.: Thematic analysis of qualitative data: AMEE Guide No. 131. Med. Teach. 42, 846–854 (2020)

    Google Scholar 

  50. Shen, Y., Qiu, Y., Li, K., Liu, Y.: Beelight: helping children discover colors. In: Proceedings of the 12th International Conference on Interaction Design and Children, pp. 301–304 (2013)

    Google Scholar 

  51. Quinlan, O.: Young Digital Makers: Surveying Attitudes and Opportunities for Digital Creativity Across the UK [online]. London (2015). Accessed 7 Feb 2018

    Google Scholar 

  52. McKnight, L., Read, J.C.: PLU-E: a proposed framework for planning and conducting evaluation studies with children. In: Proceedings of the 25th BCS Conference on Human-Computer Interaction, Newcastle-upon-Tyne, United Kingdom, pp. 126–131. British Computer Society (2011)

    Google Scholar 

  53. Read, J.C., Bekker, M.M.: The nature of child computer interaction. In: Proceedings of HCI 2011 the 25th BCS Conference on Human Computer Interaction, vol. 25, pp. 1–9 (2011)

    Google Scholar 

  54. Blythe, M.A., Monk, A.F., Overbeeke, K., Wright, P.C.: Funology: From Usability to Enjoyment. Human Computer Interaction Series. Kluwer Academic Publishers, Dordecht (2003)

    Google Scholar 

  55. Malone, T.W., Lepper, M.R.: Making learning fun: a taxonomy of intrinsic motivations for learning. In: Snow, R.E., Farr, M.J. (eds.) Aptitude, Learning and Instruction. Volume 3: Cognitive and Affective Process Analysis. Erlbaum, Hillsdale (1987)

    Google Scholar 

  56. Sim, G., MacFarlane, S., Read, J.C.: All work and no play: measuring fun, usability and learning in software for children. Comput. Educ. 46, 235–248 (2006)

    Article  Google Scholar 

  57. Sim, G., Nouwen, M., Vissers, J., Horton, M., Slegers, K., Zaman, B.: Using the Memoline to capture changes in user experience over time with children. Int. J. Child-Comput. Interact. (2016)

    Google Scholar 

  58. Tisza, G., Markopoulos, P.: Understanding the role of fun in learning to code. Int. J. Child-Comput. Interact. 28, 100270 (2021)

    Article  Google Scholar 

  59. Liu, J., Wong, C.K., Hui, K.K.: An adaptive user interface based on personalized learning. IEEE Intell. Syst. 18, 52–57 (2003)

    Article  Google Scholar 

  60. Rieman, J.: A field study of exploratory learning strategies. ACM Trans. Comput.-Hum. Interact. (TOCHI) 3, 189–218 (1996)

    Article  Google Scholar 

  61. Henrie, C.R., Halverson, L.R., Graham, C.R.: Measuring student engagement in technology-mediated learning: a review. Comput. Educ. 90, 36–53 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gavin Sim .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sim, G., Lochrie, M., Zubair, M.S., Kerr, O., Bates, M. (2023). Moving Away from the Blocks: Evaluating the Usability of EduBlocks for Supporting Children to Transition from Block-Based Programming. In: Abdelnour Nocera, J., Kristín Lárusdóttir, M., Petrie, H., Piccinno, A., Winckler, M. (eds) Human-Computer Interaction – INTERACT 2023. INTERACT 2023. Lecture Notes in Computer Science, vol 14142. Springer, Cham. https://doi.org/10.1007/978-3-031-42280-5_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42280-5_19

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42279-9

  • Online ISBN: 978-3-031-42280-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

pFad - Phonifier reborn

Pfad - The Proxy pFad of © 2024 Garber Painting. All rights reserved.

Note: This service is not intended for secure transactions such as banking, social media, email, or purchasing. Use at your own risk. We assume no liability whatsoever for broken pages.


Alternative Proxies:

Alternative Proxy

pFad Proxy

pFad v3 Proxy

pFad v4 Proxy