Abstract
Artifact flow represents an important aspect of teaching / learning processes, especially in CSCL situations in which complex relationships may be found. However, consistent modeling of CSCL processes with artifact flow may increase the cognitive load and associated effort of the teachers-designers and therefore decrease the efficiency of the design process. The empirical study, reported in this paper and grounded on mixed methods, provides evidence of the effort overload when teachers are involved in designing CSCL situations in a controlled environment. The results of the study illustrate the problem through the subjective perception of the participating teachers, complemented with objective parameters, such as time consumed or errors committed, and objective complexity metrics.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The original questionnaires used in the study can be accessed at http://goo.gl/gS0Mxp [Q0] and http://goo.gl/vdOZCp [Q3].
References
Ameri, F., Summers, J., Mocko, G., Porter, M.: Engineering design complexity: an investigation of methods and measures. Res. Eng. Des. 19(2ā3), 161ā179 (2008)
BordiƩs, O., Dimitriadis, Y.: Using objective metrics to measure the effort overload in CSCL design processes that support artifact flow. In: 2014 IEEE 14th International Conference on Advanced Learning Technologies (ICALT). IEEE, Athens, Greece (2014)
BordiĆ©s, O., Papasalouros, A., Dimitriadis, Y.: Estimating the gap between informal descriptions and formal models of artifact flows in CSCL. In: de Freitas, S., Rensing, C., Ley, T., MuƱoz-Merino, P.J. (eds.) EC-TEL 2014. LNCS, vol. 8719, pp. 554ā555. Springer, Heidelberg (2014)
Braha, D., Maimon, O.: The measurement of a design structural and functional complexity. Syst. Man Cybern. Part A: Syst. Humans 28(4), 527ā535 (1998)
Cardoso, J.: Process control-flow complexity metric: an empirical validation. In: IEEE International Conference on Services Computing, 2006. SCC 2006, pp. 167ā173. SCC 2006. IEEE Computer Society, Washington, DC, USA (2006)
Casey, J., Brosnan, K., Greller, W., Masson, A., MacNeill, A., Murphy, C.: Designing for change: visual design tools to support process change in education. Handbook of Visual Languages in Instructional Design: Theories and Practices, pp. 413ā438 (2008)
Conole, G.: Designing for Learning in an Open World. Explorations in the Learning Sciences, Instructional Systems and Performance Technologies, vol. 4. Springer, New York (2012)
Creswell, J.W.: Research Design: Qualitative, Quantitative, and Mixed Methods approaches. Sage publications, Los Angeles (2013)
Derntl, M., Neumann, S., Griffiths, D., Oberhuemer, P.: The conceptual structure of ims learning design does not impede its use for authoring. IEEE Trans. Learn. Technol. 5(1), 74ā86 (2012)
Dillenbourg, P., Tchounikine, P.: Flexibility in macro-scripts for computer-supported collaborative learning. J. Comput. Assist. Learn. 23(1), 1ā13 (2007)
Dochy, F., Segers, M., Sluijsmans, D.: The use of self-, peer and co-assessment in higher education: a review. Stud. High. Educ. 24(3), 331ā350 (1999)
HernĆ”ndez-Leo, D., Villasclaras-Fernandez, E., Asensio-Perez, J., Dimitriadis, Y., Retalis, S.: CSCL scripting patterns: hierarchical relationships and applicability. In: Sixth International Conference on Advanced Learning Technologies, 2006, pp. 388ā392. ICALT 2006. IEEE Computer Society, Washington, DC, USA (2006)
Jung, J.Y., Chin, C.H., Cardoso, J.: An entropy-based uncertainty measure of process models. Inf. Process. Lett. 111(3), 135ā141 (2011)
Karakostas, A., Demetriadis, S.: Adaptation patterns as a conceptual tool for designing the adaptive operation of CSCL systems. Educ. Technol. Res. Dev. 59(3), 327ā349 (2011)
Karakostas, A., Prieto, L.P., Dimitriadis, Y.: Opportunities and challenges for adaptive collaborative support in distributed learning environments: evaluating the GLUE! suite of tools. In: 2012 IEEE 12th International Conference on Advanced Learning Technologies (ICALT), pp. 446ā450. IEEE (2012)
Malone, T.W., Crowston, K.: The interdisciplinary study of coordination. ACM Comput. Surv. 26(1), 87ā119 (1994)
McKenney, S., Kali, Y., Markauskaite, L., Voogt, J.: Teacher design knowledge for technology enhanced learning: an ecological framework for investigating assets and needs. Instr. Sci. 43(2), 181ā202 (2015)
Mendling, J.: Metrics for Process Models: Empirical Foundations of Verification, Error Prediction, and Guidelines for Correctness. Lectures Notes in Business Information Processing. Springer, Heidelberg (2008)
Mendling, J.: Metrics for business process models. In: Aalst, W., Mylopoulos, J., Rosemann, M., Shaw, M.J., Szyperski, C. (eds.) Metrics for Process Models. Lecture Notes in Business Information Processing, vol. 6, pp. 103ā133. Springer, Heidelberg (2009). Chapter 4
Miao, Y., Burgos, D., Griffiths, D., Koper, R.: Representation of coordination mechanisms in IMS learning design to support group-based learning. In: Lockyer, L., Bennet, S., Agostinho, S., Harper, B. (eds.) Handbook of Research on Learning Design and Learning Objects: Issues, Applications and Technologies, pp. 330ā351. IDEA group, Hershey (2008)
Muketha, G., Ghani, A., Selamat, M., Atan, R.: A survey of business process complexity metrics. Inf. Technol. J. 9(7), 1336ā1344 (2010)
Palomino-RamĆrez, L., Bote-Lorenzo, M., Asensio-PĆ©rez, J., de la Fuente-ValentĆn, L., Dimitriadis, Y.: The data flow problem in learning design: a case study. In: Proceedings of the 2008 8th International Conference on Networked Learning, NLC, pp. 285ā292. NLC 2008 (2008)
Prieto, L.P., Tchounikine, P., Asensio-PĆ©rez, J.I., Sobreira, P., Dimitriadis, Y.: Exploring teachersā perceptions on different CSCL script editing tools. Comput. Educ. 78, 383ā396 (2014)
RodrĆguez-Triana, M.J., MartĆnez-MonĆ©s, A., Asensio-PĆ©rez, J.I., Dimitriadis, Y.: Towards a script-aware monitoring process of computer-supported collaborative learning scenarios. Int. J. Technol. Enhanced Learn. 5(2), 151ā167 (2013)
SĆ”nchez-GonzĆ”lez, L., GarcĆa, F., Ruiz, F., Velthuis, M.P.: Measurement in business processes: a systematic review. Bus. Process Manag. J. 16(1), 114ā134 (2010)
Sen, C., Ameri, F., Summers, J.D.: An entropic method for sequencing discrete design decisions. J. Mech. Des. 132(10), 1ā11 (2010)
Sobreira, P., Tchounikine, P.: A model for flexibly editing CSCL scripts. Int. J. Comput.-Support. Collaborative Learn. 7(4), 567ā592 (2012)
Summers, J.D., Shah, J.J.: Mechanical engineering design complexity metrics: size, coupling, and solvability. J. Mech. Des. 132(2), 021004-1ā021004-11 (2010)
Suthers, D.: Technology affordances for intersubjective meaning making: a research agenda for CSCL. Int. J. Comput.-Support. Collaborative Learn. 1(3), 315ā337 (2006)
Wu, Y., Hernandez, F., Ortega, F., Clarke, P.J., France, R.: Measuring the effort for creating and using domain-specific models. In: Proceedings of the 10th Workshop on Domain-Specific Modeling. pp. 14:1ā14:6. DSM 2010. ACM, New York, NY, USA (2010)
Acknowledgments
This research has been partially funded by the Autonomous Government of Castilla and LeĆ³n, Spain (ORDEN EDU/346/2013), the Spanish Ministry of Economy and Competitiveness (Project TIN2011-28308-C03-02) and the European Education, Audiovisual and Culture Executive Agency Project 531262-LLP-2012-ES-KA3-KA3MP. The authors would like to thank the rest of the GSIC/EMIC research team, for their effort and contributions to the ideas expressed in this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
BordiƩs, O., Dimitriadis, Y. (2015). Measuring the Effort Demanded by CSCL Design Processes Supporting a Consistent Artifact Flow. In: Baloian, N., Zorian, Y., Taslakian, P., Shoukouryan, S. (eds) Collaboration and Technology. CRIWG 2015. Lecture Notes in Computer Science(), vol 9334. Springer, Cham. https://doi.org/10.1007/978-3-319-22747-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-319-22747-4_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-22746-7
Online ISBN: 978-3-319-22747-4
eBook Packages: Computer ScienceComputer Science (R0)