Abstract
This study is intended to provide an example of computational modeling (CM) experiment using machine learning algorithms. Specific outcomes modeled in this study are the predicted influences associated with the Science Writing Heuristic (SWH) and associated with the completion of question items for the Cornell Critical Thinking Test. The Student Task and Cognition Model in this study uses cognitive data from a large-scale randomized control study. Results of the computational model experiment provide for the possibility to increase student success via targeted cognitive retraining of specific cognitive attributes via the SWH. This study also illustrates that computational modeling using machine learning algorithms (MLA) is a significant resource for testing educational interventions, informs specific hypotheses, and assists in the design and development of future research designs in science education research.




Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Ab Kadir, M. A. (2018). An inquiry into critical thinking in the Australian curriculum: examining its conceptual understandings and their implications on developing critical thinking as a “general capability” on teachers’ practice and knowledge. Asia Pacific Journal of Education, 38(4), 533–549.
Albus, J. S. (2010). A model of computation and representation in the brain. Information Sciences, 180(9), 1519–1554.
Arciniegas, D. B. (2013). Structural and Functional Neuroanatomy. Behavioral Neurology & Neuropsychiatry, 266.
Barbey, A. K., Colom, R., Solomon, J., Krueger, F., Forbes, C., & Grafman, J. (2012). An integrative architecture for general intelligence and executive function revealed by lesion mapping. Brain, 135(4), 1154-1164.
Berger, T. W., Song, D., Chan, R. H., Marmarelis, V. Z., LaCoss, J., Wills, J., & Granacki, J. J. (2012). A hippocampal cognitive prosthesis: multi-input, multi-output nonlinear modeling and VLSI implementation. Neural Systems and Rehabilitation Engineering, IEEE Transactions on, 20(2), 198–211.
Bichi, A. A., & Talib, R. (2018). Item response theory: an introduction to latent trait models to test and item development. International Journal of Evaluation and Research in Education, 7(2), 142–151.
Bond, C. E., Philo, C., & Shipton, Z. K. (2011). When there isn’t a right answer: interpretation and reasoning, key skills for twenty-first century geoscience. International Journal of Science Education, 33, 629–652.
Borra, S., & Di Ciaccio, A. (2010). Measuring the prediction error: a comparison of cross-validation, bootstrap and covariance penalty methods. Computational statistics & data analysis, 54(12), 2976–2989.
Chen, S., & Tan, D. (2018). A SA-ANN-based modeling method for human cognition mechanism and the PSACO cognition algorithm. Complexity 2018.
Choubin, B., Khalighi-Sigaroodi, S., Malekian, A., & Kişi, Ö. (2016). Multiple linear regression, multi-layer perceptron network and adaptive neuro-fuzzy inference system for forecasting precipitation based on large-scale climate signals. Hydrological Sciences Journal, 61(6), 1001-1009.
Cowan, N. (2017). The many faces of working memory and short-term storage. Psychonomic bulletin & review, 24(4), 1158–1170.
De La Torre, J. (2008). An empirically based method of Q-matrix validation for the DINA model: development and applications. Journal of educational measurement, 45(4), 343–362.
Dimitrov, D. (2012). Statistical methods for validation of assessment scale data in counseling and related fields. Alexandria, VA: American Counseling Association using their item response theory parameters. Applied Psychological Measurement, 31, 367–387.
Eason, S. H., & Ramani, G. B. (2017). Parental guidance and children’s executive function: working memory and planning as moderators during joint problem-solving. Infant and Child Development, 26(2), e1982.
Ennis, R. H., Millman, J., & Tomko, T. N. (1985). Cornell Critical Thinking Test, level X & level Z-manual (3rd ed.). PacificGrove, CA: Midwest.
Fleiss, J. L. (1971). Measuring nominal scale agreement among many raters. Psychological bulletin, 76(5), 378.
Frank, M. J., Loughry, B., & O’Reilly, R. C. (2001). Interactions between frontal cortex and basal ganglia in working memory: a computational model. Cognitive, Affective, & Behavioral Neuroscience, 1(2), 137–160.
Galbraith, D. (2009). Cognitive models of writing.German as a foreign language, (2-3), 7-22.
Gallant, S. (1993). Neural network learning and expert systems. London, England: MIT Press.
Galotti, K. M. (2013). Cognitive psychology in and out of the laboratory. Incorporated: SAGE Publications.
Gavin, H. P. (2019). The Levenberg-Marquardt algorithm for nonlinear least squares curve-fitting problems.
Goertzel, B., Lian, R., Arel, I., De Garis, H., & Chen, S. (2010). A world survey of artificial brain projects, part II: biologically inspired cognitive architectures. Neurocomputing, 74(1–3), 30–49.
Güçlü, U., & van Gerven, M. A. (2014). Unsupervised feature learning improves prediction of human brain activity in response to natural images. PLoS Comput Biol, 10(8), e1003724.
Hand, B., & Keys, C. W. (1999). Inquiry investigation. The Science Teacher, 66(4), 27.
Hanes, D. P., & Schall, J. D. (1996). Neural control of voluntary movement initiation. Science, 274(5286), 427–430.
Hass, R. W., & Beaty, R. E. (2018). Use or consequences: probing the cognitive difference between two measures of divergent thinking. Frontiers in psychology, 9, 2327.
Havaei, M., Davy, A., Warde-Farley, D., Biard, A., Courville, A., Bengio, Y., & Larochelle, H. (2017). Brain tumor segmentation with deep neural networks. Medical image analysis, 35, 18–31.
Hebb, D.O. (1961). Distinctive features of learning in the higher animal J. F. Delafresnaye (Ed.) Brain mechanisms and learning, London: Oxford University Press.
Huys, Q. J., Maia, T. V., & Frank, M. J. (2016). Computational psychiatry as a bridge from neuroscience to clinical applications. Nature neuroscience, 19(3), 404.
Hwang, G. J., & Chang, H. F. (2011). A formative assessment-based mobile learning approach to improving the learning attitudes and achievements of students. Computers & Education, 56(4), 1023–1031.
Jager, W. (2017). Enhancing the realism of simulation (EROS): on implementing and developing psychological theory in social simulation. Journal of Artificial Societies and Social Simulation, 20(3).
Japardi, K., Bookheimer, S., Knudsen, K., Ghahremani, D. G., & Bilder, R. M. (2018). Functional magnetic resonance imaging of divergent and convergent thinking in Big-C creativity. Neuropsychologia, 118, 59–67.
Jeon, H. (2014). Hierarchical processing in the prefrontal cortex in a variety of cognitive domains. Frontiers in systems neuroscience, 8, 223.
Kang, C. Y., Duncan, G. J., Clements, D. H., Sarama, J., & Bailey, D. H. (2018). The roles of transfer of learning and forgetting in the persistence and fadeout of early childhood mathematics interventions. Journal of Educational Psychology.
Kriegeskorte, N., & Douglas, P. K. (2018). Cognitive computational neuroscience. Nature neuroscience, 21(9), 1148–1160.
Lachaux, J. P., Axmacher, N., Mormann, F., Halgren, E., & Crone, N. E. (2012). High-frequency neural activity and human cognition: past, present and possible future of intracranial EEG research. Progress in Neurobiology.
Lam, Y. W., Hew, K. F., & Chiu, K. F. (2018). Improving argumentative writing: effects of a blended learning approach and gamification. Language learning & technology, 22(1), 97–118.
Lamb, R. L. (2013). The application of cognitive diagnostic approaches via neural network analysis of serious educational games (Doctoral dissertation).
Lamb, R., & Annetta, L. (2009). A pilot study of online simulations and problem based learning in a chemistry classroom. Journal of Virginia Science Educator, 3(2), 34-50.
Lamb, R., & Premo, J. (2015). Computational modeling of teaching and learning through application of evolutionary algorithms. Computation, 3(3), 427-443.
Lamb, R., Annetta, L., & Vallet, D. (2015). The interface of creativity, fluency, lateral thinking and technology while designing Serious Educational Games in a science classroom.
Lamb, R., Firestone, J. B., & Ardasheva, Y. (2016). A computational modeling of rapid attitude formation during surveys about immigrants and immigration. Computers in Human Behavior, 63, 179-188.
Lamb, R., Hand, B., & Yoon, S. (2017). Examinations of cognitive processing of science writing tasks. Journal of Psychology and Brain Studies, 1(1), 1-5.
Lamb, R. L., Annetta, L., Meldrum, J., & Vallett, D. (2012). Measuring science interest: Rasch validation of the science interest survey. International Journal of Science and Mathematics Education, 10(3), 643-668.
Lamb, R. L., Annetta, L., Vallett, D. B., & Sadler, T. D. (2014). Cognitive diagnostic like approaches using neural-network analysis of serious educational videogames. Computers & Education, 70, 92-104.
Lamb, R. L., Etopio, E., Hand, B., & Yoon, S. Y. (2019). Virtual reality simulation: Effects on academic performance within two domains of writing in science. Journal of Science Education and Technology, 28(4), 371-381.
Lamb, R. L., Vallett, D. B., Akmal, T., & Baldwin, K. (2014). A computational modeling of student cognitive processes in science education. Computers & Education, 79, 116-125.
Lamb, R., Annetta, L., Hoston, D., Shapiro, M., & Matthews, B. (2018). Examining human behavior in video games: The development of a computational model to measure aggression. Social neuroscience, 13(3), 301-317.
López, D., Vera, N., & Pedraza, L. (2017). Analysis of multilayer neural network modeling and long short-term memory. International Journal of Mathematical and Computational Sciences, 10(12), 697–702.
Love, B. C., Medin, D. L., & Gureckis, T. M. (2004). SUSTAIN: a network model of category learning. Psychological review, 111(2), 309.
Ma, W., & de la Torre, J. (2020). An empirical Q-matrix validation method for the sequential generalized DINA model. British Journal of Mathematical and Statistical Psychology, 73(1), 142–163.
Manktedlow, K. (2012). Thinking and reasoning: an introduction to the psychology of reason, judgment, and decision making. New York, NY: Psychology Press.
Meltzoff, J., & Cooper, H. (2018).Critical thinking about research: Psychology and related fields. American psychological association.
Montague, P. R., Dolan, R. J., Friston, K. J., & Dayan, P. (2012). Computational psychiatry.Trends in cognitive sciences,16(1), 72-80.
Morrison, T. M., Pathmanathan, P., Adwan, M., & Margerrison, E. (2018). Advancing regulatory science with computational modeling for medical devices at the FDA’s Office of Science and Engineering Laboratories. Frontiers in medicine, 5, 241.
Myers, N. E., Stokes, M. G., & Nobre, A. C. (2017). Prioritizing information during working memory: beyond sustained internal attention. Trends in Cognitive Sciences, 21(6), 449–461.
National Institutes of Health. (2020). RFA-AI 19–0011. Rederived from: https://grants.nih.gov/grants/guide/rfa-files/RFA-Ai-19-011.html.
National Science Foundation. (2020). NSF Award Abstract #9314946. Retrieved from: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9314946.
O’Reilly, R. C. (2006). Biologically based computational models of high-level cognition. Science, 314(5796), 91–94.
Palmeri, T. J., Love, B. C., & Turner, B. M. (2017). Model-based cognitive neuroscience.
Palminteri, S., Wyart, V., & Koechlin, E. (2017). The importance of falsification in computational cognitive modeling. Trends in cognitive sciences, 21(6), 425–433.
Park, H. J., & Friston, K. (2013). Structural and functional brain networks: from connections to cognition. Science, 342(6158), 1238411.
Prasad, J. A. (2018). Exploring executive functions using a distributed circuit model. The Journal of Neuroscience, 38(22), 5039.
Sarıca, H. Ç, & Usluel, Y. K. (2016). The effect of digital storytelling on visual memory and writing skills. Computers & Education, 94, 298–309.
Serban, I. V., Sordoni, A., Bengio, Y., Courville, A., & Pineau, J. (2016, March). Building end-to-end dialogue systems using generative hierarchical neural network models. In Thirtieth AAAI Conference on Artificial Intelligence.
Schoerning, E., Hand, B., Shelley, M., & Therrien, W. (2015). Language, access, and power in the elementary science classroom. Science Education, 99(2), 238–259.
Simmons, B. (2010). Clinical reasoning: concept analysis. Journal of advanced nursing, 66(5), 1151–1158.
Stephenson, N. S., & Sadler-McKnight, N. P. (2016). Developing critical thinking skills using the science writing heuristic in the chemistry laboratory. Chemistry Education Research and Practice, 17(1), 72–79.
Tatsuoka, K. K. (2009).Cognitive assessment: An introduction to the rule space method. Routledge.
Trafimow, D. (2018). Some implications of distinguishing between unexplained variance that is systematic or random. Educational and psychological measurement, 78(3), 482–503.
Turner, B. M., van Maanen, L., & Forstmann, B. U. (2015). Informing cognitive abstractions through neuroimaging: the neural drift diffusion model. Psychological Review, 122(2), 312–336. https://doi.org/10.1037/a0038894
Unsworth, N. (2016). Working memory capacity and recall from long-term memory: examining the influences of encoding strategies, study time allocation, search efficiency, and monitoring abilities. Journal of Experimental Psychology: Learning, Memory, and Cognition, 42(1), 50.
Wijayasekara, D., Manic, M., Sabharwall, P., & Utgikar, V. (2011). Optimal artificial neural network architecture selection for performance prediction of compact heat exchanger with the EBaLM-OTR technique. Nuclear Engineering and Design, 241(7), 2549–2557.
Wilson, R. A., & Keilm, F. C. (2001). The MIT encyclopedia of cognitive science. Cambridge, MA: MIT Press.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Human Subject Ethical Approval
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration, its later amendments, or comparable ethical standards. Informed consent was obtained from all individual participants included in the study.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Lamb, R., Hand, B. & Kavner, A. Computational Modeling of the Effects of the Science Writing Heuristic on Student Critical Thinking in Science Using Machine Learning. J Sci Educ Technol 30, 283–297 (2021). https://doi.org/10.1007/s10956-020-09871-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10956-020-09871-3