Computational Thinking Evaluation Tool Development for Early Childhood Software Education

Kyunghee Lee - Department of Innovation and Convergence, Hoseo University, Chungnam, 31499, South Korea
Jungwon Cho - Department of Computer Education, Jeju University, Jeju, 63243, South Korea

Citation Format:



The early childhood software education is being actively conducted, but research on evaluation of computational thinking is in its infancy. The purpose of early childhood software education is to cultivate the computational thinking through activities centered on solving problems in everyday life. Evaluation in software education is very important in that it not only measures computational thinking simply but also improves computational thinking through evaluation. As such, guidelines for evaluating computational thinking that can be used in early childhood software education are needed, but they are very lacking. Therefore, in this study, the researcher developed an evaluation tool that can meet the ultimate purpose of software education, cultivating computational thinking. The developed evaluation tools are a software education effectiveness test tool and a computational thinking test tool. They were developed to the level of development and interaction of the early childhood. The developed evaluation tool has been validated by software experts, early childhood education experts, and early childhood teachers. As a result of the second step validity verification, all content validity was confirmed. Through this, it was confirmed that the evaluation tool developed in this study can be used as a tool for evaluating computational thinking. This study provides implications for evaluation of computational thinking for early childhood software education. In addition, it is meaningful that it has been suggested to be effectively used for proper evaluation in early childhood software education.


Early childhood software education; software education; computational thinking; evaluation; education effectiveness.

Full Text:



G. Ashok, "Editorial: AI Education for the World," AI magazine, vol.38, pp.3, 2017.

Latham, B. Poyade, M. Finlay, C. Edmond, A and McVey, M, “New Tools in Education: Development and Learning Effectiveness of a Computer Application for Use in a University Biology Curriculum,†Advances in experimental medicine and biology, vol.1138, pp.29-46, 2019.

Tsai, M. J, Wang C. Y and Hsu P. F, "Developing the Computer Programming Self-Efficacy Scale for Computer Literacy Education," Journal Of Educational Computing Research, vol.56, pp.1345-1360, 2019.

Román-González, M., Moreno-León, J., and Robles, G. “Complementary tools for computational thinking assessment,†Proceedings of International Conference on Computational Thinking Education, pp.154-159, 2017.

David W, "Block-based Programming in Computer Science Education," Communications of the ACM, vol.62, pp.22-25, 2019.

S. S. Kim, Y. J. Kim, A. R. Cho and M. W. Lee. “Development of a Tool for Computational Thinking Assessment in Problem-Solving Programming Education: Paper Type Inspection and Self-Report Questionnaire,†The Journal of Korean Association of Computer Education, vol.22, pp. 89-99, 2019.

Fonseca Ferreira N. M, and Freitas Elisabete D C. "Computer applications for education on industrial robotic systems," Computer applications in engineering education, vol.26 pp. 1186-1194, 2018.

S. B. Sousa, Dischler, J. M, Adzhiev, V, Anderson, E. F, Ferko A, Fryazinov, O, IlÄík M, IlÄíková I, Slavik P and Sundstedt V, "Distinctive approaches to computer graphics education," Computer Graphics Forum, vol.37, pp. 403-412, 2018 .

Zendler, A and Reile, S, "The effect of reciprocal teaching and programmed instruction on learning outcome in computer science education," Studies In Educational Evaluation, vol.58, pp. 132-144, 2018.

Voas. J, Kuhn. R, Paulsen, C and Schaffer, K, "Computer Science Education in 2018," IT professional, : vol.20, pp.9-14, 2018.

Guilford, J. P, “Three faces of intellect,†American Psychologist, vol.14, pp.469-479. 1959.

Mednick, S. “The associative basis of the creative process.,†Psychological Review, vol.69, pp.220–232, 1962.

CSTA. “K-12 Computer Science Standards.†2017.

W. Xuefeng, Li. Lin, . Nanxi, T. Wei and K. S. Cheung, "The effectiveness of partial pair programming on elementary school students' Computational Thinking skills and self-efficacy," Computers & education, vol.160, 2021.

A. Charoula and G. Michail,"Computational thinking education: Issues and challenges," Computers in human behavior, vol.105, 2020.

L, Joseph, A, and J, Magana, A, "Computational thinking in higher education: A review of the literature" Computer applications in engineering education, vol.28, pp.1174-1189, 2020.

A. Charoula and V. Nicos, "Developing young children's computational thinking with educational robotics: An interaction effect between gender and scaffolding strategy," Computers in human behavior, vol.105, 2020.

C. E. Nadire, and B. Jeppe, "Computational Thinking in Compulsory Education: A Survey Study on Initiatives and Conceptions," Educational technology research and development, vol.68, pp. 551-573, 2020.

Kong, S. C, Chiu M. M and L. Ming, "A study of primary school students' interest, collaboration attitude, and programming empowerment in computational thinking education," Computers & education, vol.127, pp.178-189, 2018.

G. D. Dafna, K. Avi and F. Hanoch. "Theory-based assessment in environmental education: a tool for formative evaluation" Environmental Education Research, vol.23, pp.269-299, 2017.

H. Sheng-Jen, "Development and Evaluation of Remote Virtual Teach Pendant for Industrial Robotics Education," International Journal of Engineering Education, vol.35, pp.1816-1826, 2019.

A. Sue and D. Richard, "The informed study project: An innovative online self evaluation of fitness to practise within a professional higher education degree programme," Innovations in Education and Teaching International, vol.56, pp.529-541, 2019.

F. Sarah, B. R. Katersky and K. Sue, “Equipping parents to support their children's higher education aspirations: a design and evaluation tool,†Educational review, vol.71, pp. 198-217, 2019.

A. Angelica, S. Donatella and P. L. Elvira, "The evaluation of behavioural problems in the first three years of life: Comparing parents and early childhood educators," Infant behavior & development, vol.50, pp.324-327, 2018.

Fons. N. Elina and S. Ulla. "Sustainable Pedagogical Leadership in Finnish Early Childhood Education (ECE): An Evaluation by ECE Professionals," Early childhood education journal, vol.48, pp.213-222, 2020.

M. D. Amy, H. Carmen, S. Shukla and D. Lena, "Effective Early Childhood STEM Education: Findings from the "Little Scientists" Evaluation," Early childhood education journal, vol.48, pp. 353-363, 2020.

K. H. Lee, E. H. Koh, C. U. Hong, Y. S. Lee, E. K. Moon and J. W. Cho. “New Curriculum of Software Education for 5-Years-Old Children in Korea, Jour of Adv Research in Dynamical & Control Systems, Vol. 10, 14-Special Issue, 2018.

N. Jiyae and J. M. Lee, "Effects of Robotics Programming on the Computational Thinking and Creativity of Elementary School Students," Educational technology research and development, vol.68, pp.463-484, 2020.

J. M. Yang, J. M. Kim, W. K. Lee, I, K, Lee and J. H. Seo. A Study on the Development of Software Training Competency Diagnostic Tool, Daegu: KERIS, 2017.

K. H. Lee, E. H. Koh, C. U. Hong, Y. S. Lee, E. K. Moon and J. W. Cho. “Suggestions for Evaluation Tool of Evaluating Educational Effectiveness of Early Childhood Software education,†Proceedings of the Korean Association of Computer Education Conference, vol.23, pp.77-79, 2019.

J. Y. Park, J. H. Kim, S. H. Kim, H. S. Lee and S. H. Kim. “Development of evaluation factors for SW education in elementary and secondary schools,†The Journal of Korean Association of Computer Education, vol.20, pp.47-59, 2017.

M. J. Kim, W. K. Lee and J. M. Kim. “Presenting the Development Direction Through the Analysis of Tool used to Measure Computational Thinking,†The Journal of Korean Association of Computer Education, vol.20, pp.17-25, 2017.

Brennan, K. and Resnick, M. New frameworks for studying and assessing the development of computational thinking. In Proceedings of the 2012 annual meeting of the American Educational Research Association, Vancouver, Canada, 1, pp.25, 2012.

CACM Staff, “Computational Thinking Is Not Necessarily Computational,†Communications of the ACM, vol.60, pp.8-9, 2017.

Sung W, Ahn J and Black, J. B, "Introducing Computational Thinking to Young Learners: Practicing Computational Perspectives Through Embodiment in Mathematics Education," Technology, Knowledge and Learning, vol.22, pp. 443-463, 2017.

Bebras Challenge 2018. The Bebras Challenge website. [Online]. http://bebras.or