Rinakit Estu Waluyo (1), Muis Muhtadi (2), Nofri Ramadan (3), Muhammad Zulfiqar Rafi (4)
Background: Facial expressions are a primary form of nonverbal communication for toddlers whose verbal abilities are still developing. Specific background: Advances in computer vision and deep learning have enabled real-time facial expression detection; however, most existing systems are designed using adult facial datasets and pretrained models. Knowledge gap: Research focusing on toddler facial expression detection using models trained exclusively on toddler data without pretrained weights remains limited. Aims: This study applies YOLOv8 to detect happy, sad, and neutral facial expressions of toddlers in real time using a model trained from scratch. Results: The proposed system achieved an average detection accuracy of 86%, with precision of 0.944, recall of 0.933, and mean Average Precision at 0.5 of 0.966, demonstrating stable real-time performance under varying lighting conditions. Novelty: The study demonstrates that YOLOv8 can learn toddler-specific facial expression patterns without relying on pretrained weights derived from adult facial data. Implications: The findings indicate the feasibility of deploying real-time toddler facial expression detection systems to support emotional monitoring in childcare and early education environments.
Real-time detection of toddler facial expressions using YOLOv8.
Model training conducted entirely from scratch using toddler facial datasets.
Consistent detection performance observed in natural and varied environments.
Facial Expression Detection, Toddler, YOLOv8, Computer Vision, Real-Time System
J. G. Negrão, A. A. C. Osorio, R. F. Siciliano, V. R. G. Lederman, E. H. Kozasa, M. E. F. D’Antino, A. Tamborim, V. Santos, D. L. B. de Leucas, P. S. Camargo, D. C. Mograbi, T. P. Mecca, and J. S. Schwartzman, “The Child Emotion Facial Expression Set: A database for emotion recognition in children,” Frontiers in Psychology, vol. 12, 2021, doi: 10.3389/fpsyg.2021.666245.
P. Wang, X. Gong, Q. Guo, G. Chang, and F. Du, “Children’s expression recognition based on multi-scale asymmetric convolutional neural network,” International Journal of Advanced Computer Science and Applications, vol. 15, no. 7, 2024.
H. Santoso, G. F. Soares, and C. M. Angelo, “Convolutional neural network-based recognition of children’s facial expressions in response to gaming,” International Journal of Advanced Science Computing and Engineering, vol. 6, no. 3, pp. 118–122, 2024.
D. Bhagat, A. Vakil, R. K. Gupta, and A. Kumar, “Facial emotion recognition using convolutional neural network,” Procedia Computer Science, vol. 235, pp. 2079–2089, 2024.
Y. Ihza and D. Lelono, “Face expression classification in children using CNN,” Indonesian Journal of Computing and Cybernetics Systems, vol. 16, no. 2, pp. 159–168, 2022.
U. Laraib, A. Shaukat, R. A. Khan, Z. Mustansar, M. U. Akram, and U. Asgher, “Recognition of children’s facial expressions using deep learned features,” Electronics, vol. 12, no. 11, p. 2416, 2023.
C. Qian, J. Marques, and A. Alexandria, “Real-time emotion recognition based on facial expressions using artificial intelligence techniques: A review and future directions,” Multidisciplinary Reviews, vol. 8, 2025, doi: 10.31893/multirev.2025328.
F. M. Talaat, “Real-time facial emotion recognition system among children with autism based on deep learning and IoT,” Neural Computing and Applications, vol. 35, no. 17, pp. 12717–12728, 2023.
Z. Huang, L. Li, G. C. Krizek, and L. Sun, “Research on traffic sign detection based on improved YOLOv8,” Journal of Computer and Communications, vol. 11, no. 7, pp. 226–232, 2023.
G. Rasyid and J. Sutopo, “Comparison of YOLO version eight and YOLO version ten in detecting human facial emotions,” Indonesian Journal of Applied Technology, vol. 2, no. 1, 2025.
C. Xu, Y. Du, W. Zheng, T. Li, and Z. Yuan, “Facial expression recognition based on YOLOv8 deep learning in complex scenes,” International Journal of Information and Communication Technology, vol. 26, no. 1, pp. 89–101, 2025.
M. Cascella, M. N. Shariff, G. Lo Bianco, F. Monaco, F. Gargano, A. Simonini, A. M. Ponsiglione, and O. Piazza, “Employing the artificial intelligence object detection tool YOLOv8 for real-time pain detection: A feasibility study,” Journal of Pain Research, pp. 3681–3696, 2024.
Z. Yang, B. Tsui, J. Ning, and Z. Wu, “Falling detection of toddlers based on improved YOLOv8 models,” Sensors, vol. 24, no. 19, p. 6451, 2024.
Y. Huang, W. Deng, and T. Xu, “A study of potential applications of student emotion recognition in primary and secondary classrooms,” Applied Sciences, vol. 14, no. 23, 2024.
R. Hosney, F. M. Talaat, E. M. El-Gendy, and M. M. Saafan, “AutYOLO-ATT: An attention-based YOLOv8 algorithm for early autism diagnosis through facial expression recognition,” Neural Computing and Applications, vol. 36, no. 27, pp. 17199–17219, 2024.
G. F. Mumtaz, J. Zeniarja, A. Luthfiarta, and A. N. I. Muttaqin, “Optimizing face recognition and emotion detection in student identification using FaceNet and YOLOv8 models,” Inform: Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 10, no. 1, pp. 34–44, 2025.
U. Ihsan, N. Z. Jhanjhi, H. Ashraf, F. Ashfaq, and F. A. Wicaksana, “A real-time intelligent surveillance system for suspicious behavior and facial emotion analysis using YOLOv8 and DeepFace,” Engineering Proceedings, vol. 107, no. 1, p. 59, 2025.
A. Alshammari and M. E. Alshammari, “Emotional facial expression detection using YOLOv8,” Engineering, Technology and Applied Science Research, vol. 14, no. 5, pp. 16619–16623, 2024.
S. Saepudin, N. Sujana, M. M. Mutoffar, and A. A. Haryanto, “Performance analysis of YOLOv8 optimized with Roboflow for emotional facial expression detection using machine learning,” Naratif: Jurnal Nasional Riset, Aplikasi dan Teknik Informatika, vol. 6, no. 2, pp. 115–124, 2024.
K. A. Pamungkas, S. N. Himawan, A. Suheryadi, K. A. Cahyanto, and F. Sitanggang, “Facial paralysis detection using YOLO with web implementation,” Proceedings of the SeNTIK Seminar, vol. 8, no. 1, pp. 423–427, 2024.
V. S. Devi, U. Ramisetty, K. Ramisetty, and A. Thimmareddy, “Real-time age, gender, and emotion detection using YOLOv8,” ITM Web of Conferences, vol. 74, p. 01015, 2025.
A. Jan, Deep Learning Based Facial Expression Recognition and Its Applications, Ph.D. dissertation, Brunel University London, 2017.