This study explores the relationship between self-reported feedback and learning outcomes in video-based learning (VBL) environments. We analyzed data from 32 university students who engaged with a video on machine learning using the Evoli video annotation tool. Participants provided self-reported feedback on their prior knowledge, understanding, and perceived di-culty of the subject matter, while video interaction logs tracked their behaviour. Correlation analysis revealed a strong relationship between self-reported prior knowledge and pre-test scores (0.67) and a moderate relationship between perceived di-culty and mental e3ort (0.58). However, a weaker correlation was found between self-reported understanding and post-test scores (0.37), suggesting that con7dence in understanding does not always correspond to better achievement. K-means clustering identi7ed three distinct learner pro7les: “Careful Viewers”, who demonstrated signi7cant improvement despite low initial knowledge; “Super7cial Viewers”, who showed no improvement despite high self-reported understanding; and “Regular Viewers”, who exhibited steady progress with moderate e3ort. These 7ndings highlight the complexity of the learning process, showing that while self-reported feedback provides valuable insights into student engagement, it may not fully predict learning outcomes. The study emphasizes the need to consider multiple dimensions of engagement when evaluating VBL e3ectiveness and suggests avenues for future research to improve instructional design in digital learning environments.

Exploring the relationship between Self-Reported Feedback and students’ achievement in Video-Based Learning

G. Cassano;
2025-01-01

Abstract

This study explores the relationship between self-reported feedback and learning outcomes in video-based learning (VBL) environments. We analyzed data from 32 university students who engaged with a video on machine learning using the Evoli video annotation tool. Participants provided self-reported feedback on their prior knowledge, understanding, and perceived di-culty of the subject matter, while video interaction logs tracked their behaviour. Correlation analysis revealed a strong relationship between self-reported prior knowledge and pre-test scores (0.67) and a moderate relationship between perceived di-culty and mental e3ort (0.58). However, a weaker correlation was found between self-reported understanding and post-test scores (0.37), suggesting that con7dence in understanding does not always correspond to better achievement. K-means clustering identi7ed three distinct learner pro7les: “Careful Viewers”, who demonstrated signi7cant improvement despite low initial knowledge; “Super7cial Viewers”, who showed no improvement despite high self-reported understanding; and “Regular Viewers”, who exhibited steady progress with moderate e3ort. These 7ndings highlight the complexity of the learning process, showing that while self-reported feedback provides valuable insights into student engagement, it may not fully predict learning outcomes. The study emphasizes the need to consider multiple dimensions of engagement when evaluating VBL e3ectiveness and suggests avenues for future research to improve instructional design in digital learning environments.
2025
Lifelong Digital Learning and Education: promoting flexibility, inclusion, critical thinking and international exchange. Proceedings of the Italian Symposium on Digital Education (ISYDE 2024)
9788891938800
Teacher Awareness, Video-Annotation Tools, Video-Based Learning, Learning Analytics, Learning Engagement
File in questo prodotto:
File Dimensione Formato  
2025_cassano_diblas_ISYDE.pdf

Accesso riservato

Dimensione 406.54 kB
Formato Adobe PDF
406.54 kB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11311/1310110
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact