File Download
  Links for fulltext
     (May Require Subscription)
Supplementary

Article: Does adding video and subtitles to an audio lesson facilitate its comprehension?

TitleDoes adding video and subtitles to an audio lesson facilitate its comprehension?
Authors
KeywordsMultimedia learning
Eye movement
Hidden markov model
EMHMM
Issue Date2022
PublisherPergamon. The Journal's web site is located at http://www.elsevier.com/locate/learninstruc
Citation
Learning and Instruction, 2022, v. 77, article no. 101542 How to Cite?
AbstractWe examined whether adding video and subtitles to an audio lesson facilitates its comprehension and whether the comprehension depends on participants' cognitive abilities, including working memory and executive functions, and where they looked during video viewing. Participants received lessons consisting of statements of facts under four conditions: audio-only, audio with verbatim subtitles, audio with relevant video, and audio with both subtitles and video. Comprehension was assessed as the accuracy in answering multiple-choice questions for content memory. We found that subtitles facilitated comprehension whereas video did not. In addition, comprehension of audio lessons with video depended on participants' cognitive abilities and eye movement pattern: a more centralized (looking mainly at the screen center) eye movement pattern predicted better comprehension as opposed to a distributed pattern (with distributed regions of interest). Thus, whether video facilitates comprehension of audio lessons depends on both learners’ cognitive abilities and where they look during video viewing.
Persistent Identifierhttp://hdl.handle.net/10722/308041
ISSN
2023 Impact Factor: 4.7
2023 SCImago Journal Rankings: 2.357
ISI Accession Number ID

 

DC FieldValueLanguage
dc.contributor.authorZheng, Y-
dc.contributor.authorYe, X-
dc.contributor.authorHsiao, JH-
dc.date.accessioned2021-11-12T13:41:37Z-
dc.date.available2021-11-12T13:41:37Z-
dc.date.issued2022-
dc.identifier.citationLearning and Instruction, 2022, v. 77, article no. 101542-
dc.identifier.issn0959-4752-
dc.identifier.urihttp://hdl.handle.net/10722/308041-
dc.description.abstractWe examined whether adding video and subtitles to an audio lesson facilitates its comprehension and whether the comprehension depends on participants' cognitive abilities, including working memory and executive functions, and where they looked during video viewing. Participants received lessons consisting of statements of facts under four conditions: audio-only, audio with verbatim subtitles, audio with relevant video, and audio with both subtitles and video. Comprehension was assessed as the accuracy in answering multiple-choice questions for content memory. We found that subtitles facilitated comprehension whereas video did not. In addition, comprehension of audio lessons with video depended on participants' cognitive abilities and eye movement pattern: a more centralized (looking mainly at the screen center) eye movement pattern predicted better comprehension as opposed to a distributed pattern (with distributed regions of interest). Thus, whether video facilitates comprehension of audio lessons depends on both learners’ cognitive abilities and where they look during video viewing.-
dc.languageeng-
dc.publisherPergamon. The Journal's web site is located at http://www.elsevier.com/locate/learninstruc-
dc.relation.ispartofLearning and Instruction-
dc.rightsThis work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.-
dc.subjectMultimedia learning-
dc.subjectEye movement-
dc.subjectHidden markov model-
dc.subjectEMHMM-
dc.titleDoes adding video and subtitles to an audio lesson facilitate its comprehension?-
dc.typeArticle-
dc.identifier.emailHsiao, JH: jhsiao@hku.hk-
dc.identifier.authorityHsiao, JH=rp00632-
dc.description.naturepublished_or_final_version-
dc.identifier.doi10.1016/j.learninstruc.2021.101542-
dc.identifier.scopuseid_2-s2.0-85115128584-
dc.identifier.hkuros329323-
dc.identifier.volume77-
dc.identifier.spagearticle no. 101542-
dc.identifier.epagearticle no. 101542-
dc.identifier.isiWOS:000725569800005-
dc.publisher.placeUnited Kingdom-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats