The voice, text, and the visual as semiotic companions: an analysis of the materiality and meaning potential of multimodal screen feedback

摘要

The gap between how learners interpret and act upon feedback has been widely documented in the research literature. What is less certain is the extent to which the modality and materiality of the feedback influence students' and teachers' perceptions. This article explores the semiotic potential of multimodal screen feedback to enhance written feedback. Guided by an "Inquiry Graphics" approach, situated within a semiotic theory of learning edusemiotic conceptual framework, constructions of meaning in relation to screencasting feedback were analysed to determine how and whether it could be incorporated into existing feedback practices. Semi-structured video elicitation interviews with student teachers were used to incorporate both micro and macro levels of analysis. The findings suggested that the relationship between the auditory, visual and textual elements in multimodal screen feedback enriched the feedback process, highlighting the importance of form in addition to content to aid understanding of written feedback. The constitutive role of design and material artefacts in feedback practices in initial teacher training pertinent to these findings is also discussed.