Multimodal Semiotics Perspective on Literature Visualization

摘要

Literature visualization has particular characteristics:multimodality in production;multimediality in the means of distribution;visualization of language forms.The basic changes of literature lie in mode- choosing orientation and potentials that language and image offer for making meaning.Under the framework of multimodal semiotics,image and language are two modes nestled among a multimodal ensemble.Each mode and the interactions between them have the potential to contribute equally to meaning.Elucidating "image-language relation" from multimodality can make it clear that the particular characteristics of image and language don't change;the former describes visual effect,the latter constructs image with imagination.