Is a Picture Worth a Thousand Words?: Effects of Foregrounded Multimodal and Narrative Features

Yuan Tian; Olivia Da Costa Fialho; Shisheng Liu; Michael Burke

Is a Picture Worth a Thousand Words? Effects of Foregrounded Multimodal and Narrative Features

Yuan Tian^* (Co-auteur), Olivia Da Costa Fialho, Shisheng Liu, Michael Burke

^*Bijbehorende auteur voor dit werk

Huygens - Computationele Literatuurwetenschap

Onderzoeksoutput: Bijdrage aan wetenschappelijk tijdschrift/periodieke uitgave › Artikel › Wetenschappelijk › peer review

Samenvatting

Multimodal novels rely extensively on the interaction of verbal and visual codes to construct meaning. It has been theorized that multimodal features of the multimodal novel shape our reading-induced imagery and our emotional reactions while reading. However, there is a lack of empirical testing behind existing approaches to multimodal novels. The current study aims to empirically investigate the effects of foregrounded multimodal features and foregrounded narrative features on reading-induced imagery and readers’ emotional reactions in the reading process of multimodal novels. The results disconfirmed that differences between unusual and usual mind styles were traceable to multimodal vs. monomodal versions of these selected narratives. Reading about unusual mindstyles, instead of multimodal features, is suggested to have effects on changing perception of self and others, and thus on transformative reading.

Originele taal-2	Engels
Pagina's (van-tot)	1-16
Tijdschrift	Scientific Study of Literature
Volume	12
Nummer van het tijdschrift	1
Status	Gepubliceerd - 2023

Toegang tot document

https://ssol-journal.com/articles/178

Citeer dit

@article{7d42108c9b174e77a5f0ae8fbff3d4e4,

title = "Is a Picture Worth a Thousand Words?: Effects of Foregrounded Multimodal and Narrative Features",

abstract = "Multimodal novels rely extensively on the interaction of verbal and visual codes to construct meaning. It has been theorized that multimodal features of the multimodal novel shape our reading-induced imagery and our emotional reactions while reading. However, there is a lack of empirical testing behind existing approaches to multimodal novels. The current study aims to empirically investigate the effects of foregrounded multimodal features and foregrounded narrative features on reading-induced imagery and readers{\textquoteright} emotional reactions in the reading process of multimodal novels. The results disconfirmed that differences between unusual and usual mind styles were traceable to multimodal vs. monomodal versions of these selected narratives. Reading about unusual mindstyles, instead of multimodal features, is suggested to have effects on changing perception of self and others, and thus on transformative reading.",

author = "Yuan Tian and {Da Costa Fialho}, Olivia and Shisheng Liu and Michael Burke",

year = "2023",

language = "English",

volume = "12",

pages = "1--16",

journal = "Scientific Study of Literature",

issn = "2210-4372",

publisher = "John Benjamins Publishing",

number = "1",

}

TY - JOUR

T1 - Is a Picture Worth a Thousand Words?

T2 - Effects of Foregrounded Multimodal and Narrative Features

AU - Tian, Yuan

AU - Da Costa Fialho, Olivia

AU - Liu, Shisheng

AU - Burke, Michael

PY - 2023

Y1 - 2023

N2 - Multimodal novels rely extensively on the interaction of verbal and visual codes to construct meaning. It has been theorized that multimodal features of the multimodal novel shape our reading-induced imagery and our emotional reactions while reading. However, there is a lack of empirical testing behind existing approaches to multimodal novels. The current study aims to empirically investigate the effects of foregrounded multimodal features and foregrounded narrative features on reading-induced imagery and readers’ emotional reactions in the reading process of multimodal novels. The results disconfirmed that differences between unusual and usual mind styles were traceable to multimodal vs. monomodal versions of these selected narratives. Reading about unusual mindstyles, instead of multimodal features, is suggested to have effects on changing perception of self and others, and thus on transformative reading.

AB - Multimodal novels rely extensively on the interaction of verbal and visual codes to construct meaning. It has been theorized that multimodal features of the multimodal novel shape our reading-induced imagery and our emotional reactions while reading. However, there is a lack of empirical testing behind existing approaches to multimodal novels. The current study aims to empirically investigate the effects of foregrounded multimodal features and foregrounded narrative features on reading-induced imagery and readers’ emotional reactions in the reading process of multimodal novels. The results disconfirmed that differences between unusual and usual mind styles were traceable to multimodal vs. monomodal versions of these selected narratives. Reading about unusual mindstyles, instead of multimodal features, is suggested to have effects on changing perception of self and others, and thus on transformative reading.

M3 - Article

SN - 2210-4372

VL - 12

SP - 1

EP - 16

JO - Scientific Study of Literature

JF - Scientific Study of Literature

IS - 1

ER -

Is a Picture Worth a Thousand Words? Effects of Foregrounded Multimodal and Narrative Features

Samenvatting

Toegang tot document

Vingerafdruk

Citeer dit