Visual Narrative Structure
Overview
Authors
Affiliations
Narratives are an integral part of human expression. In the graphic form, they range from cave paintings to Egyptian hieroglyphics, from the Bayeux Tapestry to modern day comic books (Kunzle, 1973; McCloud, 1993). Yet not much research has addressed the structure and comprehension of narrative images, for example, how do people create meaning out of sequential images? This piece helps fill the gap by presenting a theory of Narrative Grammar. We describe the basic narrative categories and their relationship to a canonical narrative arc, followed by a discussion of complex structures that extend beyond the canonical schema. This demands that the canonical arc be reconsidered as a generative schema whereby any narrative category can be expanded into a node in a tree structure. Narrative "pacing" is interpreted as a reflection of various patterns of this embedding: conjunction, left-branching trees, center-embedded constituencies, and others. Following this, diagnostic methods are proposed for testing narrative categories and constituency. Finally, we outline the applicability of this theory beyond sequential images, such as to film and verbal discourse, and compare this theory with previous approaches to narrative and discourse.
A Scale Development for Visual Literacy on Health Students and Professionals.
Wang Y, Liao H J Multidiscip Healthc. 2023; 16:3129-3141.
PMID: 37908342 PMC: 10613567. DOI: 10.2147/JMDH.S416196.
Constructed languages are processed by the same brain mechanisms as natural languages.
Malik-Moraleda S, Taliaferro M, Shannon S, Jhingan N, Swords S, Peterson D bioRxiv. 2023; .
PMID: 37546901 PMC: 10402139. DOI: 10.1101/2023.07.28.550667.
Image-text coherence and its implications for multimodal AI.
Alikhani M, Khalid B, Stone M Front Artif Intell. 2023; 6:1048874.
PMID: 37255946 PMC: 10226667. DOI: 10.3389/frai.2023.1048874.
Visual resemblance and interaction history jointly constrain pictorial meaning.
Hawkins R, Sano M, Goodman N, Fan J Nat Commun. 2023; 14(1):2199.
PMID: 37069160 PMC: 10110538. DOI: 10.1038/s41467-023-37737-w.
Perceiving the poetic world: A corpus-assisted transitivity analysis of poetry comics.
Chen S, Zhong Z Front Psychol. 2023; 13:1061169.
PMID: 36643708 PMC: 9835094. DOI: 10.3389/fpsyg.2022.1061169.