PICTREE Project
The PICTREE Project
Pictures are often thought to be fairly simple compared to language. Where language is known to use patterns in a vocabulary and grammar, pictures are often thought to reflect what we see, and as a reflection of vision would not have complex structure of their own. In contrast, my work has broadly shown that pictures are also built of patterns, including both a vocabulary and a grammar. This “PICTREE Project” targets one aspect of pictorial communication that has been claimed to be unique to language: hierarchic structure.
The PICTREE Project—officially called “Hierarchic structure in pictorial communication”—aims to investigate how the brain encodes hierarchic information about individual and sequential images. The project is a five year project funded by a European Research Council (ERC) Consolidator grant to Neil Cohn.
The PICTREE project has three primary themes where we are measuring people’s brainwaves to investigate hierarchic structure. These include the primary aspects of individual and sequential pictures, along with their relations to other modalities:
- Prajwal Prakash is studying individual images for how graphics are constructed, while postdoc Irmak Hacımusaoğlu is studying hierarchy in visual morphology.
- Maryam Torabi is studying the narrative grammar of sequential images with complex patterns that involve “distance dependencies”
- Lenneke Lichtenberg is studying whether the similar brain responses that appear to manipulations of “grammars” in sentences, music, or visual narratives share a common origin in the brain
Aspects of visual narrative comprehension are explored at length in the book Who Understands Comics?, and some of our prior work set the stage for these projects:
- Cohn, Neil. 2020. Visual narrative comprehension: Universal or not? Psychonomic Bulletin and Review. 27(2): 266-285
- Cohn, Neil. 2020. Your brain on comics: A cognitive model of visual narrative comprehension. Topics in Cognitive Science. 12(1): 352-386
- Cohn, Neil. 2019. Visual narratives and the mind: Comprehension, cognition, and learning.In Federmeier, Kara D. and Diane M. Beck (Eds). Psychology of Learning and Motivation: Knowledge and Vision. Vol. 70. (pp. 97-128). London: Academic Press (PDF)
- Cohn, Neil, Lincy van Middelaar, Tom Foulsham, and Joost Schilperoord. 2024. Anaphoric distance dependencies in visual narrative structure and processing. Cognitive Psychology. 149: 101639
- Cohn, Neil and Tom Foulsham. 2022. Meaning above (and in) the head: Combinatorial visual morphology from comics and emoji. Memory and Cognition. (Open online)
Team members
The PICTREE research team consists of several core staff and various collaborators around the world. We welcome additional collaborations, so if you are interested, please inquire with Neil Cohn for details.
Irmak Hacımusaoğlu is a postdoc and Lenneke Lichtenberg, Maryam Torabi, and Prajwal Prakash are PhD students at Tilburg University.
Morgan Patrick (Elon University) is a collaborator on the cognition of music.
Leandro Kruszielski (Universidade Federal do Paraná, Brazil) is a collaborator working on the psychometrics of visual language fluency.
Funded by the European Union (ERC, PICTREE, 101171243). Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Research Council. Neither the European Union nor the granting authority can be held responsible for them.
