Pie graphs reading and multimodal comprehension

A psycholinguistics investigation of top down and bottom-up factors

Authors

DOI:

https://doi.org/10.15448/1984-4301.2020.4.37524

Keywords:

Multimodal comprehension, Pie graphs reading, Eye tracking

Abstract

This study is part of a research project designed to investigate multimodal comprehension. In this paper we address the interference of top-down and bottom-up information in the comprehension of pie charts. Specifically, we analyse the role of the title (guiding vs. non-guiding) and the position of the legend (left vs. right of the pizza) during the reading of pie graphs by a group of 40 undergraduate students. The participants’ eye movements and eye fixations were monitored in an eye tracking experiment in order to evaluate processing costs regarding the integration of linguistic and visual/graphic information. The experimental findings are briefly discussed in the light of aspects of the theoretical models of graph comprehension (ACARTÜRK, 2010; PINKER, 1990) as well as cognitive principles to be observed in the production of graphics (KOSSLYN, 2006).

Downloads

Download data is not yet available.

Author Biographies

Erica dos Santos Rodrigues, Pontifícia Universidade Católica do Rio de Janeiro (PUC-Rio), Rio de Janeiro, RJ, Brasil

Doutora em Letras pela Pontifícia Universidade Católica do Rio de Janeiro (PUC-Rio), no Rio de Janeiro, RJ, Brasil; professora da mesma instituição. Bolsista PQ2_CNPq 311422/2019-5.

Antonio João Carvalho Ribeiro, Laboratório de Psicolinguística Experimental (LAPEX)- UFRJ

Doutor em Linguística pela Universidade Federal do Rio de Janeiro (UFRJ), no Rio de Janeiro, RJ, Brasil; professor I de Língua Portuguesa da Fundação de Apoio à Escola Técnica (Faetec) (aposentado).

References

ACARTÜRK, Cengiz. Multimodal comprehension of graph-text constellations: An information processing perspective. 2010. (Doctoral Dissertation). Hamburg: University of Hamburg, 2010.

ACARTÜRK, Cengiz; HABEL, Christopher; CAGILTAY, Kursat. ALACAM, Özge. Multimodal comprehension of language: graphs with and without annotations. Journal of Eye Movement Research, [s. l.], v.1, n. 3, p.1-15, 2008. https://doi.org/10.16910/jemr.1.3.2

ACARTÜRK, Cengiz; HABEL, Christopher. Eye tracking in multimodal comprehension of graphs. In: COX, R.; DIEGO, J. P. S. (ed.). Proceedings of the Workshop on Technology-Enhanced Diagrams Research. Canterbury, UK: CEUR, 2012. v. 887, p. 11-25.

Berkowitz, Bruce D. Playfair: The True Story of the British Secret Agent Who Changed How We See the World. Fairfax, VA: George Mason University Press, 2018.

BORINE, Monica Silvia. Consciência, emoção e cognição: o efeito do priming afetivo subliminar em tarefas de atenção. Ciências & Cognição, [s. l.], v. 11, p. 67-79, 2007.

FIELD, John. Psycholinguistics: The Key Concepts. Londres: Routledge, 2004.

FRIEL, Susan; CURCIO, Frances R.; BRIGHT, George W. Making sense of graphs: critical factors influencing comprehension and instructional implications. Journal for Research in Mathematics Education, [s. l.], v. 32, n. 2, p.124-158, 2001. DOI: https://doi.org/10.2307/749671

FORSTER, Renê. Aspectos da utilização do rastreamento ocular na pesquisa psicolinguística. DELTA [online], [s. l.], v. 33, n. 2, São Paulo, p. 609-644, 2017. DOI: https://doi.org/10.1590/0102-445095461720767529

GAL, Iddo. Adult’s statistical literacy: meanings, components, responsibilities. International Statistical Review, [s. l.], v. 70, n. 1, p. 1-25, 2002.

HUESTEGGE, Lynn; PHILIPP, Andrea M. Effects of spatial compatibility on integration processes in graph comprehension. Attention, Perception, & Psychophysics, [s. l.], v. 73, n. 6, p.1903–1915, 2011. DOI: https://doi.org/10.3758/s13414-011-0155-1

KOSSLYN, Stephen Michael. Graph design for the eye and mind. Nova York: Oxford University Press, 2006.

PINKER, Steven. A theory of graph comprehension. In: FRIEDLE, R. (ed.). Artificial intelligence and the future of testing. Norwood: Ablex, 1990. p.73-126.

RODRIGUES, Erica dos Santos; FRAGOSO, Luane da Costa Pinto Lins; RIBEIRO, Antonio João Carvalho Compreensão multimodal e rastreamento ocular na leitura de gráficos. In: MAIA, M. (org.). Psicolinguística e educação. Campinas, SP: Mercado de Letras, 2018. p. 133-172.

SNOW, C. Reading for Understanding: Toward an R&D Program in Reading Comprehension. Santa Monica, CA: RAND Corporation, 2002.

SPENCE, I. William Playfair and the psychology of graphs. Proceedings of the American Statistical Association, Section on Statistical Graphics. Alexandria VA: American Statistical Association, 2006. p. 2426-2436.

User’s manual Tobii Studio Version 3.4.5, 01/2016. Disponível em: https://www.tobiipro.com/siteassets/tobii-pro/user-manuals/tobii-pro-studio-user-manual. pdf. Acesso em: 12 jun. 2019.

Downloads

Published

2020-10-08

How to Cite

Rodrigues, E. dos S., & Ribeiro, A. J. C. (2020). Pie graphs reading and multimodal comprehension: A psycholinguistics investigation of top down and bottom-up factors. Letrônica, 13(4), e37524. https://doi.org/10.15448/1984-4301.2020.4.37524

Issue

Vol. 13 No. 4 (2020): Literacia em um Contexto Multiletrado: bases teóricas, metodológicas e empíricas

Section

Articles

License

Copyright (c) 2020 Letrônica

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Copyright

The submission of originals to Letrônica implies the transfer by the authors of the right for publication. Authors retain copyright and grant the journal right of first publication. If the authors wish to include the same data into another publication, they must cite Letrônica as the site of original publication.

Creative Commons License

Except where otherwise specified, material published in this journal is licensed under a Creative Commons Attribution 4.0 International license, which allows unrestricted use, distribution and reproduction in any medium, provided the original publication is correctly cited.

Most read articles by the same author(s)