ConRam: methodology for a corpus of conversations with gaze tracking
DOI:
https://doi.org/10.30973/esdi.2025.11.2.224Keywords:
corpus, multimodality, eye tracking, face to face interactionAbstract
This article presents the Corpus de conversaciones con rastreo de mirada (Corpus of conversations with eye tracking), ConRam, and the methodology used to create it. The Corpus of Conversations with Eye Tracking is the first corpus of conversations in Spanish collected using visual tracking technology. It is a multimodal corpus of dyadic conversations between speakers with a high degree of closeness and a symmetrical relationship, collected in a laboratory setting. The article discusses the relevance of obtaining a multimodal corpus of these characteristics and, specifically, the interest in obtaining data on the gaze of speakers during conversation for the study of language in interaction.
Downloads
References
Adolphs, Svenja y Ronald Carter. Spoken Corpus Linguistics: From Monomodal to Multimodal. Routledge, 2013. https://doi.org/10.4324/9780203526149
Albelda, Marta y María Estellés, coordinators. Corpus Ameresco. Universitat de València, 2020. www.corpusameresco.com.
Auer, Peter. "Gaze, addressee selection and turn-taking in three-party interaction". Eye-tracking in Interaction Studies on the role of eye gaze in dialogue, De Gruyter, 2018, pp. 197–232. https://doi.org/10.1075/ais.10.09aue
Beattie, Geoffrey W. "A further investigation of the cognitive interference hypothesis of gaze patterns during conversation". British Journal of Social Psychology, vol. 20, 1981, pp. 243–248. https://doi.org/10.1111/j.2044-8309.1981.tb00493.x
Bertrand, Roxane, Gaëlle Ferré, Philippe Blache, Robert Espesser y Stéphane Rauzy. "Backchannels Revisited from a Multimodal Perspective". Proceedings of Auditory-Visual Speech Processing, Hilvarenbeek, 2007. https://hal.science/hal-00244490v1
Blache, Philippe, Roxane Bertrand y Gaëlle Ferré. “Creating and Exploiting Multimodal Annotated Corpora". Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC), 2008. http://www.lrec-conf.org/proceedings/lrec2008/
Boersma, Paul y Davud Weenink. Praat: making phonetics by computer, 2024. [Programa informático]
Briz, Antonio y Grupo Val.Es.Co. Corpus de conversaciones coloquiales. Arco/Libros, 2002.
Briz, Antonio y Marta Albelda. "Estado actual de los corpus de lengua española hablada y escrita: I+D". El español en el mundo. Anuario del Instituto Cervantes 2009, Instituto Cervantes, 2009, pp. 165–226.
Briz, Antonio y María S. Hernández. "Estudio de la variación situacional en corpus orales del español". Lingüística de corpus en español / The Routledge Handbook of Spanish Corpus Linguistics, Routledge, 2022, pp. 310–324.
Brône, Geert y Bert Oben. "InSight Interaction: A Multimodal and Multifocal Dialogue Corpus". Language Resources and Evaluation, vol. 49, núm. 1, 2015, pp. 195–214. https://doi.org/10.1007/s10579-014-9283-2
Brône, Geert y Bert Oben. Eye-Tracking in Interaction. John Benjamins Publishing Company, 2018. https://doi.org/10.1075/ais.10.
Brône, Geert, Bert Oben, Annelies Jehoul, Jelena Vranjes, y Kurt Feyaerts. (2017). "Eye gaze and viewpoint in multimodal interaction management". Cognitive Linguistics, vol. 28, núm. 3, 2017, pp. 449–483. https://doi.org/10.1515/cog-2016-0119
Brugman, Hennie y Albert Russel. "Annotating Multi-media/Multi-modal Resources with ELAN". Proceedings of LREC, 2004, pp. 2065–2068. http://www.lrec-conf.org/proceedings/lrec2004/pdf/480.pdf
Carcelén Guerrero, Andrea. "Novedades en los corpus digitales para el estudio del español oral". Normas, vol. 14, núm. 1, 2024, pp. 241–260. https://doi.org/10.7203/Normas.v14i1.29929
Degutyte, Ziedune y Arlene Astell. "The Role of Eye Gaze in Regulating Turn Taking in Conversations: A Systematized Review of Methods and Findings". Frontiers in Psychology, vol. 12, 2021, pp. 1–22. https://doi.org/10.3389/fpsyg.2021.616471.
Edlund, Jens, Jonas Beskow, Kjell Elenius, Kahl Hellmer, Sofia Strömbergsson y David House. "Spontal: A Swedish Spontaneous Dialogue Corpus of Audio, Video and Motion Capture". Proceedings of LREC, 2010, pp. 2992–2995.
Exline, Ralph, David Gray y Dorothy Schuette. "Visual Behavior in a Dyad as Affected by Interview Content and Sex of Respondent". Journal of Personality and Social Psychology, vol. 1, 1965, p. 201. https://doi.org/10.1037/h0021865.
Gallardo Paúls, Beatriz. "Conversación y conversación cotidiana: sobre una confusión de niveles". Pragmalingüística, vol. 2, 1994, pp.151-194
Garrod, Simon y Martin J. Pickering. "Joint Action, Interactive Alignment, and Dialog". Topics in Cognitive Science, vol. 1, núm. 2, 2009, pp. 292-304. https://doi.org/10.1111/j.1756-8765.2009.01020.x
Gironzetti, Elisa. "Eye-Tracking Applications for Spanish Pragmatics Research". The Routledge Handbook of Spanish Pragmatics, Routledge, 2020, pp. 517–531.
Glenberg, Arthur M., Jennifer L. Schroeder y David A. Robertson. "Averting the Gaze Disengages the Environment and Facilitates Remembering". Memory and Cognition, vol. 26, núm. 4, 1998, pp. 651–658. https://doi.org/10.3758/BF03211385
Goldin-Meadow, Susan y Martha Wagner Alibali. "Gesture's role in speaking, learning, and creating language". Annual review of psychology 64, núm1, 2013, pp. 257-283. doi: 10.1146/annurev-psych-113011-143802
Goodwin, Charles. "Restarts, Pauses, and the Achievement of a State of Mutual Gaze at Turn-Beginning". Sociological Inquiry, vol. 50, núm. 3–4, 1980, pp. 272–302. https://doi.org/10.1111/j.1475-682X.1980.tb00023.x
Griffin, Zenzi M. "Gaze Durations during Speech Reflect Word Selection and Phonological Encoding". Cognition, vol. 82, núm. 1, 2001, pp. 1–16. https://doi.org/10.1016/S0010-0277(01)00138-X
Hirvenkari, Lotta, Johanna Ruusuvuori, Veli-Matti Saarinen, Maari Kivioja, Anssi Peräkylä y Riitta Hari. "Influence of Turn-Taking in a Two-Person Conversation on the Gaze of a Viewer". PLoS ONE, vol. 8, núm. 8, 2013. https://doi.org/10.1371/journal.pone.0071569
Holler, Judith y Kobin H. Kendrick. "Unaddressed Participants’ Gaze in Multi-person Interaction: Optimizing Recipiency". Frontiers in Psychology, vol. 6, 2015, pp. 1–14. https://doi.org/10.3389/fpsyg.2015.00098
Huang, C. M., Andrist, S., Sauppé, A., y Mutlu, B. (2015). Using gaze patterns to predict task intent in collaboration. Frontiers in Psychology, 6(July), 1–12. https://doi.org/10.3389/fpsyg.2015.01049
Keevallik, Leelo. "What Does Embodied Interaction Tell Us about Grammar?" Research on Language and Social Interaction, vol. 51, no. 1, 2018, pp. 1–21. https://doi.org/10.1080/08351813.2018.1413887
Kendon, Adam. "Some Functions of Gaze-Direction in Social Interaction". Acta Psychologica, vol. 26, 1967, pp. 22–63. https://doi.org/10.1016/0001-6918(67)90005-4
Kendrick, Kobin H. "Using Conversation Analysis in the Lab". Research on Language and Social Interaction, vol. 50, núm. 1, 2017, pp. 1–11. https://doi.org/10.1080/08351813.2017.1267911
Kendrick, Kobin H. y Judith Holler. "Gaze Direction Signals Response Preference in Conversation". Research on Language and Social Interaction, vol. 50, núm. 1, 2017, pp. 12–32. https://doi.org/10.1080/08351813.2017.1262120
Kibrik, Andrej A. y Olga V. Fedorova. "An Empirical Study of Multichannel Communication: Russian Pear Chats and Stories". Psychology. Journal of the Higher School of Economics, vol. 15, núm. 2, 2018, pp. 191–200. DOI: 10.17323/1813-8918-2018-2-191-200
Knight, Dawn, Svenja Adolphs, Paul Tennent y Ronald Carter. "The Nottingham Multi-Modal Corpus: A Demonstration". Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC), 2008.
Knight, Dawn, David Evans, Ronald Carter y Svenja Adolphs. "HeadTalk, HandTalk and the Corpus: Towards a Framework for Multi-modal, Multi-media Corpus Development". Corpora, vol. 4, 2009, pp. 1–32. https://doi.org/10.3366/E1749503209000203
Lausberg, Hedda y Han Sloetjes. "Coding Gestural Behavior with the NEUROGES-ELAN System". Behavior Research Methods, vol. 41, núm. 3, 2009, pp. 841–849. https://doi.org/10.3758/BRM.41.3.841
Lerner, Gene H. "Selecting next speaker: The context-sensitive operation of a context-free organization". Language in Society, vol. 32, núm. 2, 2003, pp. 177-201. https://doi.org/10.1017/S004740450332202X
Levinson, Stephen C. "On the Human ‘Interaction Engine". Roots of Human Sociality: Culture, Cognition and Interaction, 2006, pp. 39–69. https://doi.org/10.4324/9781003135517-3
Levinson, Stephen C. "Interactional Foundations of Language: The Interaction Engine Hypothesis". Human Language: From Genes and Brain to Behavior, 2010, pp. 189–200.
Levinson, Stephen C. y Judith Holler. "The Origin of Human Multi-Modal Communication". Philosophical Transactions of the Royal Society B, vol. 369, 2014, pp. 1–9. https://doi.org/10.1038/nature13748
Martín Butragueño, Pedro y Yolanda Lastra, coordinators. Corpus Sociolingüístico de la Ciudad de México (CSCM). El Colegio de México, 2011–2015.
Meyer, Antje S., Astrid M. Sleiderink y Willem J. M. Levelt. "Viewing and Naming Objects: Eye Movements during Noun Phrase Production". Cognition, vol. 66, núm. 2, 1998, pp. 25–33. https://doi.org/10.1016/S0010-0277(98)00009-2
Nevile, Maurice. "The Embodied Turn in Research on Language and Social Interaction". Research on Language and Social Interaction, vol. 48, núm. 2, 2015, pp. 121–151. https://doi.org/10.1080/08351813.2015.1025499
Novick, David G., Brian Hansen y Karen Ward. "Coordinating Turn-Taking with Gaze". International Conference on Spoken Language Processing (ICSLP) Proceedings, vol. 3, 1996, pp. 1888–1891. https://doi.org/10.21437/icslp.1996-485
Oertel, Catharine, Fred Cummins, Jens Edlund, Petra Wagner y Nick Campbell. "D64: A Corpus of Richly Recorded Conversational Interaction". Journal on Multimodal User Interfaces, vol. 7, núm. 1, 2013, pp. 19–28. https://doi.org/10.1007/s12193-012-0108-6
Persyn, Yne. "Gaze Aversion and Response Preference in Dutch Face-to-Face Conversation: A Corpus Study." 2023. Universidad de Radboud, tesis de maestría.
Poyatos, Fernando. La comunicación no verbal. Ediciones AKAL, 1994.
PRESEEA. Corpus del Proyecto para el Estudio Sociolingüístico del Español de España y de América. Universidad de Alcalá, 2014–, http://preseea.uah.es
Rodríguez, Lidia, María Eugenia Flores y Tzitel Pérez. Corpus El habla de Monterrey – PRESEEA. Secretaría de Educación Pública, Monterrey, 2010.
Rodríguez Rosique, Susana. "Creencia, activación y comunidades culturales: GestInf, o la pertinencia de un corpus basado en el conocimiento compartido". Oralia, vol. 24, 2021, pp. 151-186. https://doi.org/10.25115/oralia.v24i1.6484
Rojo, Guillermo. "Los corpus textuales del español". Enciclopedia lingüística hispánica, edited by Javier Gutiérrez-Rexach, Routledge, 2016, pp. 285–296.
Romani, Michela, Paola Cesari, Cosimo Urgesi, Stefano Facchini y Salvatore M. Aglioti. "Motor Facilitation of the Human Cortico-Spinal System during Observation of Bio-mechanically Impossible Movements". NeuroImage, vol. 26, núm. 3, 2005, pp. 755–763. https://doi.org/10.1016/j.neuroimage.2005.02.027
Rossano, Federico, Penelope Brown y Stephen C. Levinson. Gaze, questioning and culture. Cambridge: Cambridge University Press, 2009.
Sebanz, Natalie y Maggie Shiffrar. "Detecting Deception in a Bluffing Body: The Role of Expertise". Psychonomic Bulletin and Review, vol. 16, núm. 1, 2009, pp. 170–175. https://doi.org/10.3758/PBR.16.1.170
Shiffrar, Maggie y Jennifer J. Freyd. "Apparent Motion of the Human Body". Psychological Science, vol. 1, núm. 4, 1990, pp. 257–264. https://doi.org/10.1111/j.1467-9280.1990.tb00210.x
Solís García, Inmaculada. "Corpus dialógicos para el análisis de la conversación". Chimera, vol. 5, 2018, pp. 117–129.
Stanley, Gordon y Donald S. Martin. "Eye-Contact and the Recall of Material Involving Competitive and Noncompetitive Associations". Psychonomic Science, vol. 13, núm. 6, 1968, pp. 337–338. https://doi.org/10.3758/BF03342614
Staudte, Maria y Matthew W. Crocker. "Investigating Joint Attention Mechanisms through Spoken Human-Robot Interaction". Cognition, vol. 120, núm. 2, 2011, pp. 268–291. https://doi.org/10.1016/j.cognition.2011.05.005
Van Son, R.J.J.H., Wieneke Wesseling, Eric Sanders y Hans van der Heuvel. "The IFADV Corpus: A Free Dialog Video Corpus". Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC), 2008.
Vázquez Carranza, Ariel. "If Vegetables Could Talk…: A Structural and Sequential Analysis of Buying and Selling Interactions in a Mexican Fruit and Vegetable Shop". Discourse Studies, vol. 19, núm. 6, 2017, pp. 711–731. https://doi.org/10.1177/1461445617727185
Vertegaal, Roel, Robert Slagter, Gerrit van der Veer y Anton Nijholt. "Eye Gaze Patterns in Conversations: There Is More to Conversational Agents than Meets the Eyes". Proceedings of the Conference on Human Factors in Computing Systems, Jan. 2001, pp. 301–308. https://doi.org/10.1145/365024.365119
Vila Pujol, María Rosa. Corpus del español conversacional de Barcelona y su área metropolitana. Grupo GRIESBA, Universitat de Barcelona, 2001.
Vila Pujol, M. Rosa y Maitena Etxebarria. "Corpus para el estudio de las interferencias lingüísticas: los corpus de Barcelona, Lérida y Bilbao". Oralia, vol. 8, 2005, pp. 213–242. https://doi.org/10.25115/oralia.v8i1.8351
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 DISCOURSE STUDIES
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
La revista Estudios del Discurso está bajo una Licencia Creative Commons Atribución-NoComercial 4.0 Internacional, de tipo CC BY-NC, de modo que es posible compartir y adaptar el material, pero debe darse crédito a la obra de manera adecuada e indicar si se han realizado cambios; no puede hacerse uso del material con fines comerciales. Estudios del Discurso proporciona un acceso abierto inmediato a su contenido e investigaciones; se autoriza copiar, distribuir y comunicar públicamente cualquiera de los textos publicados, siempre que se cite de manera adecuada la fuente y se remita a la publicación original. Los autores tienen libertad de diseminar su trabajo y hacerlo disponible en otros lugares, siempre y cuando den crédito a la publicación original y, de ser posible, proporcione una liga directa a la misma. Esta revista no solicita cobro de tarifas hacia los autores para la evaluación o procesamiento de los artículos.
