Cognitive Sciences - Publications
Permanent URI for this collection
Browse
Recent Submissions
1 - 5 of 189
-
Item
-
ItemInteraction of language and visual attention: evidence from production and comprehension( 2009-09-04)Recent developments in multimodal interactions in language processing have revealed important facts about the important controlling influence of the attentional system on language behavior. In this chapter, we cover the attentional system that is important for language processing and its interaction with the microstructure of the linguistic system. We argue that to understand the origin of language-mediated eye movements; we must integrate neuronal mechanisms of saccade generation with language processing. We discuss the various facets of interaction of language processing with visual attentional mechanism using eye-tracking data from Hindi in the production and comprehension of language. © 2009 Elsevier B.V. All rights reserved.
-
ItemMechanisms and representations of language-mediated visual attention( 2011-01-01)The experimental investigation of language-mediated visual attention is a promising way to study the interaction of the cognitive systems involved in language, vision, attention, and memory. Here we highlight four challenges for a mechanistic account of this oculomotor behavior: the levels of representation at which language-derived and vision-derived representations are integrated; attentional mechanisms; types of memory; and the degree of individual and group differences. Central points in our discussion are (a) the possibility that local microcircuitries involving feedforward and feedback loops instantiate a common representational substrate of linguistic and non-linguistic information and attention; and (b) that an explicit working memory may be central to explaining interactions between language and visual attention. We conclude that a synthesis of further experimental evidence from a variety of fields of inquiry and the testing of distinct, non-student, participant populations will prove to be critical. © 2012 Huettig, Mishra and Olivers.
-
ItemOn the mental representations originating during the interaction between language and vision( 2010-11-01)The interaction between vision and language processing is clearly of interest to both cognitive psychologists and psycholinguists. Recent research has begun to create understanding of the interaction between vision and language in terms of the representational issues involved. In this paper, we first review some of the theoretical and methodological issues in the current vision-language interaction debate. Later, we develop a model that attempts to account for effects of affordances and visual context on language-scene interaction as well as the role of sensorimotor simulation. The paper addresses theoretical issues related to the mental representations that arise when visual and linguistic systems interact. © 2010 Marta Olivetti Belardinelli and Springer-Verlag.
-
ItemSearching and fixating: Scale-invariance vs. characteristic timescales in attentional processes( 2011-06-01)In an experiment involving semantic search, the visual movements of sample populations subjected to visual and aural input were tracked in a taskless paradigm. The probability distributions of saccades and fixations were obtained and analyzed. Scale-invariance was observed in the saccadic distributions, while the fixation distributions revealed the presence of a characteristic (attentional) time scale for literate subjects. A detailed analysis of our results suggests that saccadic eye motions are an example of Levy, rather than Brownian, dynamics. © Europhysics Letters Association, 2011.