所有EyeLink论文，按第一作者名字首字母排序。您可以使用关键字搜索，比如Visual Search，Smooth Pursuit，Parkinsons等。您也可以按作者姓名搜索。如需要查阅各个研究领域的EyeLink论文，请查看各解决方案网页。如果您发现我们漏掉了部分EyeLink论文，请邮件联系！
David Aagten-Murphy; Paul M Bays Automatic and intentional influences on saccade landing Journal Article Journal of Neurophysiology, 118 (2), pp. 1105–1122, 2017. @article{AagtenMurphy2017, title = {Automatic and intentional influences on saccade landing}, author = {David Aagten-Murphy and Paul M Bays}, doi = {10.1152/jn.00141.2017}, year = {2017}, date = {2017-08-01}, journal = {Journal of Neurophysiology}, volume = {118}, number = {2}, pages = {1105--1122}, abstract = {When making an eye movement to a target location, the presence of a nearby distractor can cause the saccade to unintentionally terminate at the distractor itself or the average position in between stimuli. With probabilistic mixture models, we quantified how both unavoidable capture and goal-directed targeting were influenced by changing the task and the target-distractor separation. Using this novel technique, we could extract the time course over which automatic and intentional processes compete for control of saccades.}, keywords = {}, pubstate = {published}, tppubtype = {article} } When making an eye movement to a target location, the presence of a nearby distractor can cause the saccade to unintentionally terminate at the distractor itself or the average position in between stimuli. With probabilistic mixture models, we quantified how both unavoidable capture and goal-directed targeting were influenced by changing the task and the target-distractor separation. Using this novel technique, we could extract the time course over which automatic and intentional processes compete for control of saccades. |
David Aagten-Murphy; Paul M Bays Independent working memory resources for egocentric and allocentric spatial information Journal Article PLOS Computational Biology, 15 (2), pp. e1006563, 2019. @article{AagtenMurphy2019, title = {Independent working memory resources for egocentric and allocentric spatial information}, author = {David Aagten-Murphy and Paul M Bays}, editor = {Erie Boorman}, doi = {10.1371/journal.pcbi.1006563}, year = {2019}, date = {2019-02-01}, journal = {PLOS Computational Biology}, volume = {15}, number = {2}, pages = {e1006563}, abstract = {Visuospatial working memory enables us to maintain access to visual information for processing even when a stimulus is no longer present, due to occlusion, our own movements, or transience of the stimulus. Here we show that, when localizing remembered stimuli, the precision of spatial recall does not rely solely on memory for individual stimuli, but additionally depends on the relative distances between stimuli and visual landmarks in the surroundings. Across three separate experiments, we consistently observed a spatially selective improvement in the precision of recall for items located near a persistent landmark. While the results did not require that the landmark be visible throughout the memory delay period, it was essential that it was visible both during encoding and response. We present a simple model that can accurately capture human performance by considering relative (allocentric) spatial information as an independent localization estimate which degrades with distance and is optimally integrated with egocentric spatial information. Critically, allocentric information was encoded without cost to egocentric estimation, demonstrating independent storage of the two sources of information. Finally, when egocentric and allocentric estimates were put in conflict, the model successfully predicted the resulting localization errors. We suggest that the relative distance between stimuli represents an additional, independent spatial cue for memory recall. This cue information is likely to be critical for spatial localization in natural settings which contain an abundance of visual landmarks.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Visuospatial working memory enables us to maintain access to visual information for processing even when a stimulus is no longer present, due to occlusion, our own movements, or transience of the stimulus. Here we show that, when localizing remembered stimuli, the precision of spatial recall does not rely solely on memory for individual stimuli, but additionally depends on the relative distances between stimuli and visual landmarks in the surroundings. Across three separate experiments, we consistently observed a spatially selective improvement in the precision of recall for items located near a persistent landmark. While the results did not require that the landmark be visible throughout the memory delay period, it was essential that it was visible both during encoding and response. We present a simple model that can accurately capture human performance by considering relative (allocentric) spatial information as an independent localization estimate which degrades with distance and is optimally integrated with egocentric spatial information. Critically, allocentric information was encoded without cost to egocentric estimation, demonstrating independent storage of the two sources of information. Finally, when egocentric and allocentric estimates were put in conflict, the model successfully predicted the resulting localization errors. We suggest that the relative distance between stimuli represents an additional, independent spatial cue for memory recall. This cue information is likely to be critical for spatial localization in natural settings which contain an abundance of visual landmarks. |
Annika Åkerfelt; Hans Colonius; Adele Diederich Visual-tactile saccadic inhibition Journal Article Experimental Brain Research, 169 (4), pp. 554–563, 2006. @article{Aakerfelt2006, title = {Visual-tactile saccadic inhibition}, author = {Annika Åkerfelt and Hans Colonius and Adele Diederich}, doi = {10.1007/s00221-005-0168-x}, year = {2006}, date = {2006-01-01}, journal = {Experimental Brain Research}, volume = {169}, number = {4}, pages = {554--563}, abstract = {In an eye movement countermanding paradigm it is demonstrated for the first time that a tactile stimulus can be an effective stop signal when human participants are to inhibit saccades to a visual target. Estimated stop signal processing times were 90-140 ms, comparable to results with auditory stop signals, but shorter than those commonly found for manual responses. Two of the three participants significantly slowed their reactions in expectation of the stop signal as revealed by a control experiment without stop signals. All participants produced slower responses in the shortest stop signal delay condition than predicted by the race model (Logan and Cowan 1984) along with hypometric saccades on stop failure trials, suggesting that the race model may need to be elaborated to include some component of interaction of stop and go signal processing.}, keywords = {}, pubstate = {published}, tppubtype = {article} } In an eye movement countermanding paradigm it is demonstrated for the first time that a tactile stimulus can be an effective stop signal when human participants are to inhibit saccades to a visual target. Estimated stop signal processing times were 90-140 ms, comparable to results with auditory stop signals, but shorter than those commonly found for manual responses. Two of the three participants significantly slowed their reactions in expectation of the stop signal as revealed by a control experiment without stop signals. All participants produced slower responses in the shortest stop signal delay condition than predicted by the race model (Logan and Cowan 1984) along with hypometric saccades on stop failure trials, suggesting that the race model may need to be elaborated to include some component of interaction of stop and go signal processing. |
Rasmus Aamand; Thomas Dalsgaard; Yi-Ching Lynn Ho; Arne Møller; Andreas Roepstorff; Torben E Lund A NO way to BOLD?: Dietary nitrate alters the hemodynamic response to visual stimulation Journal Article NeuroImage, 83 , pp. 397–407, 2013. @article{Aamand2013, title = {A NO way to BOLD?: Dietary nitrate alters the hemodynamic response to visual stimulation}, author = {Rasmus Aamand and Thomas Dalsgaard and Yi-Ching Lynn Ho and Arne Møller and Andreas Roepstorff and Torben E Lund}, doi = {10.1016/j.neuroimage.2013.06.069}, year = {2013}, date = {2013-12-01}, journal = {NeuroImage}, volume = {83}, pages = {397--407}, publisher = {Elsevier Inc.}, abstract = {Neurovascular coupling links neuronal activity to vasodilation. Nitric oxide (NO) is a potent vasodilator, and in neurovascular coupling NO production from NO synthases plays an important role. However, another pathway for NO production also exists, namely the nitrate-nitrite-NO pathway. On this basis, we hypothesized that dietary nitrate (NO3-) could influence the brain's hemodynamic response to neuronal stimulation. In the present study, 20 healthy male participants were given either sodium nitrate (NaNO3) or sodium chloride (NaCl) (saline placebo) in a crossover study and were shown visual stimuli based on the retinotopic characteristics of the visual cortex. Our primary measure of the hemodynamic response was the blood oxygenation level dependent (BOLD) response measured with high-resolution functional magnetic resonance imaging (0.64×0.64×1.8mm) in the visual cortex. From this response, we made a direct estimate of key parameters characterizing the shape of the BOLD response (i.e. lag and amplitude). During elevated nitrate intake, corresponding to the nitrate content of a large plate of salad, both the hemodynamic lag and the BOLD amplitude decreased significantly (7.0±2% and 7.9±4%, respectively), and the variation across activated voxels of both measures decreased (12.3±4% and 15.3±7%, respectively). The baseline cerebral blood flow was not affected by nitrate. Ourexperiments demonstrate, for the first time, that dietary nitrate may modulate the local cerebral hemodynamic response to stimuli. A faster and smaller BOLD response, with less variation across local cortex, is consistent with an enhanced hemodynamic coupling during elevated nitrate intake. These findings suggest that dietary patterns, via the nitrate-nitrite-NO pathway, may be a potential way to affect key properties of neurovascular coupling. This could have major clinical implications, which remain to be explored.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Neurovascular coupling links neuronal activity to vasodilation. Nitric oxide (NO) is a potent vasodilator, and in neurovascular coupling NO production from NO synthases plays an important role. However, another pathway for NO production also exists, namely the nitrate-nitrite-NO pathway. On this basis, we hypothesized that dietary nitrate (NO3-) could influence the brain's hemodynamic response to neuronal stimulation. In the present study, 20 healthy male participants were given either sodium nitrate (NaNO3) or sodium chloride (NaCl) (saline placebo) in a crossover study and were shown visual stimuli based on the retinotopic characteristics of the visual cortex. Our primary measure of the hemodynamic response was the blood oxygenation level dependent (BOLD) response measured with high-resolution functional magnetic resonance imaging (0.64×0.64×1.8mm) in the visual cortex. From this response, we made a direct estimate of key parameters characterizing the shape of the BOLD response (i.e. lag and amplitude). During elevated nitrate intake, corresponding to the nitrate content of a large plate of salad, both the hemodynamic lag and the BOLD amplitude decreased significantly (7.0±2% and 7.9±4%, respectively), and the variation across activated voxels of both measures decreased (12.3±4% and 15.3±7%, respectively). The baseline cerebral blood flow was not affected by nitrate. Ourexperiments demonstrate, for the first time, that dietary nitrate may modulate the local cerebral hemodynamic response to stimuli. A faster and smaller BOLD response, with less variation across local cortex, is consistent with an enhanced hemodynamic coupling during elevated nitrate intake. These findings suggest that dietary patterns, via the nitrate-nitrite-NO pathway, may be a potential way to affect key properties of neurovascular coupling. This could have major clinical implications, which remain to be explored. |
Rasmus Aamand; Yi-Ching Lynn Ho; Thomas Dalsgaard; Andreas Roepstorff; Torben E Lund Dietary nitrate facilitates an acetazolamide-induced increase in cerebral blood flow during visual stimulation Journal Article Journal of Applied Physiology, 116 (3), pp. 267–273, 2014. @article{Aamand2014, title = {Dietary nitrate facilitates an acetazolamide-induced increase in cerebral blood flow during visual stimulation}, author = {Rasmus Aamand and Yi-Ching Lynn Ho and Thomas Dalsgaard and Andreas Roepstorff and Torben E Lund}, doi = {10.1152/japplphysiol.00797.2013}, year = {2014}, date = {2014-02-01}, journal = {Journal of Applied Physiology}, volume = {116}, number = {3}, pages = {267--273}, abstract = {The carbonic anhydrase (CA) inhibitor acetazolamide (AZ) is used routinely to estimate cerebrovascular reserve capacity in patients, as it reliably increases cerebral blood flow (CBF). However, the mechanism by which AZ accomplishes this CBF increase is not entirely understood. We recently discovered that CA can produce nitric oxide (NO) from nitrite, and that AZ enhances this NO production in vitro. In fact, this interaction between AZ and CA accounted for a large part of AZ's vasodilatory action, which fits well with the known vasodilatory potency of NO. The present study aimed to assess whether AZ acts similarly in vivo in the human cerebrovascular system. Hence, we increased or minimized the dietary intake of nitrate in 20 healthy male participants, showed them a full-field flickering dartboard, and measured their CBF response to this visual stimulus with arterial spin labeling. Doing so, we found a significant positive interaction between the dietary intake of nitrate and the CBF modulation afforded by AZ during visual stimulation. In addition, but contrary to studies conducted in elderly participants, we report no effect of nitrate intake on resting CBF in healthy human participants. The present study provides in vivo support for an enhancing effect of AZ on the NO production from nitrite catalyzed by CA in the cerebrovascular system. Furthermore, our results, in combination with the results of other groups, indicate that nitrate may have significant importance to vascular function when the cerebrovascular system is challenged by age or disease.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The carbonic anhydrase (CA) inhibitor acetazolamide (AZ) is used routinely to estimate cerebrovascular reserve capacity in patients, as it reliably increases cerebral blood flow (CBF). However, the mechanism by which AZ accomplishes this CBF increase is not entirely understood. We recently discovered that CA can produce nitric oxide (NO) from nitrite, and that AZ enhances this NO production in vitro. In fact, this interaction between AZ and CA accounted for a large part of AZ's vasodilatory action, which fits well with the known vasodilatory potency of NO. The present study aimed to assess whether AZ acts similarly in vivo in the human cerebrovascular system. Hence, we increased or minimized the dietary intake of nitrate in 20 healthy male participants, showed them a full-field flickering dartboard, and measured their CBF response to this visual stimulus with arterial spin labeling. Doing so, we found a significant positive interaction between the dietary intake of nitrate and the CBF modulation afforded by AZ during visual stimulation. In addition, but contrary to studies conducted in elderly participants, we report no effect of nitrate intake on resting CBF in healthy human participants. The present study provides in vivo support for an enhancing effect of AZ on the NO production from nitrite catalyzed by CA in the cerebrovascular system. Furthermore, our results, in combination with the results of other groups, indicate that nitrate may have significant importance to vascular function when the cerebrovascular system is challenged by age or disease. |
Dato Abashidze; Maria Nella Carminati; Pia Knoeferle Anticipating a future versus integrating a recent event? Evidence from eye-tracking Journal Article Acta Psychologica, 200 , pp. 102916, 2019. @article{Abashidze2019, title = {Anticipating a future versus integrating a recent event? Evidence from eye-tracking}, author = {Dato Abashidze and Maria Nella Carminati and Pia Knoeferle}, doi = {10.1016/j.actpsy.2019.102916}, year = {2019}, date = {2019-09-01}, journal = {Acta Psychologica}, volume = {200}, pages = {102916}, publisher = {Elsevier}, abstract = {When comprehending a spoken sentence that refers to a visually-presented event, comprehenders both integrate their current interpretation of language with the recent event and develop expectations about future event possibilities. Tense cues can disambiguate this linking, but temporary ambiguity in these cues may lead comprehenders to also rely on further, experience-based (e.g., frequency or an actor's gaze) cues. How comprehenders reconcile these different cues in real time is an open issue. Extant results suggest that comprehenders preferentially relate their unfolding interpretation to a recent event by inspecting its target object. We investigated to what extent this recent-event preference could be overridden by short-term experiential and situation-specific cues. In Experiments 1–2 participants saw substantially more future than recent events and listened to more sentences about future-events (75% in Experiment 1 and 88% in Experiment 2). Experiment 3 cued future target objects and event possibilities via an actor's gaze. The event frequency increase yielded a reduction in the recent event inspection preference early during sentence processing in Experiments 1–2 compared with Experiment 3 (where event frequency and utterance tense were balanced) but did not eliminate the overall recent-event preference. Actor gaze also modulated the recent-event preference, and jointly with future tense led to its reversal in Experiment 3. However, our results showed that people overall preferred to focus on recent (vs. future) events in their interpretation, suggesting that while two cues (actor gaze and short-term event frequency) can partially override the recent-event preference, the latter still plays a key role in shaping participants' interpretation.}, keywords = {}, pubstate = {published}, tppubtype = {article} } When comprehending a spoken sentence that refers to a visually-presented event, comprehenders both integrate their current interpretation of language with the recent event and develop expectations about future event possibilities. Tense cues can disambiguate this linking, but temporary ambiguity in these cues may lead comprehenders to also rely on further, experience-based (e.g., frequency or an actor's gaze) cues. How comprehenders reconcile these different cues in real time is an open issue. Extant results suggest that comprehenders preferentially relate their unfolding interpretation to a recent event by inspecting its target object. We investigated to what extent this recent-event preference could be overridden by short-term experiential and situation-specific cues. In Experiments 1–2 participants saw substantially more future than recent events and listened to more sentences about future-events (75% in Experiment 1 and 88% in Experiment 2). Experiment 3 cued future target objects and event possibilities via an actor's gaze. The event frequency increase yielded a reduction in the recent event inspection preference early during sentence processing in Experiments 1–2 compared with Experiment 3 (where event frequency and utterance tense were balanced) but did not eliminate the overall recent-event preference. Actor gaze also modulated the recent-event preference, and jointly with future tense led to its reversal in Experiment 3. However, our results showed that people overall preferred to focus on recent (vs. future) events in their interpretation, suggesting that while two cues (actor gaze and short-term event frequency) can partially override the recent-event preference, the latter still plays a key role in shaping participants' interpretation. |
Matthew J Abbott; Bernhard Angele; Danbi Y Ahn; Keith Rayner Skipping syntactically illegal the previews: The role of predictability. Journal Article Journal of Experimental Psychology: Learning, Memory, and Cognition, 41 (6), pp. 1703–1714, 2015. @article{Abbott2015a, title = {Skipping syntactically illegal the previews: The role of predictability.}, author = {Matthew J Abbott and Bernhard Angele and Danbi Y Ahn and Keith Rayner}, doi = {10.1037/xlm0000142}, year = {2015}, date = {2015-11-01}, journal = {Journal of Experimental Psychology: Learning, Memory, and Cognition}, volume = {41}, number = {6}, pages = {1703--1714}, abstract = {Readers tend to skip words, particularly when they are short, frequent, or predictable. Angele and Rayner (2013) recently reported that readers are often unable to detect syntactic anomalies in parafoveal vision. In the present study, we manipulated target word predictability to assess whether contextual constraint modulates the-skipping behavior. The results provide further evidence that readers frequently skip the article the when infelicitous in context. Readers skipped predictable words more often than unpredictable words, even when the, which was syntactically illegal and unpredictable from the prior context, was presented as a parafoveal preview. The results of the experiment were simulated using E-Z Reader 10 by assuming that cloze probability can be dissociated from parafoveal visual input. It appears that when a short word is predictable in context, a decision to skip it can be made even if the information available parafoveally conflicts both visually and syntactically with those predictions.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Readers tend to skip words, particularly when they are short, frequent, or predictable. Angele and Rayner (2013) recently reported that readers are often unable to detect syntactic anomalies in parafoveal vision. In the present study, we manipulated target word predictability to assess whether contextual constraint modulates the-skipping behavior. The results provide further evidence that readers frequently skip the article the when infelicitous in context. Readers skipped predictable words more often than unpredictable words, even when the, which was syntactically illegal and unpredictable from the prior context, was presented as a parafoveal preview. The results of the experiment were simulated using E-Z Reader 10 by assuming that cloze probability can be dissociated from parafoveal visual input. It appears that when a short word is predictable in context, a decision to skip it can be made even if the information available parafoveally conflicts both visually and syntactically with those predictions. |
Matthew J Abbott; Adrian Staub The effect of plausibility on eye movements in reading: Testing E-Z Reader's null predictions Journal Article Journal of Memory and Language, 85 , pp. 76–87, 2015. @article{Abbott2015b, title = {The effect of plausibility on eye movements in reading: Testing E-Z Reader's null predictions}, author = {Matthew J Abbott and Adrian Staub}, doi = {10.1016/j.jml.2015.07.002}, year = {2015}, date = {2015-01-01}, journal = {Journal of Memory and Language}, volume = {85}, pages = {76--87}, publisher = {Elsevier Inc.}, abstract = {The E-Z Reader 10 model of eye movements in reading (Reichle, Warren, & McConnell, 2009) posits that the process of word identification strictly precedes the process of integration of a word into its syntactic and semantic context. The present study reports a single large-scale (N=112) eyetracking experiment in which the frequency and plausibility of a target word in each sentence were factorially manipulated. The results were consistent with E-Z Reader's central predictions: frequency but not plausibility influenced the probability that the word was skipped over by the eyes rather than directly fixated, and the two variables had additive, not interactive, effects on all reading time measures. Evidence in favor of null effects and null interactions was obtained by computing Bayes factors, using the default priors and sampling methods for ANOVA models implemented by Rouder, Morey, Speckman, and Province (2012). The results suggest that though a word's plausibility may have a measurable influence as early as the first fixation duration on the target word, in fact plausibility may be influencing only a post-lexical processing stage, rather than lexical identification itself.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The E-Z Reader 10 model of eye movements in reading (Reichle, Warren, & McConnell, 2009) posits that the process of word identification strictly precedes the process of integration of a word into its syntactic and semantic context. The present study reports a single large-scale (N=112) eyetracking experiment in which the frequency and plausibility of a target word in each sentence were factorially manipulated. The results were consistent with E-Z Reader's central predictions: frequency but not plausibility influenced the probability that the word was skipped over by the eyes rather than directly fixated, and the two variables had additive, not interactive, effects on all reading time measures. Evidence in favor of null effects and null interactions was obtained by computing Bayes factors, using the default priors and sampling methods for ANOVA models implemented by Rouder, Morey, Speckman, and Province (2012). The results suggest that though a word's plausibility may have a measurable influence as early as the first fixation duration on the target word, in fact plausibility may be influencing only a post-lexical processing stage, rather than lexical identification itself. |
Bahman Abdi Sargezeh; Ahmad Ayatollahi; Mohammad Reza Daliri Investigation of eye movement pattern parameters of individuals with different fluid intelligence Journal Article Experimental Brain Research, 237 , pp. 15–28, 2019. @article{AbdiSargezeh2019, title = {Investigation of eye movement pattern parameters of individuals with different fluid intelligence}, author = {Bahman {Abdi Sargezeh} and Ahmad Ayatollahi and Mohammad Reza Daliri}, doi = {10.1007/s00221-018-5392-2}, year = {2019}, date = {2019-01-01}, journal = {Experimental Brain Research}, volume = {237}, pages = {15--28}, publisher = {Springer Berlin Heidelberg}, abstract = {Eye movement studies are subject of interest in human cognition. Cortical activity and cognitive load impress eye movement influentially. Here, we investigated whether fluid intelligence (FI) has any effect on eye movement pattern in a comparative visual search (CVS) task. FI of individuals was measured using the Cattell test, and participants were divided into three groups: low FI, middle FI, and high FI. Eye movements of individuals were then recorded during the CVS task. Eye movement patterns were extracted and compared statistically among the three groups. Our experiment demonstrated that eye movement patterns were significantly different among the three groups. Pearson correlation coefficients between FI and eye movement parameters were also calculated to assess which of the eye movement parameters were most affected by FI. Our findings illustrate that saccade peak velocity had the greatest positive correlation with FI score and the ratio of total fixation duration to total saccade duration had the greatest negative correlation with FI. Next, we extracted 24 features from eye movement patterns and designed: (1) a classifier to categorize individuals and (2) a regression analysis to predict the FI score of individuals. In the best case examined, the classifier categorized subjects with 68.3% accuracy, and the regression predicted FI of individuals with a 0.54 correlation between observed FI and predicted FI. In our investigation, the results have emphasized that imposed loads on low FI individuals is greater than that of high FI individuals in the cognitive load tasks.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Eye movement studies are subject of interest in human cognition. Cortical activity and cognitive load impress eye movement influentially. Here, we investigated whether fluid intelligence (FI) has any effect on eye movement pattern in a comparative visual search (CVS) task. FI of individuals was measured using the Cattell test, and participants were divided into three groups: low FI, middle FI, and high FI. Eye movements of individuals were then recorded during the CVS task. Eye movement patterns were extracted and compared statistically among the three groups. Our experiment demonstrated that eye movement patterns were significantly different among the three groups. Pearson correlation coefficients between FI and eye movement parameters were also calculated to assess which of the eye movement parameters were most affected by FI. Our findings illustrate that saccade peak velocity had the greatest positive correlation with FI score and the ratio of total fixation duration to total saccade duration had the greatest negative correlation with FI. Next, we extracted 24 features from eye movement patterns and designed: (1) a classifier to categorize individuals and (2) a regression analysis to predict the FI score of individuals. In the best case examined, the classifier categorized subjects with 68.3% accuracy, and the regression predicted FI of individuals with a 0.54 correlation between observed FI and predicted FI. In our investigation, the results have emphasized that imposed loads on low FI individuals is greater than that of high FI individuals in the cognitive load tasks. |
Bahman Abdi Sargezeh; Niloofar Tavakoli; Mohammad Reza Daliri Gender-based eye movement differences in passive indoor picture viewing: An eye-tracking study Journal Article Physiology and Behavior, 206 , pp. 43–50, 2019. @article{AbdiSargezeh2019a, title = {Gender-based eye movement differences in passive indoor picture viewing: An eye-tracking study}, author = {Bahman {Abdi Sargezeh} and Niloofar Tavakoli and Mohammad Reza Daliri}, doi = {10.1016/j.physbeh.2019.03.023}, year = {2019}, date = {2019-01-01}, journal = {Physiology and Behavior}, volume = {206}, pages = {43--50}, abstract = {Male and female brains have different structures, which can make genders produce various eye- movement patterns. This study presents the results of an eye tracking experiment in which we analyzed the eye movements of 25 male and 20 female participants during passive indoor picture viewing. We examined eye-movement parameters, namely fixation duration, scan path length, number of saccades, spatial density, saccade amplitude, and the ratio of total fixation duration to total saccade duration so as to investigate gender differences in eye-movement patterns while indoor picture viewing. We found significant differences in eye-movement patterns between genders. The results of eye-movement analysis also indicated that females showed more explorative gaze behavior, indicated by larger saccade amplitudes, and by longer scan paths. Furthermore, owing to shorter ratio of fixation durations to saccade duration in females as compared to male, we speculate that females inspect the images faster than males. In addition, we classified the genders into two subgroups—males and females—based on their eye-movement parameters by using a support vector machine classifier achieving an accuracy of 70%. We have come to the result males and females – with same culture – see the environment differently. Our findings have profound implications for researches employing gaze-based models.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Male and female brains have different structures, which can make genders produce various eye- movement patterns. This study presents the results of an eye tracking experiment in which we analyzed the eye movements of 25 male and 20 female participants during passive indoor picture viewing. We examined eye-movement parameters, namely fixation duration, scan path length, number of saccades, spatial density, saccade amplitude, and the ratio of total fixation duration to total saccade duration so as to investigate gender differences in eye-movement patterns while indoor picture viewing. We found significant differences in eye-movement patterns between genders. The results of eye-movement analysis also indicated that females showed more explorative gaze behavior, indicated by larger saccade amplitudes, and by longer scan paths. Furthermore, owing to shorter ratio of fixation durations to saccade duration in females as compared to male, we speculate that females inspect the images faster than males. In addition, we classified the genders into two subgroups—males and females—based on their eye-movement parameters by using a support vector machine classifier achieving an accuracy of 70%. We have come to the result males and females – with same culture – see the environment differently. Our findings have profound implications for researches employing gaze-based models. |
Parisa Abedi Khoozani; Gunnar Blohm Neck muscle spindle noise biases reaches in a multisensory integration task Journal Article Journal of Neurophysiology, 120 (3), pp. 893–909, 2018. @article{AbediKhoozani2018, title = {Neck muscle spindle noise biases reaches in a multisensory integration task}, author = {Parisa {Abedi Khoozani} and Gunnar Blohm}, doi = {10.1152/jn.00643.2017}, year = {2018}, date = {2018-01-01}, journal = {Journal of Neurophysiology}, volume = {120}, number = {3}, pages = {893--909}, abstract = {Reference frame Transformations (RFTs) are crucial components of sensorimotor transformations in the brain. Stochasticity in RFTs has been suggested to add noise to the transformed signal due to variability in transformation parameter estimates (e.g. angle) as well as the stochastic nature of computations in spiking networks of neurons. Here, we varied the RFT angle together with the associated variability and evaluated the behavioral impact in a reaching task that required variability-dependent visual-proprioceptive multi-sensory integration. Crucially, reaches were performed with the head either straight or rolled 30deg to either shoulder and we also applied neck loads of 0 or 1.8kg (left or right) in a 3x3 design, resulting in different combinations of estimated head roll angle magnitude and variance required in RFTs. A novel 3D stochastic model of multi-sensory integration across reference frames was fitted to the data and captured our main behavioral findings: (1) neck load biased head angle estimation across all head roll orientations resulting in systematic shifts in reach errors; (2) Increased neck muscle tone led to increased reach variability, due to signal-dependent noise; (3) both head roll and neck load created larger angular errors in reaches to visual targets away from the body compared to reaches toward the body. These results show that noise in muscle spindles and stochasticity in general have a tangible effect on RFTs underlying reach planning. Since RFTs are omnipresent in the brain, our results could have implication for processes as diverse as motor control, decision making, posture / balance control, and perception.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Reference frame Transformations (RFTs) are crucial components of sensorimotor transformations in the brain. Stochasticity in RFTs has been suggested to add noise to the transformed signal due to variability in transformation parameter estimates (e.g. angle) as well as the stochastic nature of computations in spiking networks of neurons. Here, we varied the RFT angle together with the associated variability and evaluated the behavioral impact in a reaching task that required variability-dependent visual-proprioceptive multi-sensory integration. Crucially, reaches were performed with the head either straight or rolled 30deg to either shoulder and we also applied neck loads of 0 or 1.8kg (left or right) in a 3x3 design, resulting in different combinations of estimated head roll angle magnitude and variance required in RFTs. A novel 3D stochastic model of multi-sensory integration across reference frames was fitted to the data and captured our main behavioral findings: (1) neck load biased head angle estimation across all head roll orientations resulting in systematic shifts in reach errors; (2) Increased neck muscle tone led to increased reach variability, due to signal-dependent noise; (3) both head roll and neck load created larger angular errors in reaches to visual targets away from the body compared to reaches toward the body. These results show that noise in muscle spindles and stochasticity in general have a tangible effect on RFTs underlying reach planning. Since RFTs are omnipresent in the brain, our results could have implication for processes as diverse as motor control, decision making, posture / balance control, and perception. |
Mathias Abegg; Hyung Lee; Jason J S Barton Systematic diagonal and vertical errors in antisaccades and memory-guided saccades Journal Article Journal of Eye Movement Research, 3 (3), pp. 1–10, 2010. @article{Abegg2010, title = {Systematic diagonal and vertical errors in antisaccades and memory-guided saccades}, author = {Mathias Abegg and Hyung Lee and Jason J S Barton}, doi = {10.16910/jemr.3.3.5}, year = {2010}, date = {2010-01-01}, journal = {Journal of Eye Movement Research}, volume = {3}, number = {3}, pages = {1--10}, abstract = {Studies of memory-guided saccades in monkeys show an upward bias, while studies of antisaccades in humans show a diagonal effect, a deviation of endpoints toward the 45° diagonal. To determine if these two different spatial biases are specific to different types of saccades, we studied prosaccades, antisaccades and memory-guided saccades in humans. The diagonal effect occurred not with prosaccades but with antisaccades and memory-guided saccades with long intervals, consistent with hypotheses that it originates in computations of goal location under conditions of uncertainty. There was a small upward bias for memory-guided saccades but not prosaccades or antisaccades. Thus this bias is not a general effect of target uncertainty but a property specific to memory-guided saccades.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Studies of memory-guided saccades in monkeys show an upward bias, while studies of antisaccades in humans show a diagonal effect, a deviation of endpoints toward the 45° diagonal. To determine if these two different spatial biases are specific to different types of saccades, we studied prosaccades, antisaccades and memory-guided saccades in humans. The diagonal effect occurred not with prosaccades but with antisaccades and memory-guided saccades with long intervals, consistent with hypotheses that it originates in computations of goal location under conditions of uncertainty. There was a small upward bias for memory-guided saccades but not prosaccades or antisaccades. Thus this bias is not a general effect of target uncertainty but a property specific to memory-guided saccades. |
Mathias Abegg; Amadeo R Rodriguez; Hyung Lee; Jason J S Barton ‘Alternate-goal bias' in antisaccades and the influence of expectation Journal Article Experimental Brain Research, 203 (3), pp. 553–562, 2010. @article{Abegg2010a, title = {‘Alternate-goal bias' in antisaccades and the influence of expectation}, author = {Mathias Abegg and Amadeo R Rodriguez and Hyung Lee and Jason J S Barton}, doi = {10.1007/s00221-010-2259-6}, year = {2010}, date = {2010-01-01}, journal = {Experimental Brain Research}, volume = {203}, number = {3}, pages = {553--562}, abstract = {Saccadic performance depends on the requirements of the current trial, but also may be influenced by other trials in the same experiment. This effect of trial context has been investigated most for saccadic error rate and reaction time but seldom for the positional accuracy of saccadic landing points. We investigated whether the direction of saccades towards one goal is affected by the location of a second goal used in other trials in the same experimental block. In our first experiment, landing points ('endpoints') of antisaccades but not prosaccades were shifted towards the location of the alternate goal. This spatial bias decreased with increasing angular separation between the current and alternative goals. In a second experiment, we explored whether expectancy about the goal location was responsible for the biasing of the saccadic endpoint. For this, we used a condition where the saccadic goal randomly changed from one trial to the next between locations on, above or below the horizontal meridian. We modulated the prior probability of the alternate-goal location by showing cues prior to stimulus onset. The results showed that expectation about the possible positions of the saccadic goal is sufficient to bias saccadic endpoints and can account for at least part of this phenomenon of 'alternate-goal bias'.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Saccadic performance depends on the requirements of the current trial, but also may be influenced by other trials in the same experiment. This effect of trial context has been investigated most for saccadic error rate and reaction time but seldom for the positional accuracy of saccadic landing points. We investigated whether the direction of saccades towards one goal is affected by the location of a second goal used in other trials in the same experimental block. In our first experiment, landing points ('endpoints') of antisaccades but not prosaccades were shifted towards the location of the alternate goal. This spatial bias decreased with increasing angular separation between the current and alternative goals. In a second experiment, we explored whether expectancy about the goal location was responsible for the biasing of the saccadic endpoint. For this, we used a condition where the saccadic goal randomly changed from one trial to the next between locations on, above or below the horizontal meridian. We modulated the prior probability of the alternate-goal location by showing cues prior to stimulus onset. The results showed that expectation about the possible positions of the saccadic goal is sufficient to bias saccadic endpoints and can account for at least part of this phenomenon of 'alternate-goal bias'. |
Mathias Abegg; Dara S Manoach; Jason J S Barton Knowing the future: Partial foreknowledge effects on the programming of prosaccades and antisaccades Journal Article Vision Research, 51 (1), pp. 215–221, 2011. @article{Abegg2011, title = {Knowing the future: Partial foreknowledge effects on the programming of prosaccades and antisaccades}, author = {Mathias Abegg and Dara S Manoach and Jason J S Barton}, doi = {10.1016/j.visres.2010.11.006}, year = {2011}, date = {2011-01-01}, journal = {Vision Research}, volume = {51}, number = {1}, pages = {215--221}, abstract = {Foreknowledge about the demands of an upcoming trial may be exploited to optimize behavioural responses. In the current study we systematically investigated the benefits of partial foreknowledge - that is, when some but not all aspects of a future trial are known in advance. For this we used an ocular motor paradigm with horizontal prosaccades and antisaccades. Predictable sequences were used to create three partial foreknowledge conditions: one with foreknowledge about the stimulus location only, one with foreknowledge about the task set only, and one with foreknowledge about the direction of the required response only. These were contrasted with a condition of no-foreknowledge and a condition of complete foreknowledge about all three parameters. The results showed that the three types of foreknowledge affected saccadic efficiency differently. While foreknowledge about stimulus-location had no effect on efficiency, task foreknowledge had some effect and response-foreknowledge was as effective as complete foreknowledge. Foreknowledge effects on switch costs followed a similar pattern in general, but were not specific for switching of the trial attribute for which foreknowledge was available. We conclude that partial foreknowledge has a differential effect on efficiency, most consistent with preparatory activation of a motor schema in advance of the stimulus, with consequent benefits for both switched and repeated trials.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Foreknowledge about the demands of an upcoming trial may be exploited to optimize behavioural responses. In the current study we systematically investigated the benefits of partial foreknowledge - that is, when some but not all aspects of a future trial are known in advance. For this we used an ocular motor paradigm with horizontal prosaccades and antisaccades. Predictable sequences were used to create three partial foreknowledge conditions: one with foreknowledge about the stimulus location only, one with foreknowledge about the task set only, and one with foreknowledge about the direction of the required response only. These were contrasted with a condition of no-foreknowledge and a condition of complete foreknowledge about all three parameters. The results showed that the three types of foreknowledge affected saccadic efficiency differently. While foreknowledge about stimulus-location had no effect on efficiency, task foreknowledge had some effect and response-foreknowledge was as effective as complete foreknowledge. Foreknowledge effects on switch costs followed a similar pattern in general, but were not specific for switching of the trial attribute for which foreknowledge was available. We conclude that partial foreknowledge has a differential effect on efficiency, most consistent with preparatory activation of a motor schema in advance of the stimulus, with consequent benefits for both switched and repeated trials. |
Mathias Abegg; Nishant Sharma; Jason J S Barton Antisaccades generate two types of saccadic inhibition Journal Article Biological Psychology, 89 (1), pp. 191–194, 2012. @article{Abegg2012, title = {Antisaccades generate two types of saccadic inhibition}, author = {Mathias Abegg and Nishant Sharma and Jason J S Barton}, doi = {10.1016/j.biopsycho.2011.10.007}, year = {2012}, date = {2012-01-01}, journal = {Biological Psychology}, volume = {89}, number = {1}, pages = {191--194}, abstract = {To make an antisaccade away from a stimulus, one must also suppress the more reflexive prosaccade to the stimulus. Whether this inhibition is diffuse or specific for saccade direction is not known. We used a paradigm examining inter-trial carry-over effects. Twelve subjects performed sequences of four identical antisaccades followed by sequences of four prosaccades randomly directed at the location of the antisaccade stimulus, the location of the antisaccade goal, or neutral locations. We found two types of persistent antisaccade-related inhibition. First, prosaccades in any direction were delayed only in the first trial after the antisaccades. Second, prosaccades to the location of the antisaccade stimulus were delayed more than all other prosaccades, and this persisted from the first to the fourth subsequent trial. These findings are consistent with both a transient global inhibition and a more sustained focal inhibition specific for the location of the antisaccade stimulus.}, keywords = {}, pubstate = {published}, tppubtype = {article} } To make an antisaccade away from a stimulus, one must also suppress the more reflexive prosaccade to the stimulus. Whether this inhibition is diffuse or specific for saccade direction is not known. We used a paradigm examining inter-trial carry-over effects. Twelve subjects performed sequences of four identical antisaccades followed by sequences of four prosaccades randomly directed at the location of the antisaccade stimulus, the location of the antisaccade goal, or neutral locations. We found two types of persistent antisaccade-related inhibition. First, prosaccades in any direction were delayed only in the first trial after the antisaccades. Second, prosaccades to the location of the antisaccade stimulus were delayed more than all other prosaccades, and this persisted from the first to the fourth subsequent trial. These findings are consistent with both a transient global inhibition and a more sustained focal inhibition specific for the location of the antisaccade stimulus. |
Mathias Abegg; Dario Pianezzi; Jason J S Barton A vertical asymmetry in saccades Journal Article Journal of Eye Movement Research, 8 (5), pp. 1–10, 2015. @article{Abegg2015, title = {A vertical asymmetry in saccades}, author = {Mathias Abegg and Dario Pianezzi and Jason J S Barton}, doi = {10.16910/jemr.8.5.3}, year = {2015}, date = {2015-01-01}, journal = {Journal of Eye Movement Research}, volume = {8}, number = {5}, pages = {1--10}, abstract = {Visual exploration of natural scenes imposes demands that differ between the upper and the lower visual hemifield. Yet little is known about how ocular motor performance is affected by the location of visual stimuli or the direction of a behavioural response. We compared saccadic latencies between upper and lower hemifield in a variety of conditions, including short-latency prosaccades, long-latency prosaccades, antisaccades, memory-guided saccades and saccades with increased attentional and selection demand. All saccade types, except memory guided saccades, had shorter latencies when saccades were directed towards the upper field as compared to downward saccades (ptextless0.05). This upper field reaction time advantage probably arises in ocular motor rather than visual processing. It may originate in structures involved in motor preparation rather than execution.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Visual exploration of natural scenes imposes demands that differ between the upper and the lower visual hemifield. Yet little is known about how ocular motor performance is affected by the location of visual stimuli or the direction of a behavioural response. We compared saccadic latencies between upper and lower hemifield in a variety of conditions, including short-latency prosaccades, long-latency prosaccades, antisaccades, memory-guided saccades and saccades with increased attentional and selection demand. All saccade types, except memory guided saccades, had shorter latencies when saccades were directed towards the upper field as compared to downward saccades (ptextless0.05). This upper field reaction time advantage probably arises in ocular motor rather than visual processing. It may originate in structures involved in motor preparation rather than execution. |
Naotoshi Abekawa; Hiroaki Gomi Spatial coincidence of intentional actions modulates an implicit visuomotor control Journal Article Journal of Neurophysiology, 103 (5), pp. 2717–2727, 2010. @article{Abekawa2010, title = {Spatial coincidence of intentional actions modulates an implicit visuomotor control}, author = {Naotoshi Abekawa and Hiroaki Gomi}, doi = {10.1152/jn.91133.2008}, year = {2010}, date = {2010-01-01}, journal = {Journal of Neurophysiology}, volume = {103}, number = {5}, pages = {2717--2727}, abstract = {We investigated a visuomotor mechanism contributing to reach correction: the manual following response (MFR), which is a quick response to background visual motion that frequently occurs as a reafference when the body moves. Although several visual specificities of the MFR have been elucidated, the functional and computational mechanisms of its motor coordination remain unclear mainly because it involves complex relationships among gaze, reaching target, and visual stimuli. To directly explore how these factors interact in the MFR, we assessed the impact of spatial coincidences among gaze, arm reaching, and visual motion on the MFR. When gaze location was displaced from the reaching target with an identical visual motion kept on the retina, the amplitude of the MFR significantly decreased as displacement increased. A factorial manipulation of gaze, reaching-target, and visual motion locations showed that the response decrease is due to the spatial separation between gaze and reaching target but is not due to the spatial separation between visual motion and reaching target. Additionally, elimination of visual motion around the fovea attenuated the MFR. The effects of these spatial coincidences on the MFR are completely different from their effects on the perceptual mislocalization of targets caused by visual motion. Furthermore, we found clear differences between the modulation sensitivities of the MFR and the ocular following response to spatial mismatch between gaze and reaching locations. These results suggest that the MFR modulation observed in our experiment is not due to changes in visual interaction between target and visual motion or to modulation of motion sensitivity in early visual processing. Instead the motor command of the MFR appears to be modulated by the spatial relationship between gaze and reaching.}, keywords = {}, pubstate = {published}, tppubtype = {article} } We investigated a visuomotor mechanism contributing to reach correction: the manual following response (MFR), which is a quick response to background visual motion that frequently occurs as a reafference when the body moves. Although several visual specificities of the MFR have been elucidated, the functional and computational mechanisms of its motor coordination remain unclear mainly because it involves complex relationships among gaze, reaching target, and visual stimuli. To directly explore how these factors interact in the MFR, we assessed the impact of spatial coincidences among gaze, arm reaching, and visual motion on the MFR. When gaze location was displaced from the reaching target with an identical visual motion kept on the retina, the amplitude of the MFR significantly decreased as displacement increased. A factorial manipulation of gaze, reaching-target, and visual motion locations showed that the response decrease is due to the spatial separation between gaze and reaching target but is not due to the spatial separation between visual motion and reaching target. Additionally, elimination of visual motion around the fovea attenuated the MFR. The effects of these spatial coincidences on the MFR are completely different from their effects on the perceptual mislocalization of targets caused by visual motion. Furthermore, we found clear differences between the modulation sensitivities of the MFR and the ocular following response to spatial mismatch between gaze and reaching locations. These results suggest that the MFR modulation observed in our experiment is not due to changes in visual interaction between target and visual motion or to modulation of motion sensitivity in early visual processing. Instead the motor command of the MFR appears to be modulated by the spatial relationship between gaze and reaching. |
Naotoshi Abekawa; Toshio Inui; Hiroaki Gomi Eye-hand coordination in on-line visuomotor adjustments Journal Article NeuroReport, 25 (7), pp. 441–445, 2014. @article{Abekawa2014, title = {Eye-hand coordination in on-line visuomotor adjustments}, author = {Naotoshi Abekawa and Toshio Inui and Hiroaki Gomi}, doi = {10.1097/WNR.0000000000000111}, year = {2014}, date = {2014-01-01}, journal = {NeuroReport}, volume = {25}, number = {7}, pages = {441--445}, abstract = {When we perform a visually guided reaching action, the brain coordinates our hand and eye movements. Eye-hand coordination has been examined widely, but it remains unclear whether the hand and eye motor systems are coordinated during on-line visuomotor adjustments induced by a target jump during a reaching movement. As such quick motor responses are required when we interact with dynamic environments, eye and hand movements could be coordinated even during on-line motor control. Here, we examine the relationship between online hand adjustment and saccadic eye movement. In contrast to the well-known temporal order of eye and hand initiations where the hand follows the eyes, we found that on-line hand adjustment was initiated before the saccade onset. Despite this order reversal, a correlation between hand and saccade latencies was observed, suggesting that the hand motor system is not independent of eye control even when the hand response was induced before the saccade. Moreover, the latency of the hand adjustment with saccadic eye movement was significantly shorter than that with eye fixation. This hand latency modulation cannot be ascribed to any changes of visual or oculomotor reafferent information as the saccade was not yet initiated when the hand adjustment started. Taken together, the hand motor system would receive preparation signals rather than reafference signals of saccadic eye movements to provide quick manual adjustments of the goal-directed eye-hand movements.}, keywords = {}, pubstate = {published}, tppubtype = {article} } When we perform a visually guided reaching action, the brain coordinates our hand and eye movements. Eye-hand coordination has been examined widely, but it remains unclear whether the hand and eye motor systems are coordinated during on-line visuomotor adjustments induced by a target jump during a reaching movement. As such quick motor responses are required when we interact with dynamic environments, eye and hand movements could be coordinated even during on-line motor control. Here, we examine the relationship between online hand adjustment and saccadic eye movement. In contrast to the well-known temporal order of eye and hand initiations where the hand follows the eyes, we found that on-line hand adjustment was initiated before the saccade onset. Despite this order reversal, a correlation between hand and saccade latencies was observed, suggesting that the hand motor system is not independent of eye control even when the hand response was induced before the saccade. Moreover, the latency of the hand adjustment with saccadic eye movement was significantly shorter than that with eye fixation. This hand latency modulation cannot be ascribed to any changes of visual or oculomotor reafferent information as the saccade was not yet initiated when the hand adjustment started. Taken together, the hand motor system would receive preparation signals rather than reafference signals of saccadic eye movements to provide quick manual adjustments of the goal-directed eye-hand movements. |
Naotoshi Abekawa; Hiroaki Gomi Online gain update for manual following response accompanied by gaze shift during arm reaching Journal Article Journal of Neurophysiology, 113 (4), pp. 1206–1216, 2015. @article{Abekawa2015, title = {Online gain update for manual following response accompanied by gaze shift during arm reaching}, author = {Naotoshi Abekawa and Hiroaki Gomi}, doi = {10.1152/jn.00281.2014}, year = {2015}, date = {2015-01-01}, journal = {Journal of Neurophysiology}, volume = {113}, number = {4}, pages = {1206--1216}, abstract = {To capture objects by hand, online motor corrections are required to compensate for self-body movements. Recent studies have shown that background visual motion, usually caused by body movement, plays a significant role in such online corrections. Visual motion applied during a reaching movement induces a rapid and automatic manual following response (MFR) in the direction of the visual motion. Importantly, the MFR amplitude is modulated by the gaze direction relative to the reach target location (i.e., foveal or peripheral reaching). That is, the brain specifies the adequate visuomotor gain for an online controller based on gaze-reach coordination. However, the time or state point at which the brain specifies this visuomotor gain remains unclear. More specifically, does the gain change occur even during the execution of reaching? In the present study, we measured MFR amplitudes during a task in which the participant performed a saccadic eye movement that altered the gaze-reach coordination during reaching. The results indicate that the MFR amplitude immediately after the saccade termination changed according to the new gaze-reach coordination, suggesting a flexible online updating of the MFR gain during reaching. An additional experiment showed that this gain updating mostly started before the saccade terminated. Therefore, the MFR gain updating process would be triggered by an ocular command related to saccade planning or execution based on forthcoming changes in the gaze-reach coordination. Our findings suggest that the brain flexibly updates the visuomotor gain for an online controller even during reaching movements based on continuous monitoring of the gaze-reach coordination.}, keywords = {}, pubstate = {published}, tppubtype = {article} } To capture objects by hand, online motor corrections are required to compensate for self-body movements. Recent studies have shown that background visual motion, usually caused by body movement, plays a significant role in such online corrections. Visual motion applied during a reaching movement induces a rapid and automatic manual following response (MFR) in the direction of the visual motion. Importantly, the MFR amplitude is modulated by the gaze direction relative to the reach target location (i.e., foveal or peripheral reaching). That is, the brain specifies the adequate visuomotor gain for an online controller based on gaze-reach coordination. However, the time or state point at which the brain specifies this visuomotor gain remains unclear. More specifically, does the gain change occur even during the execution of reaching? In the present study, we measured MFR amplitudes during a task in which the participant performed a saccadic eye movement that altered the gaze-reach coordination during reaching. The results indicate that the MFR amplitude immediately after the saccade termination changed according to the new gaze-reach coordination, suggesting a flexible online updating of the MFR gain during reaching. An additional experiment showed that this gain updating mostly started before the saccade terminated. Therefore, the MFR gain updating process would be triggered by an ocular command related to saccade planning or execution based on forthcoming changes in the gaze-reach coordination. Our findings suggest that the brain flexibly updates the visuomotor gain for an online controller even during reaching movements based on continuous monitoring of the gaze-reach coordination. |
Naotoshi Abekawa; Elisa R Ferre; Maria Gallagher; Hiroaki Gomi; Patrick Haggard Disentangling the visual, motor and representational effects of vestibular input Journal Article Cortex, 104 , pp. 46–57, 2018. @article{Abekawa2018, title = {Disentangling the visual, motor and representational effects of vestibular input}, author = {Naotoshi Abekawa and Elisa R Ferre and Maria Gallagher and Hiroaki Gomi and Patrick Haggard}, doi = {10.1016/j.cortex.2018.04.003}, year = {2018}, date = {2018-01-01}, journal = {Cortex}, volume = {104}, pages = {46--57}, abstract = {The body midline provides a basic reference for egocentric representation of external space. Clinical observations have suggested that vestibular information underpins egocentric representations. Here we aimed to clarify whether and how vestibular inputs contribute to egocentric representation in healthy volunteers. In a psychophysical task, participants were asked to judge whether visual stimuli were located to the left or to the right of their body midline. Artificial vestibular stimulation was applied to stimulate the vestibular organs. We found that artificial stimulation of the vestibular system biased body midline perception. Importantly, no effect was found on motor effector selection. We also ruled out additional explanations based on allocentric visual representations and on potential indirect effects caused by vestibular-driven movements of the eyes, head and body. Taken together our data suggest that vestibular information contributes to computation of egocentric representations by affecting the internal representation of the body midline.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The body midline provides a basic reference for egocentric representation of external space. Clinical observations have suggested that vestibular information underpins egocentric representations. Here we aimed to clarify whether and how vestibular inputs contribute to egocentric representation in healthy volunteers. In a psychophysical task, participants were asked to judge whether visual stimuli were located to the left or to the right of their body midline. Artificial vestibular stimulation was applied to stimulate the vestibular organs. We found that artificial stimulation of the vestibular system biased body midline perception. Importantly, no effect was found on motor effector selection. We also ruled out additional explanations based on allocentric visual representations and on potential indirect effects caused by vestibular-driven movements of the eyes, head and body. Taken together our data suggest that vestibular information contributes to computation of egocentric representations by affecting the internal representation of the body midline. |
Larry Allen Abel; Zhong I Wang; Louis F Dell'Osso Wavelet analysis in infantile nystagmus syndrome: Limitations and abilities Journal Article Investigative Ophthalmology & Visual Science, 49 (8), pp. 3413–3423, 2008. @article{Abel2008, title = {Wavelet analysis in infantile nystagmus syndrome: Limitations and abilities}, author = {Larry Allen Abel and Zhong I Wang and Louis F Dell'Osso}, doi = {10.1167/iovs.08-1710}, year = {2008}, date = {2008-01-01}, journal = {Investigative Ophthalmology & Visual Science}, volume = {49}, number = {8}, pages = {3413--3423}, abstract = {PURPOSE: To investigate the proper usage of wavelet analysis in infantile nystagmus syndrome (INS) and determine its limitations and abilities. METHODS: Data were analyzed from accurate eye-movement recordings of INS patients. Wavelet analysis was performed to examine the foveation characteristics, morphologic characteristics and time variation in different INS waveforms. Also compared were the wavelet analysis and the expanded nystagmus acuity function (NAFX) analysis on sections of pre- and post-tenotomy data. RESULTS: Wavelet spectra showed some sensitivity to different features of INS waveforms and reflected their variations across time. However, wavelet analysis was not effective in detecting foveation periods, especially in a complicated INS waveform. NAFX, on the other hand, was a much more direct way of evaluating waveform changes after nystagmus treatments. CONCLUSIONS: Wavelet analysis is a tool that performs, with difficulty, some things that can be done faster and better by directly operating on the nystagmus waveform itself. It appears, however, to be insensitive to the subtle but visually important improvements brought about by INS therapies. Wavelet analysis may have a role in developing automated waveform classifiers where its time-dependent characterization of the waveform can be used. The limitations of wavelet analysis outweighed its abilities in INS waveform-characteristic examination.}, keywords = {}, pubstate = {published}, tppubtype = {article} } PURPOSE: To investigate the proper usage of wavelet analysis in infantile nystagmus syndrome (INS) and determine its limitations and abilities. METHODS: Data were analyzed from accurate eye-movement recordings of INS patients. Wavelet analysis was performed to examine the foveation characteristics, morphologic characteristics and time variation in different INS waveforms. Also compared were the wavelet analysis and the expanded nystagmus acuity function (NAFX) analysis on sections of pre- and post-tenotomy data. RESULTS: Wavelet spectra showed some sensitivity to different features of INS waveforms and reflected their variations across time. However, wavelet analysis was not effective in detecting foveation periods, especially in a complicated INS waveform. NAFX, on the other hand, was a much more direct way of evaluating waveform changes after nystagmus treatments. CONCLUSIONS: Wavelet analysis is a tool that performs, with difficulty, some things that can be done faster and better by directly operating on the nystagmus waveform itself. It appears, however, to be insensitive to the subtle but visually important improvements brought about by INS therapies. Wavelet analysis may have a role in developing automated waveform classifiers where its time-dependent characterization of the waveform can be used. The limitations of wavelet analysis outweighed its abilities in INS waveform-characteristic examination. |
Dekel Abeles; Shlomit Yuval-Greenberg Just look away: Gaze aversions as an overt attentional disengagement mechanism Journal Article Cognition, 168 , pp. 99–109, 2017. @article{Abeles2017, title = {Just look away: Gaze aversions as an overt attentional disengagement mechanism}, author = {Dekel Abeles and Shlomit Yuval-Greenberg}, doi = {10.1016/j.cognition.2017.06.021}, year = {2017}, date = {2017-01-01}, journal = {Cognition}, volume = {168}, pages = {99--109}, publisher = {Elsevier B.V.}, abstract = {During visual exploration of a scene, the eye-gaze tends to be directed toward more salient image-locations, containing more information. However, while performing non-visual tasks, such information-seeking behavior could be detrimental to performance, as the perception of irrelevant but salient visual input may unnecessarily increase the cognitive-load. It would be therefore beneficial if during non-visual tasks, eye-gaze would be governed by a drive to reduce saliency rather than maximize it. The current study examined the phenomenon of gaze-aversion during non-visual tasks, which is hypothesized to act as an active avoidance mechanism. In two experiments, gaze-position was monitored by an eye-tracker while participants performed an auditory mental arithmetic task, and in a third experiment they performed an undemanding naming task. Task-irrelevant simple motion stimuli (drifting grating and random dot kinematogram) were centrally presented, moving at varying speeds. Participants averted their gaze away from the moving stimuli more frequently and for longer proportions of the time when the motion was faster than when it was slower. Additionally, a positive correlation was found between the task's difficulty and this aversion behavior. When the task was highly undemanding, no gaze aversion behavior was observed. We conclude that gaze aversion is an active avoidance strategy, sensitive to both the physical features of the visual distractions and the cognitive load imposed by the non-visual task.}, keywords = {}, pubstate = {published}, tppubtype = {article} } During visual exploration of a scene, the eye-gaze tends to be directed toward more salient image-locations, containing more information. However, while performing non-visual tasks, such information-seeking behavior could be detrimental to performance, as the perception of irrelevant but salient visual input may unnecessarily increase the cognitive-load. It would be therefore beneficial if during non-visual tasks, eye-gaze would be governed by a drive to reduce saliency rather than maximize it. The current study examined the phenomenon of gaze-aversion during non-visual tasks, which is hypothesized to act as an active avoidance mechanism. In two experiments, gaze-position was monitored by an eye-tracker while participants performed an auditory mental arithmetic task, and in a third experiment they performed an undemanding naming task. Task-irrelevant simple motion stimuli (drifting grating and random dot kinematogram) were centrally presented, moving at varying speeds. Participants averted their gaze away from the moving stimuli more frequently and for longer proportions of the time when the motion was faster than when it was slower. Additionally, a positive correlation was found between the task's difficulty and this aversion behavior. When the task was highly undemanding, no gaze aversion behavior was observed. We conclude that gaze aversion is an active avoidance strategy, sensitive to both the physical features of the visual distractions and the cognitive load imposed by the non-visual task. |
Dekel Abeles; Roy Amit; Shlomit Yuval-Greenberg Oculomotor behavior during non-visual tasks: The role of visual saliency Journal Article PLoS ONE, 13 (6), pp. e0198242, 2018. @article{Abeles2018, title = {Oculomotor behavior during non-visual tasks: The role of visual saliency}, author = {Dekel Abeles and Roy Amit and Shlomit Yuval-Greenberg}, doi = {10.1371/journal.pone.0198242}, year = {2018}, date = {2018-01-01}, journal = {PLoS ONE}, volume = {13}, number = {6}, pages = {e0198242}, abstract = {During visual exploration or free-view, gaze positioning is largely determined by the tendency to maximize visual saliency: more salient locations are more likely to be fixated. However, when visual input is completely irrelevant for performance, such as with non-visual tasks, this saliency maximization strategy may be less advantageous and potentially even disruptive for task-performance. Here, we examined whether visual saliency remains a strong driving force in determining gaze positions even in non-visual tasks. We tested three alternative hypotheses: a) That saliency is disadvantageous for non-visual tasks and therefore gaze would tend to shift away from it and towards non-salient locations; b) That saliency is irrelevant during non-visual tasks and therefore gaze would not be directed towards it but also not away-from it; c) That saliency maximization is a strong behavioral drive that would prevail even during non-visual tasks.}, keywords = {}, pubstate = {published}, tppubtype = {article} } During visual exploration or free-view, gaze positioning is largely determined by the tendency to maximize visual saliency: more salient locations are more likely to be fixated. However, when visual input is completely irrelevant for performance, such as with non-visual tasks, this saliency maximization strategy may be less advantageous and potentially even disruptive for task-performance. Here, we examined whether visual saliency remains a strong driving force in determining gaze positions even in non-visual tasks. We tested three alternative hypotheses: a) That saliency is disadvantageous for non-visual tasks and therefore gaze would tend to shift away from it and towards non-salient locations; b) That saliency is irrelevant during non-visual tasks and therefore gaze would not be directed towards it but also not away-from it; c) That saliency maximization is a strong behavioral drive that would prevail even during non-visual tasks. |
Dekel Abeles; Roy Amit; Noam Tal-Perry; Marisa Carrasco; Shlomit Yuval-Greenberg Oculomotor inhibition precedes temporally expected auditory targets Journal Article Nature Communications, 11 , pp. 1–12, 2020. @article{Abeles2020, title = {Oculomotor inhibition precedes temporally expected auditory targets}, author = {Dekel Abeles and Roy Amit and Noam Tal-Perry and Marisa Carrasco and Shlomit Yuval-Greenberg}, doi = {10.1038/s41467-020-17158-9}, year = {2020}, date = {2020-01-01}, journal = {Nature Communications}, volume = {11}, pages = {1--12}, publisher = {Springer US}, abstract = {Eye movements are inhibited prior to the onset of temporally-predictable visual targets. This oculomotor inhibition effect could be considered a marker for the formation of temporal expectations and the allocation of temporal attention in the visual domain. Here we show that eye movements are also inhibited before predictable auditory targets. In two experiments, we manipulate the period between a cue and an auditory target to be either predictable or unpredictable. The findings show that although there is no perceptual gain from avoiding gaze-shifts in this procedure, saccades and blinks are inhibited prior to predictable relative to unpredictable auditory targets. These findings show that oculomotor inhibition occurs prior to auditory targets. This link between auditory expectation and oculomotor behavior reveals a multimodal perception action coupling, which has a central role in temporal expectations.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Eye movements are inhibited prior to the onset of temporally-predictable visual targets. This oculomotor inhibition effect could be considered a marker for the formation of temporal expectations and the allocation of temporal attention in the visual domain. Here we show that eye movements are also inhibited before predictable auditory targets. In two experiments, we manipulate the period between a cue and an auditory target to be either predictable or unpredictable. The findings show that although there is no perceptual gain from avoiding gaze-shifts in this procedure, saccades and blinks are inhibited prior to predictable relative to unpredictable auditory targets. These findings show that oculomotor inhibition occurs prior to auditory targets. This link between auditory expectation and oculomotor behavior reveals a multimodal perception action coupling, which has a central role in temporal expectations. |
Rany Abend; Mira A Bajaj; Chika Matsumoto; Marissa Yetter; Anita Harrewijn; Elise M Cardinale; Katharina Kircanski; Eli R Lebowitz; Wendy K Silverman; Yair Bar-Haim; Amit Lazarov; Ellen Leibenluft; Melissa Brotman; Daniel S Pine Converging multi-modal evidence for implicit threat-related bias in pediatric anxiety disorders Journal Article Journal of Abnormal Child Psychology, pp. 1–14, 2020. @article{Abend2020, title = {Converging multi-modal evidence for implicit threat-related bias in pediatric anxiety disorders}, author = {Rany Abend and Mira A Bajaj and Chika Matsumoto and Marissa Yetter and Anita Harrewijn and Elise M Cardinale and Katharina Kircanski and Eli R Lebowitz and Wendy K Silverman and Yair Bar-Haim and Amit Lazarov and Ellen Leibenluft and Melissa Brotman and Daniel S Pine}, doi = {10.1007/s10802-020-00712-w}, year = {2020}, date = {2020-01-01}, journal = {Journal of Abnormal Child Psychology}, pages = {1--14}, publisher = {Springer US}, abstract = {This report examines the relationship between pediatric anxiety disorders and implicit bias evoked by threats. To do so, the report uses two tasks that assess implicit bias to negative-valence faces, the first by eye-gaze and the second by measuring body-movement parameters. The report contrasts task performance in 51 treatment-seeking, medication-free pediatric patients with anxiety disorders and 36 healthy peers. Among these youth, 53 completed an eye-gaze task, 74 completed a body-movement task, and 40 completed both tasks. On the eye-gaze task, patients displayed longer gaze duration on negative relative to non-negative valence faces than healthy peers, F(1, 174) = 8.27}, keywords = {}, pubstate = {published}, tppubtype = {article} } This report examines the relationship between pediatric anxiety disorders and implicit bias evoked by threats. To do so, the report uses two tasks that assess implicit bias to negative-valence faces, the first by eye-gaze and the second by measuring body-movement parameters. The report contrasts task performance in 51 treatment-seeking, medication-free pediatric patients with anxiety disorders and 36 healthy peers. Among these youth, 53 completed an eye-gaze task, 74 completed a body-movement task, and 40 completed both tasks. On the eye-gaze task, patients displayed longer gaze duration on negative relative to non-negative valence faces than healthy peers, F(1, 174) = 8.27 |
Irene Ablinger; Walter Huber; Kerstin I Schattka; Ralph Radach Recovery in a letter-by-letter reader: More efficiency at the expense of normal reading strategy Journal Article Neurocase, 19 (3), pp. 236–255, 2013. @article{Ablinger2013, title = {Recovery in a letter-by-letter reader: More efficiency at the expense of normal reading strategy}, author = {Irene Ablinger and Walter Huber and Kerstin I Schattka and Ralph Radach}, doi = {10.1080/13554794.2012.667119}, year = {2013}, date = {2013-01-01}, journal = {Neurocase}, volume = {19}, number = {3}, pages = {236--255}, abstract = {Although changes in reading performance of recovering letter-by-letter readers have been described in some detail, no prior research has provided an in-depth analysis of the underlying adaptive word processing strategies. Our work examined the reading performance of a letter-by-letter reader, FH, over a period of 15 months, using eye movement methodology to delineate the recovery process at two different time points (T1, T2). A central question is whether recovery is characterized either by moving back towards normal word processing or by refinement and possibly automatization of an existing pathological strategy that was developed in response to the impairment. More specifically, we hypothesized that letter-by-letter reading may be executed with at least four different strategies and our work sought to distinguish between these alternatives. During recovery significant improvements in reading performance were achieved. A shift of fixation positions from the far left to the extreme right of target words was combined with many small and very few longer regressive saccades. Apparently, ‘letter-by-letter reading' took the form of local clustering, most likely corresponding to the formation ofsublexical units ofanalysis. This pattern was more pronounced at T2, suggesting that improvements in reading efficiency may come at the expense of making it harder to eventually return to normal reading.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Although changes in reading performance of recovering letter-by-letter readers have been described in some detail, no prior research has provided an in-depth analysis of the underlying adaptive word processing strategies. Our work examined the reading performance of a letter-by-letter reader, FH, over a period of 15 months, using eye movement methodology to delineate the recovery process at two different time points (T1, T2). A central question is whether recovery is characterized either by moving back towards normal word processing or by refinement and possibly automatization of an existing pathological strategy that was developed in response to the impairment. More specifically, we hypothesized that letter-by-letter reading may be executed with at least four different strategies and our work sought to distinguish between these alternatives. During recovery significant improvements in reading performance were achieved. A shift of fixation positions from the far left to the extreme right of target words was combined with many small and very few longer regressive saccades. Apparently, ‘letter-by-letter reading' took the form of local clustering, most likely corresponding to the formation ofsublexical units ofanalysis. This pattern was more pronounced at T2, suggesting that improvements in reading efficiency may come at the expense of making it harder to eventually return to normal reading. |
Irene Ablinger; Walter Huber; Ralph Radach Eye movement analyses indicate the underlying reading strategy in the recovery of lexical readers Journal Article Aphasiology, 28 (6), pp. 640–657, 2014. @article{Ablinger2014, title = {Eye movement analyses indicate the underlying reading strategy in the recovery of lexical readers}, author = {Irene Ablinger and Walter Huber and Ralph Radach}, doi = {10.1080/02687038.2014.894960}, year = {2014}, date = {2014-01-01}, journal = {Aphasiology}, volume = {28}, number = {6}, pages = {640--657}, abstract = {Background: Psycholinguistic error analysis of dyslexic responses in various reading tasks provides the primary basis for clinically discriminating subtypes of pathological reading. Within this framework, phonology-related errors are indicative of a sequential word processing strategy, whereas lexical and semantic errors are associated with a lexical reading strategy. Despite the large number of published intervention studies, relatively little is known about changes in error distributions during recovery in dyslexic patients.Aims: The main purpose of the present work was to extend the scope of research on the time course of recovery in readers with acquired dyslexia, using eye tracking methodology to examine word processing in real time. The guiding hypothesis was that in lexical readers a reduction of lexical errors and an emerging predominant production of phonological errors should be associated with a change to a more segmental moment-to-moment reading behaviour.Methods & Procedures: Five patients participated in an eye movement supported reading intervention, where both lexical and segmental reading was facilitated. Reading performance was assessed before (T1) and after (T2) therapy intervention via recording of eye movements. Analyses included a novel way to examine the spatiotemporal dynamics of processing using distributions of fixation positions as different time intervals. These subdistributions reveal the gradual shifting of fixation positions during word processing, providing an adequate metric for objective classification of online reading strategies.Outcome & Results: Therapy intervention led to improved reading accuracy in all subjects. In three of five participants, analyses revealed a restructuring in the underlying reading mechanisms from predominantly lexical to more segmental word processing. In contrast, two subjects maintained their lexical reading procedures. Importantly, the fundamental assumption that a high number of phonologically based reading errors must be associated with segmental word processing routines, while the production of lexical errors is indicative of a holistic reading strategy could not be verified.Conclusions: Our results indicate that despite general improvements in reading performance, only some patients reorganised their word identification process. Contradictive data raise doubts on the validity of psycholinguistic error analysis as an exclusive indicator of changes in reading strategy. We suggest this traditional approach to combine with innovative eye tracking methodology in the interest of more comprehensive diagnostic strategies.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Background: Psycholinguistic error analysis of dyslexic responses in various reading tasks provides the primary basis for clinically discriminating subtypes of pathological reading. Within this framework, phonology-related errors are indicative of a sequential word processing strategy, whereas lexical and semantic errors are associated with a lexical reading strategy. Despite the large number of published intervention studies, relatively little is known about changes in error distributions during recovery in dyslexic patients.Aims: The main purpose of the present work was to extend the scope of research on the time course of recovery in readers with acquired dyslexia, using eye tracking methodology to examine word processing in real time. The guiding hypothesis was that in lexical readers a reduction of lexical errors and an emerging predominant production of phonological errors should be associated with a change to a more segmental moment-to-moment reading behaviour.Methods & Procedures: Five patients participated in an eye movement supported reading intervention, where both lexical and segmental reading was facilitated. Reading performance was assessed before (T1) and after (T2) therapy intervention via recording of eye movements. Analyses included a novel way to examine the spatiotemporal dynamics of processing using distributions of fixation positions as different time intervals. These subdistributions reveal the gradual shifting of fixation positions during word processing, providing an adequate metric for objective classification of online reading strategies.Outcome & Results: Therapy intervention led to improved reading accuracy in all subjects. In three of five participants, analyses revealed a restructuring in the underlying reading mechanisms from predominantly lexical to more segmental word processing. In contrast, two subjects maintained their lexical reading procedures. Importantly, the fundamental assumption that a high number of phonologically based reading errors must be associated with segmental word processing routines, while the production of lexical errors is indicative of a holistic reading strategy could not be verified.Conclusions: Our results indicate that despite general improvements in reading performance, only some patients reorganised their word identification process. Contradictive data raise doubts on the validity of psycholinguistic error analysis as an exclusive indicator of changes in reading strategy. We suggest this traditional approach to combine with innovative eye tracking methodology in the interest of more comprehensive diagnostic strategies. |
Irene Ablinger; Kerstin von Heyden; Christian Vorstius; Katja Halm; Walter Huber; Ralph Radach An eye movement based reading intervention in lexical and segmental readers with acquired dyslexia Journal Article Neuropsychological Rehabilitation, 24 (6), pp. 833–867, 2014. @article{Ablinger2014a, title = {An eye movement based reading intervention in lexical and segmental readers with acquired dyslexia}, author = {Irene Ablinger and Kerstin von Heyden and Christian Vorstius and Katja Halm and Walter Huber and Ralph Radach}, doi = {10.1080/09602011.2014.913530}, year = {2014}, date = {2014-01-01}, journal = {Neuropsychological Rehabilitation}, volume = {24}, number = {6}, pages = {833--867}, abstract = {Due to their brain damage, aphasic patients with acquired dyslexia often rely to a greater extent on lexical or segmental reading procedures. Thus, therapy intervention is mostly targeted on the more impaired reading strategy. In the present work we introduce a novel therapy approach based on real-time measurement of patients' eye movements as they attempt to read words. More specifically, an eye movement contingent technique of stepwise letter de-masking was used to support sequential reading, whereas fixation-dependent initial masking of non-central letters stimulated a lexical (parallel) reading strategy. Four lexical and four segmental readers with acquired central dyslexia received our intensive reading intervention. All participants showed remarkable improvements as evident in reduced total reading time, a reduced number of fixations per word and improved reading accuracy. Both types of intervention led to item-specific training effects in all subjects. A generalisation to untrained items was only found in segmental readers after the lexical training. Eye movement analyses were also used to compare word processing before and after therapy, indicating that all patients, with one exclusion, maintained their preferred reading strategy. However, in several cases the balance between sequential and lexical processing became less extreme, indicating a more effective individual interplay of both word processing routes.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Due to their brain damage, aphasic patients with acquired dyslexia often rely to a greater extent on lexical or segmental reading procedures. Thus, therapy intervention is mostly targeted on the more impaired reading strategy. In the present work we introduce a novel therapy approach based on real-time measurement of patients' eye movements as they attempt to read words. More specifically, an eye movement contingent technique of stepwise letter de-masking was used to support sequential reading, whereas fixation-dependent initial masking of non-central letters stimulated a lexical (parallel) reading strategy. Four lexical and four segmental readers with acquired central dyslexia received our intensive reading intervention. All participants showed remarkable improvements as evident in reduced total reading time, a reduced number of fixations per word and improved reading accuracy. Both types of intervention led to item-specific training effects in all subjects. A generalisation to untrained items was only found in segmental readers after the lexical training. Eye movement analyses were also used to compare word processing before and after therapy, indicating that all patients, with one exclusion, maintained their preferred reading strategy. However, in several cases the balance between sequential and lexical processing became less extreme, indicating a more effective individual interplay of both word processing routes. |
Irene Ablinger; Ralph Radach Diverging receptive and expressive word processing mechanisms in a deep dyslexic reader Journal Article Neuropsychologia, 81 , pp. 12–21, 2016. @article{Ablinger2016, title = {Diverging receptive and expressive word processing mechanisms in a deep dyslexic reader}, author = {Irene Ablinger and Ralph Radach}, doi = {10.1016/j.neuropsychologia.2015.11.023}, year = {2016}, date = {2016-01-01}, journal = {Neuropsychologia}, volume = {81}, pages = {12--21}, publisher = {Elsevier}, abstract = {We report on KJ, a patient with acquired dyslexia due to cerebral artery infarction. He represents an unusually clear case of an "output" deep dyslexic reader, with a distinct pattern of pure semantic reading. According to current neuropsychological models of reading, the severity of this condition is directly related to the degree of impairment in semantic and phonological representations and the resulting imbalance in the interaction between the two word processing pathways. The present work sought to examine whether an innovative eye movement supported intervention combining lexical and segmental therapy would strengthen phonological processing and lead to an attenuation of the extreme semantic over-involvement in KJ's word identification process. Reading performance was assessed before (T1) between (T2) and after (T3) therapy using both analyses of linguistic errors and word viewing patterns. Therapy resulted in improved reading aloud accuracy along with a change in error distribution that suggested a return to more sequential reading. Interestingly, this was in contrast to the dynamics of moment-to-moment word processing, as eye movement analyses still suggested a predominantly holistic strategy, even at T3. So, in addition to documenting the success of the therapeutic intervention, our results call for a theoretically important conclusion: Real-time letter and word recognition routines should be considered separately from properties of the verbal output. Combining both perspectives may provide a promising strategy for future assessment and therapy evaluation.}, keywords = {}, pubstate = {published}, tppubtype = {article} } We report on KJ, a patient with acquired dyslexia due to cerebral artery infarction. He represents an unusually clear case of an "output" deep dyslexic reader, with a distinct pattern of pure semantic reading. According to current neuropsychological models of reading, the severity of this condition is directly related to the degree of impairment in semantic and phonological representations and the resulting imbalance in the interaction between the two word processing pathways. The present work sought to examine whether an innovative eye movement supported intervention combining lexical and segmental therapy would strengthen phonological processing and lead to an attenuation of the extreme semantic over-involvement in KJ's word identification process. Reading performance was assessed before (T1) between (T2) and after (T3) therapy using both analyses of linguistic errors and word viewing patterns. Therapy resulted in improved reading aloud accuracy along with a change in error distribution that suggested a return to more sequential reading. Interestingly, this was in contrast to the dynamics of moment-to-moment word processing, as eye movement analyses still suggested a predominantly holistic strategy, even at T3. So, in addition to documenting the success of the therapeutic intervention, our results call for a theoretically important conclusion: Real-time letter and word recognition routines should be considered separately from properties of the verbal output. Combining both perspectives may provide a promising strategy for future assessment and therapy evaluation. |
Irene Ablinger; Anne Friede; Ralph Radach A combined lexical and segmental therapy approach in a participant with pure alexia Journal Article Aphasiology, 33 (5), pp. 579–605, 2019. @article{Ablinger2019, title = {A combined lexical and segmental therapy approach in a participant with pure alexia}, author = {Irene Ablinger and Anne Friede and Ralph Radach}, doi = {10.1080/02687038.2018.1485073}, year = {2019}, date = {2019-01-01}, journal = {Aphasiology}, volume = {33}, number = {5}, pages = {579--605}, publisher = {Routledge}, abstract = {Background: Pure alexia is characterized by effortful left-to-right word processing, leading to a pathological length effect during reading aloud. Results of previous therapy outcome research suggest that patients with pure alexia tend to develop and maintain an adaptive sequential reading strategy in an effort to cope with their severe deficit and at least master a slow and laborious reading mode. Aim: We applied a theory-based, strategy-driven and eye-movement-supported therapy approach on HC, a participant with pure alexia. Our intention was to help optimizing his very persistent sequential reading strategy, while concurrently facilitating fast parallel word processing. Methods & Procedures: Therapy included a systematic combination of segmental and holistic reading as well as text reading components. Exposure duration and font size were gradually reduced. Following a single case experimental reading design with follow-up testing, we assessed reading performance at four testing points focusing on analyses of linguistic errors and word viewing patterns. Outcomes & Results: With respect to reading accuracy and oculomotor measures, the combined therapy approach resulted in sustained training effects evident in significant improvements for trained and untrained word materials. Text reading intervention only led to therapy specific improvements. Spatio-temporal analyses of eye fixation positions revealed a more and more efficient adaptive strategy to compensate for reading difficulties. However, spatial changes in fixation position were less pronounced at T4, suggesting some diminishing of success at follow-up. Conclusions: Our results underscore the need for a continuous systematic training of underlying reading strategies in pure alexia to develop and sustain more economic reading procedures.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Background: Pure alexia is characterized by effortful left-to-right word processing, leading to a pathological length effect during reading aloud. Results of previous therapy outcome research suggest that patients with pure alexia tend to develop and maintain an adaptive sequential reading strategy in an effort to cope with their severe deficit and at least master a slow and laborious reading mode. Aim: We applied a theory-based, strategy-driven and eye-movement-supported therapy approach on HC, a participant with pure alexia. Our intention was to help optimizing his very persistent sequential reading strategy, while concurrently facilitating fast parallel word processing. Methods & Procedures: Therapy included a systematic combination of segmental and holistic reading as well as text reading components. Exposure duration and font size were gradually reduced. Following a single case experimental reading design with follow-up testing, we assessed reading performance at four testing points focusing on analyses of linguistic errors and word viewing patterns. Outcomes & Results: With respect to reading accuracy and oculomotor measures, the combined therapy approach resulted in sustained training effects evident in significant improvements for trained and untrained word materials. Text reading intervention only led to therapy specific improvements. Spatio-temporal analyses of eye fixation positions revealed a more and more efficient adaptive strategy to compensate for reading difficulties. However, spatial changes in fixation position were less pronounced at T4, suggesting some diminishing of success at follow-up. Conclusions: Our results underscore the need for a continuous systematic training of underlying reading strategies in pure alexia to develop and sustain more economic reading procedures. |
Elger L Abrahamse; Wout Duthoo; Wim Notebaert; Evan F Risko Attention modulation by proportion congruency: The asymmetrical list shifting effect Journal Article Journal of Experimental Psychology: Learning, Memory, and Cognition, 39 (5), pp. 1552–1562, 2013. @article{Abrahamse2013, title = {Attention modulation by proportion congruency: The asymmetrical list shifting effect}, author = {Elger L Abrahamse and Wout Duthoo and Wim Notebaert and Evan F Risko}, year = {2013}, date = {2013-01-01}, journal = {Journal of Experimental Psychology: Learning, Memory, and Cognition}, volume = {39}, number = {5}, pages = {1552--1562}, abstract = {Proportion congruency effects represent hallmark phenomena in current theorizing about cognitive control. This is based on the notion that proportion congruency determines the relative levels of attention to relevant and irrelevant information in conflict tasks. However, little empirical evidence exists that uniquely supports such an attention modulation account; moreover, a rivaling account was recently proposed that attributes the effect of proportion congruency to mere contingency leaming. In the present study, the influences of shifts in list-wide (Experiment 1) or item-specific (Experiment 2) proportion congruency were investigated. As predicted by attention modulation but not by contingency leaming, strong asymmetries were observed in such shifting: An increase in the proportion of congruent trials had only limited impact on the size of the congruency effect when participants were initially trained with a mostly incongruent list, but the impact was substantial for an equivalent increase of incongruent trials when participants were initially trained with a mostly congruent list. This asymmetrical list shifting effect directly supports attention modulation by proportion congruency manipulations and as such provides a novel tool for exploring cognitive control. Implications of our findings for existing theories of cognitive control are discussed.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Proportion congruency effects represent hallmark phenomena in current theorizing about cognitive control. This is based on the notion that proportion congruency determines the relative levels of attention to relevant and irrelevant information in conflict tasks. However, little empirical evidence exists that uniquely supports such an attention modulation account; moreover, a rivaling account was recently proposed that attributes the effect of proportion congruency to mere contingency leaming. In the present study, the influences of shifts in list-wide (Experiment 1) or item-specific (Experiment 2) proportion congruency were investigated. As predicted by attention modulation but not by contingency leaming, strong asymmetries were observed in such shifting: An increase in the proportion of congruent trials had only limited impact on the size of the congruency effect when participants were initially trained with a mostly incongruent list, but the impact was substantial for an equivalent increase of incongruent trials when participants were initially trained with a mostly congruent list. This asymmetrical list shifting effect directly supports attention modulation by proportion congruency manipulations and as such provides a novel tool for exploring cognitive control. Implications of our findings for existing theories of cognitive control are discussed. |
Arman Abrahamyan; Laura Luz Silva; Steven C Dakin; Matteo Carandini; Justin L Gardner Adaptable history biases in human perceptual decisions Journal Article Proceedings of the National Academy of Sciences, 113 (25), pp. E3548–E3557, 2016. @article{Abrahamyan2016, title = {Adaptable history biases in human perceptual decisions}, author = {Arman Abrahamyan and Laura Luz Silva and Steven C Dakin and Matteo Carandini and Justin L Gardner}, doi = {10.1073/pnas.1518786113}, year = {2016}, date = {2016-01-01}, journal = {Proceedings of the National Academy of Sciences}, volume = {113}, number = {25}, pages = {E3548--E3557}, abstract = {When making choices under conditions of perceptual uncertainty, past experience can play a vital role. However, it can also lead to biases that worsen decisions. Consistent with previous observations, we found that human choices are influenced by the success or failure of past choices even in a standard two-alternative detection task, where choice history is irrelevant. The typical bias was one that made the subject switch choices after a failure. These choice history biases led to poorer performance and were similar for observers in different countries. They were well captured by a simple logistic regression model that had been previously applied to describe psychophysical performance in mice. Such irrational biases seem at odds with the principles of reinforcement learning, which would predict exquisite adaptability to choice history. We therefore asked whether subjects could adapt their irrational biases following changes in trial order statistics. Adaptability was strong in the direction that confirmed a subject's default biases, but weaker in the opposite direction, so that existing biases could not be eradicated. We conclude that humans can adapt choice history biases, but cannot easily overcome existing biases even if irrational in the current context: adaptation is more sensitive to confirmatory than contradictory statistics.}, keywords = {}, pubstate = {published}, tppubtype = {article} } When making choices under conditions of perceptual uncertainty, past experience can play a vital role. However, it can also lead to biases that worsen decisions. Consistent with previous observations, we found that human choices are influenced by the success or failure of past choices even in a standard two-alternative detection task, where choice history is irrelevant. The typical bias was one that made the subject switch choices after a failure. These choice history biases led to poorer performance and were similar for observers in different countries. They were well captured by a simple logistic regression model that had been previously applied to describe psychophysical performance in mice. Such irrational biases seem at odds with the principles of reinforcement learning, which would predict exquisite adaptability to choice history. We therefore asked whether subjects could adapt their irrational biases following changes in trial order statistics. Adaptability was strong in the direction that confirmed a subject's default biases, but weaker in the opposite direction, so that existing biases could not be eradicated. We conclude that humans can adapt choice history biases, but cannot easily overcome existing biases even if irrational in the current context: adaptation is more sensitive to confirmatory than contradictory statistics. |
Joana Acha; Manuel Perea The effect of neighborhood frequency in reading: Evidence with transposed-letter neighbors Journal Article Cognition, 108 , pp. 290–300, 2008. @article{Acha2008, title = {The effect of neighborhood frequency in reading: Evidence with transposed-letter neighbors}, author = {Joana Acha and Manuel Perea}, year = {2008}, date = {2008-01-01}, journal = {Cognition}, volume = {108}, pages = {290--300}, abstract = {Transposed-letter effects (e.g., jugde activates judge) pose serious models for models of visual-word recognition that use position-specific coding schemes. However, even though the evidence of transposed-letter effects with nonword stimuli is strong, the evidence for word stimuli is scarce and inconclusive. The present experiment examined the effect of neighborhood frequency during normal silent reading using transposed-letter neighbors (e.g., silver, sliver). Two sets of low-frequency words were created (equated in the number of substitution neighbors, word frequency, and number of letters), which were embedded in sentences. In one set, the target word had a higher frequency transposed-letter neighbor, and in the other set, the target word had no transposed-letter neighbors. An inhibitory effect of neighborhood frequency was observed in measures that reflect late processing in words (number of regressions back to the target word, and total time). We examine the implications of these findings for models of visual-word recognition and reading.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Transposed-letter effects (e.g., jugde activates judge) pose serious models for models of visual-word recognition that use position-specific coding schemes. However, even though the evidence of transposed-letter effects with nonword stimuli is strong, the evidence for word stimuli is scarce and inconclusive. The present experiment examined the effect of neighborhood frequency during normal silent reading using transposed-letter neighbors (e.g., silver, sliver). Two sets of low-frequency words were created (equated in the number of substitution neighbors, word frequency, and number of letters), which were embedded in sentences. In one set, the target word had a higher frequency transposed-letter neighbor, and in the other set, the target word had no transposed-letter neighbors. An inhibitory effect of neighborhood frequency was observed in measures that reflect late processing in words (number of regressions back to the target word, and total time). We examine the implications of these findings for models of visual-word recognition and reading. |
Alper Açik; Selim Onat; Frank Schumann; Wolfgang Einhäuser; Peter König Effects of luminance contrast and its modifications on fixation behavior during free viewing of images from different categories Journal Article Vision Research, 49 (12), pp. 1541–1553, 2009. @article{Acik2009, title = {Effects of luminance contrast and its modifications on fixation behavior during free viewing of images from different categories}, author = {Alper A{ç}ik and Selim Onat and Frank Schumann and Wolfgang Einhäuser and Peter König}, doi = {10.1016/j.visres.2009.03.011}, year = {2009}, date = {2009-01-01}, journal = {Vision Research}, volume = {49}, number = {12}, pages = {1541--1553}, publisher = {Elsevier Ltd}, abstract = {During viewing of natural scenes, do low-level features guide attention, and if so, does this depend on higher-level features? To answer these questions, we studied the image category dependence of low-level feature modification effects. Subjects fixated contrast-modified regions often in natural scene images, while smaller but significant effects were observed for urban scenes and faces. Surprisingly, modifications in fractal images did not influence fixations. Further analysis revealed an inverse relationship between modification effects and higher-level, phase-dependent image features. We suggest that high- and mid-level features - such as edges, symmetries, and recursive patterns - guide attention if present. However, if the scene lacks such diagnostic properties, low-level features prevail. We posit a hierarchical framework, which combines aspects of bottom-up and top-down theories and is compatible with our data.}, keywords = {}, pubstate = {published}, tppubtype = {article} } During viewing of natural scenes, do low-level features guide attention, and if so, does this depend on higher-level features? To answer these questions, we studied the image category dependence of low-level feature modification effects. Subjects fixated contrast-modified regions often in natural scene images, while smaller but significant effects were observed for urban scenes and faces. Surprisingly, modifications in fractal images did not influence fixations. Further analysis revealed an inverse relationship between modification effects and higher-level, phase-dependent image features. We suggest that high- and mid-level features - such as edges, symmetries, and recursive patterns - guide attention if present. However, if the scene lacks such diagnostic properties, low-level features prevail. We posit a hierarchical framework, which combines aspects of bottom-up and top-down theories and is compatible with our data. |
Alper Açik; Adjmal Sarwary; Rafael Schultze-Kraft; Selim Onat; Peter König Developmental changes in natural viewing behavior: Bottom-up and top-down differences between children, young adults and older adults Journal Article Frontiers in Psychology, 1 , pp. 1–14, 2010. @article{Acik2010, title = {Developmental changes in natural viewing behavior: Bottom-up and top-down differences between children, young adults and older adults}, author = {Alper A{ç}ik and Adjmal Sarwary and Rafael Schultze-Kraft and Selim Onat and Peter König}, doi = {10.3389/fpsyg.2010.00207}, year = {2010}, date = {2010-01-01}, journal = {Frontiers in Psychology}, volume = {1}, pages = {1--14}, publisher = {10}, address = {doi}, abstract = {Despite the growing interest in fixation selection under natural conditions, there is a major gap in the literature concerning its developmental aspects. Early in life, bottom-up processes, such as local image feature - color, luminance contrast etc. - guided viewing, might be prominent but later overshadowed by more top-down processing. Moreover, with decline in visual functioning in old age, bottom-up processing is known to suffer. Here we recorded eye movements of 7- to 9-year-old children, 19- to 27-year-old adults, and older adults above 72 years of age while they viewed natural and complex images before performing a patch-recognition task. Task performance displayed the classical inverted U-shape, with young adults outperforming the other age groups. Fixation discrimination performance of local feature values dropped with age. Whereas children displayed the highest feature values at fixated points, suggesting a bottom-up mechanism, older adult viewing behavior was less feature-dependent, reminiscent of a top-down strategy. Importantly, we observed a double dissociation between children and elderly regarding the effects of active viewing on feature-related viewing: Explorativeness correlated with feature-related viewing negatively in young age, and positively in older adults. The results indicate that, with age, bottom-up fixation selection loses strength and/or the role of top-down processes becomes more important. Older adults who increase their feature-related viewing by being more explorative make use of this low-level information and perform better in the task. The present study thus reveals an important developmental change in natural and task-guided viewing.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Despite the growing interest in fixation selection under natural conditions, there is a major gap in the literature concerning its developmental aspects. Early in life, bottom-up processes, such as local image feature - color, luminance contrast etc. - guided viewing, might be prominent but later overshadowed by more top-down processing. Moreover, with decline in visual functioning in old age, bottom-up processing is known to suffer. Here we recorded eye movements of 7- to 9-year-old children, 19- to 27-year-old adults, and older adults above 72 years of age while they viewed natural and complex images before performing a patch-recognition task. Task performance displayed the classical inverted U-shape, with young adults outperforming the other age groups. Fixation discrimination performance of local feature values dropped with age. Whereas children displayed the highest feature values at fixated points, suggesting a bottom-up mechanism, older adult viewing behavior was less feature-dependent, reminiscent of a top-down strategy. Importantly, we observed a double dissociation between children and elderly regarding the effects of active viewing on feature-related viewing: Explorativeness correlated with feature-related viewing negatively in young age, and positively in older adults. The results indicate that, with age, bottom-up fixation selection loses strength and/or the role of top-down processes becomes more important. Older adults who increase their feature-related viewing by being more explorative make use of this low-level information and perform better in the task. The present study thus reveals an important developmental change in natural and task-guided viewing. |
Alper Acik; Andreas Bartel; Peter Konig Real and implied motion at the center of gaze Journal Article Journal of Vision, 14 (1), pp. 1–19, 2014. @article{Acik2014, title = {Real and implied motion at the center of gaze}, author = {Alper Acik and Andreas Bartel and Peter Konig}, doi = {10.1109/ICMTS.2016.7476201}, year = {2014}, date = {2014-01-01}, journal = {Journal of Vision}, volume = {14}, number = {1}, pages = {1--19}, abstract = {Even though the dynamicity of our environment is a given, much of what we know on fixation selection comes from studies of static scene viewing. We performed a direct comparison of fixation selection on static and dynamic visual stimuli and investigated how far identical mechanisms drive these. We recorded eye movements while participants viewed movie clips of natural scenery and static frames taken from the same movies. Both were presented in the same high spatial resolution (1080 textperiodcentered 1920 pixels). The static condition allowed us to check whether local movement features computed from movies are salient even when presented as single frames. We observed that during the first second of viewing, movement and static features are equally salient in both conditions. Furthermore, predictability of fixations based on movement features decreased faster when viewing static frames as compared with viewing movie clips. Yet even during the later portion of static-frame viewing, the predictive value of movement features was still high above chance. Moreover, we demonstrated that, whereas the sets of movement and static features were statistically dependent within these sets, respectively, no dependence was observed between the two sets. Based on these results, we argue that implied motion is predictive of fixation similarly to real movement and that the onset of motion in natural stimuli is more salient than ongoing movement is. The present results allow us to address to what extent and when static image viewing is similar to the perception of a dynamic environment.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Even though the dynamicity of our environment is a given, much of what we know on fixation selection comes from studies of static scene viewing. We performed a direct comparison of fixation selection on static and dynamic visual stimuli and investigated how far identical mechanisms drive these. We recorded eye movements while participants viewed movie clips of natural scenery and static frames taken from the same movies. Both were presented in the same high spatial resolution (1080 textperiodcentered 1920 pixels). The static condition allowed us to check whether local movement features computed from movies are salient even when presented as single frames. We observed that during the first second of viewing, movement and static features are equally salient in both conditions. Furthermore, predictability of fixations based on movement features decreased faster when viewing static frames as compared with viewing movie clips. Yet even during the later portion of static-frame viewing, the predictive value of movement features was still high above chance. Moreover, we demonstrated that, whereas the sets of movement and static features were statistically dependent within these sets, respectively, no dependence was observed between the two sets. Based on these results, we argue that implied motion is predictive of fixation similarly to real movement and that the onset of motion in natural stimuli is more salient than ongoing movement is. The present results allow us to address to what extent and when static image viewing is similar to the perception of a dynamic environment. |
Leah Acker; Erica N Pino; Edward S Boyden; Robert Desimone FEF inactivation with improved optogenetic methods Journal Article Proceedings of the National Academy of Sciences, 113 (46), pp. E7297–E7306, 2016. @article{Acker2016, title = {FEF inactivation with improved optogenetic methods}, author = {Leah Acker and Erica N Pino and Edward S Boyden and Robert Desimone}, doi = {10.1073/pnas.1610784113}, year = {2016}, date = {2016-01-01}, journal = {Proceedings of the National Academy of Sciences}, volume = {113}, number = {46}, pages = {E7297--E7306}, abstract = {Optogenetic methods have been highly effective for suppressing neural activity and modulating behavior in rodents, but effects have been much smaller in primates, which have much larger brains. Here, we present a suite of technologies to use optogenetics effectively in primates and apply these tools to a classic question in oculomotor control. First, we measured light absorption and heat propagation in vivo, optimized the conditions for using the red-light-shifted halorhodopsin Jaws in primates, and developed a large-volume illuminator to maximize light delivery with minimal heating and tissue displacement. Together, these advances allowed for nearly universal neuronal inactivation across more than 10 mm(3) of the cortex. Using these tools, we demonstrated large behavioral changes (i.e., up to several fold increases in error rate) with relatively low light power densities (≤100 mW/mm(2)) in the frontal eye field (FEF). Pharmacological inactivation studies have shown that the FEF is critical for executing saccades to remembered locations. FEF neurons increase their firing rate during the three epochs of the memory-guided saccade task: visual stimulus presentation, the delay interval, and motor preparation. It is unclear from earlier work, however, whether FEF activity during each epoch is necessary for memory-guided saccade execution. By harnessing the temporal specificity of optogenetics, we found that FEF contributes to memory-guided eye movements during every epoch of the memory-guided saccade task (the visual, delay, and motor periods).}, keywords = {}, pubstate = {published}, tppubtype = {article} } Optogenetic methods have been highly effective for suppressing neural activity and modulating behavior in rodents, but effects have been much smaller in primates, which have much larger brains. Here, we present a suite of technologies to use optogenetics effectively in primates and apply these tools to a classic question in oculomotor control. First, we measured light absorption and heat propagation in vivo, optimized the conditions for using the red-light-shifted halorhodopsin Jaws in primates, and developed a large-volume illuminator to maximize light delivery with minimal heating and tissue displacement. Together, these advances allowed for nearly universal neuronal inactivation across more than 10 mm(3) of the cortex. Using these tools, we demonstrated large behavioral changes (i.e., up to several fold increases in error rate) with relatively low light power densities (≤100 mW/mm(2)) in the frontal eye field (FEF). Pharmacological inactivation studies have shown that the FEF is critical for executing saccades to remembered locations. FEF neurons increase their firing rate during the three epochs of the memory-guided saccade task: visual stimulus presentation, the delay interval, and motor preparation. It is unclear from earlier work, however, whether FEF activity during each epoch is necessary for memory-guided saccade execution. By harnessing the temporal specificity of optogenetics, we found that FEF contributes to memory-guided eye movements during every epoch of the memory-guided saccade task (the visual, delay, and motor periods). |
John F Ackermann; Michael S Landy Choice of saccade endpoint under risk Journal Article Journal of Vision, 13 (3), pp. 1–20, 2013. @article{Ackermann2013, title = {Choice of saccade endpoint under risk}, author = {John F Ackermann and Michael S Landy}, doi = {10.1167/13.3.27}, year = {2013}, date = {2013-01-01}, journal = {Journal of Vision}, volume = {13}, number = {3}, pages = {1--20}, abstract = {Eye movements function to bring detailed information onto the high-resolution region of the retina. Previous research has shown that human observers select fixation points that maximize information acquisition and minimize target location uncertainty. In this study, we ask whether human observers choose the saccade endpoint that maximizes gain when there are explicit rewards associated with correctly detecting the target. Observers performed an 8-alternative forced-choice detection task for a contrast-defined target in noise. After a single saccade, observers indicated the target location. Each potential target location had an associated reward that was known to the observer. In some conditions, the reward at one location was higher than at the other locations. We compared human saccade endpoints to those of an ideal observer that maximizes expected gain given the respective human observer's visibility map, i.e., d' for target detection as a function of retinal location. Varying the location of the highest reward had a significant effect on human observers' distribution of saccade endpoints. Both human and ideal observers show a high density of saccades made toward the highest rewarded and actual target locations. But humans' overall spatial distributions of saccade endpoints differed significantly from the ideal observer as they made a greater number of saccade to locations far from the highest rewarded and actual target locations. Suboptimal choice of saccade endpoint, possibly in combination with suboptimal integration of information across saccades, had a significant effect on human observers' ability to correctly detect the target and maximize gain.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Eye movements function to bring detailed information onto the high-resolution region of the retina. Previous research has shown that human observers select fixation points that maximize information acquisition and minimize target location uncertainty. In this study, we ask whether human observers choose the saccade endpoint that maximizes gain when there are explicit rewards associated with correctly detecting the target. Observers performed an 8-alternative forced-choice detection task for a contrast-defined target in noise. After a single saccade, observers indicated the target location. Each potential target location had an associated reward that was known to the observer. In some conditions, the reward at one location was higher than at the other locations. We compared human saccade endpoints to those of an ideal observer that maximizes expected gain given the respective human observer's visibility map, i.e., d' for target detection as a function of retinal location. Varying the location of the highest reward had a significant effect on human observers' distribution of saccade endpoints. Both human and ideal observers show a high density of saccades made toward the highest rewarded and actual target locations. But humans' overall spatial distributions of saccade endpoints differed significantly from the ideal observer as they made a greater number of saccade to locations far from the highest rewarded and actual target locations. Suboptimal choice of saccade endpoint, possibly in combination with suboptimal integration of information across saccades, had a significant effect on human observers' ability to correctly detect the target and maximize gain. |
John F Ackermann; M S Landy Statistical templates for visual search Journal Article Journal of Vision, 14 (3), pp. 1–17, 2014. @article{Ackermann2014, title = {Statistical templates for visual search}, author = {John F Ackermann and M S Landy}, doi = {10.1167/14.3.18}, year = {2014}, date = {2014-01-01}, journal = {Journal of Vision}, volume = {14}, number = {3}, pages = {1--17}, abstract = {How do we find a target embedded in a scene? Within the framework of signal detection theory, this task is carried out by comparing each region of the scene with a "template," i.e., an internal representation of the search target. Here we ask what form this representation takes when the search target is a complex image with uncertain orientation. We examine three possible representations. The first is the matched filter. Such a representation cannot account for the ease with which humans can find a complex search target that is rotated relative to the template. A second representation attempts to deal with this by estimating the relative orientation of target and match and rotating the intensity-based template. No intensity-based template, however, can account for the ability to easily locate targets that are defined categorically and not in terms of a specific arrangement of pixels. Thus, we define a third template that represents the target in terms of image statistics rather than pixel intensities. Subjects performed a two-alternative, forced-choice search task in which they had to localize an image that matched a previously viewed target. Target images were texture patches. In one condition, match images were the same image as the target and distractors were a different image of the same textured material. In the second condition, the match image was of the same texture as the target (but different pixels) and the distractor was an image of a different texture. Match and distractor stimuli were randomly rotated relative to the target. We compared human performance to pixel-based, pixel-based with rotation, and statistic-based search models. The statistic-based search model was most successful at matching human performance. We conclude that humans use summary statistics to search for complex visual targets.}, keywords = {}, pubstate = {published}, tppubtype = {article} } How do we find a target embedded in a scene? Within the framework of signal detection theory, this task is carried out by comparing each region of the scene with a "template," i.e., an internal representation of the search target. Here we ask what form this representation takes when the search target is a complex image with uncertain orientation. We examine three possible representations. The first is the matched filter. Such a representation cannot account for the ease with which humans can find a complex search target that is rotated relative to the template. A second representation attempts to deal with this by estimating the relative orientation of target and match and rotating the intensity-based template. No intensity-based template, however, can account for the ability to easily locate targets that are defined categorically and not in terms of a specific arrangement of pixels. Thus, we define a third template that represents the target in terms of image statistics rather than pixel intensities. Subjects performed a two-alternative, forced-choice search task in which they had to localize an image that matched a previously viewed target. Target images were texture patches. In one condition, match images were the same image as the target and distractors were a different image of the same textured material. In the second condition, the match image was of the same texture as the target (but different pixels) and the distractor was an image of a different texture. Match and distractor stimuli were randomly rotated relative to the target. We compared human performance to pixel-based, pixel-based with rotation, and statistic-based search models. The statistic-based search model was most successful at matching human performance. We conclude that humans use summary statistics to search for complex visual targets. |
John F Ackermann; Michael S Landy Suboptimal decision criteria are predicted by subjectively weighted probabilities and rewards Journal Article Attention, Perception, and Psychophysics, 77 (2), pp. 638–658, 2015. @article{Ackermann2015, title = {Suboptimal decision criteria are predicted by subjectively weighted probabilities and rewards}, author = {John F Ackermann and Michael S Landy}, doi = {10.3758/s13414-014-0779-z}, year = {2015}, date = {2015-01-01}, journal = {Attention, Perception, and Psychophysics}, volume = {77}, number = {2}, pages = {638--658}, abstract = {Subjects performed a visual detection task in which the probability of target occurrence at each of the two possible locations, and the rewards for correct responses for each, were varied across conditions. To maximize monetary gain, observers should bias their responses, choosing one location more often than the other in line with the varied probabilities and rewards. Typically, and in our task, observers do not bias their responses to the extent they should, and instead distribute their responses more evenly across locations, a phenomenon referred to as 'conservatism.' We investigated several hypotheses regarding the source of the conservatism. We measured utility and probability weighting functions under Prospect Theory for each subject in an independent economic choice task and used the weighting-function parameters to calculate each subject's subjective utility (SU(c)) as a function of the criterion c, and the corresponding weighted optimal criteria (wc opt ). Subjects' criteria were not close to optimal relative to wc opt . The slope of SU(c) and of expected gain EG(c) at the neutral criterion corresponding to $beta$ = 1 were both predictive of the subjects' criteria. The slope of SU(c) was a better predictor of observers' decision criteria overall. Thus, rather than behaving optimally, subjects move their criterion away from the neutral criterion by estimating how much they stand to gain by such a change based on the slope of subjective gain as a function of criterion, using inherently distorted probabilities and values.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Subjects performed a visual detection task in which the probability of target occurrence at each of the two possible locations, and the rewards for correct responses for each, were varied across conditions. To maximize monetary gain, observers should bias their responses, choosing one location more often than the other in line with the varied probabilities and rewards. Typically, and in our task, observers do not bias their responses to the extent they should, and instead distribute their responses more evenly across locations, a phenomenon referred to as 'conservatism.' We investigated several hypotheses regarding the source of the conservatism. We measured utility and probability weighting functions under Prospect Theory for each subject in an independent economic choice task and used the weighting-function parameters to calculate each subject's subjective utility (SU(c)) as a function of the criterion c, and the corresponding weighted optimal criteria (wc opt ). Subjects' criteria were not close to optimal relative to wc opt . The slope of SU(c) and of expected gain EG(c) at the neutral criterion corresponding to $beta$ = 1 were both predictive of the subjects' criteria. The slope of SU(c) was a better predictor of observers' decision criteria overall. Thus, rather than behaving optimally, subjects move their criterion away from the neutral criterion by estimating how much they stand to gain by such a change based on the slope of subjective gain as a function of criterion, using inherently distorted probabilities and values. |
David J Acunzo; John M Henderson No emotional "Pop-out" effect in natural scene viewing Journal Article Emotion, 11 (5), pp. 1134–1143, 2011. @article{Acunzo2011, title = {No emotional "Pop-out" effect in natural scene viewing}, author = {David J Acunzo and John M Henderson}, doi = {10.1037/a0022586}, year = {2011}, date = {2011-01-01}, journal = {Emotion}, volume = {11}, number = {5}, pages = {1134--1143}, abstract = {It has been shown that attention is drawn toward emotional stimuli. In particular, eye movement research suggests that gaze is attracted toward emotional stimuli in an unconscious, automated manner. We addressed whether this effect remains when emotional targets are embedded within complex real-world scenes. Eye movements were recorded while participants memorized natural images. Each image contained an item that was either neutral, such as a bag, or emotional, such as a snake or a couple hugging. We found no latency difference for the first target fixation between the emotional and neutral conditions, suggesting no extrafoveal "pop-out" effect of emotional targets. However, once detected, emotional targets held attention for a longer time than neutral targets. The failure of emotional items to attract attention seems to contradict previous eye-movement research using emotional stimuli. However, our results are consistent with studies examining semantic drive of overt attention in natural scenes. Interpretations of the results in terms of perceptual and attentional load are provided.}, keywords = {}, pubstate = {published}, tppubtype = {article} } It has been shown that attention is drawn toward emotional stimuli. In particular, eye movement research suggests that gaze is attracted toward emotional stimuli in an unconscious, automated manner. We addressed whether this effect remains when emotional targets are embedded within complex real-world scenes. Eye movements were recorded while participants memorized natural images. Each image contained an item that was either neutral, such as a bag, or emotional, such as a snake or a couple hugging. We found no latency difference for the first target fixation between the emotional and neutral conditions, suggesting no extrafoveal "pop-out" effect of emotional targets. However, once detected, emotional targets held attention for a longer time than neutral targets. The failure of emotional items to attract attention seems to contradict previous eye-movement research using emotional stimuli. However, our results are consistent with studies examining semantic drive of overt attention in natural scenes. Interpretations of the results in terms of perceptual and attentional load are provided. |
Hamed Zivari Adab; Ivo D Popivanov; Wim Vanduffel; Rufin Vogels Perceptual learning of simple stimuli modifies stimulus representations in posterior inferior temporal cortex Journal Article Journal of Cognitive Neuroscience, 26 (10), pp. 2187–2200, 2014. @article{Adab2014, title = {Perceptual learning of simple stimuli modifies stimulus representations in posterior inferior temporal cortex}, author = {Hamed Zivari Adab and Ivo D Popivanov and Wim Vanduffel and Rufin Vogels}, doi = {10.1162/jocn}, year = {2014}, date = {2014-01-01}, journal = {Journal of Cognitive Neuroscience}, volume = {26}, number = {10}, pages = {2187--2200}, abstract = {Practicing simple visual detection and discrimination tasks improves performance, a signature of adult brain plasticity. The neural mechanisms that underlie these changes in performance are still unclear. Previously, we reported that practice in discriminating the orientation of noisy gratings (coarse orientation discrimination) increased the ability of single neurons in the early visual area V4 to discriminate the trained stimuli. Here, we ask whether practice in this task also changes the stimulus tuning properties of later visual cortical areas, despite the use of simple grating stimuli. To identify candidate areas, we used fMRI to map activations to noisy gratings in trained rhesus monkeys, revealing a region in the posterior inferior temporal (PIT) cortex. Subsequent single unit record- ings in PIT showed that the degree of orientation selectivity was similar to that of area V4 and that the PIT neurons discriminated the trained orientations better than the untrained orientations. Unlike in previous single unit studies of perceptual learning in early visual cortex, more PIT neurons preferred trained compared with untrained orientations. The effects of training on the responses to the grating stimuli were also present when the animals were performing a difficult orthogo- nal task in which the grating stimuli were task-irrelevant, suggesting that the training effect does not need attention to be expressed. The PIT neurons could support orientation discrimination at low signal-to-noise levels. These findings suggest that extensive practice in discriminating simple grating stimuli not only affects early visual cortex but also changes the stimulus tuning of a late visual cortical area.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Practicing simple visual detection and discrimination tasks improves performance, a signature of adult brain plasticity. The neural mechanisms that underlie these changes in performance are still unclear. Previously, we reported that practice in discriminating the orientation of noisy gratings (coarse orientation discrimination) increased the ability of single neurons in the early visual area V4 to discriminate the trained stimuli. Here, we ask whether practice in this task also changes the stimulus tuning properties of later visual cortical areas, despite the use of simple grating stimuli. To identify candidate areas, we used fMRI to map activations to noisy gratings in trained rhesus monkeys, revealing a region in the posterior inferior temporal (PIT) cortex. Subsequent single unit record- ings in PIT showed that the degree of orientation selectivity was similar to that of area V4 and that the PIT neurons discriminated the trained orientations better than the untrained orientations. Unlike in previous single unit studies of perceptual learning in early visual cortex, more PIT neurons preferred trained compared with untrained orientations. The effects of training on the responses to the grating stimuli were also present when the animals were performing a difficult orthogo- nal task in which the grating stimuli were task-irrelevant, suggesting that the training effect does not need attention to be expressed. The PIT neurons could support orientation discrimination at low signal-to-noise levels. These findings suggest that extensive practice in discriminating simple grating stimuli not only affects early visual cortex but also changes the stimulus tuning of a late visual cortical area. |
Hamed Zivari Adab; Rufin Vogels Perturbation of posterior inferior temporal cortical activity impairs coarse orientation discrimination Journal Article Cerebral Cortex, 26 (9), pp. 3814–3827, 2016. @article{Adab2016, title = {Perturbation of posterior inferior temporal cortical activity impairs coarse orientation discrimination}, author = {Hamed Zivari Adab and Rufin Vogels}, doi = {10.1093/cercor/bhv178}, year = {2016}, date = {2016-01-01}, journal = {Cerebral Cortex}, volume = {26}, number = {9}, pages = {3814--3827}, abstract = {It is reasonable to assume that the discrimination of simple visual stimuli depends on the activity of early visual cortical neurons, because simple visual features are supposedly coded in these areas whereas more complex features are coded in late visual areas. Recently, we showed that training monkeys in a coarse orientation discrimination task modified the response properties of single neurons in the posterior inferior temporal (PIT) cortex, a late visual area. Here, we examined the contribution of PIT to coarse orientation discrimination using causal perturbation methods. Electrical stimulation (ES) of PIT with currents of at least 100 µA impaired coarse orientation discrimination in monkeys. The performance deterioration did not exclusively reflect a general impairment to perform a difficult perceptual task. However, high current (650 µA) but not low-current (100 µA) ES also impaired fine color discrimination. ES of temporal regions dorsal or anterior to PIT produced less impairment of coarse orientation discrimination than ES of PIT. Injections of the GABA agonist muscimol into PIT also impaired performance. These data suggest that the late cortical area PIT is part of the network that supports coarse orientation discrimination of a simple grating stimulus, at least after extensive training in this task at threshold.}, keywords = {}, pubstate = {published}, tppubtype = {article} } It is reasonable to assume that the discrimination of simple visual stimuli depends on the activity of early visual cortical neurons, because simple visual features are supposedly coded in these areas whereas more complex features are coded in late visual areas. Recently, we showed that training monkeys in a coarse orientation discrimination task modified the response properties of single neurons in the posterior inferior temporal (PIT) cortex, a late visual area. Here, we examined the contribution of PIT to coarse orientation discrimination using causal perturbation methods. Electrical stimulation (ES) of PIT with currents of at least 100 µA impaired coarse orientation discrimination in monkeys. The performance deterioration did not exclusively reflect a general impairment to perform a difficult perceptual task. However, high current (650 µA) but not low-current (100 µA) ES also impaired fine color discrimination. ES of temporal regions dorsal or anterior to PIT produced less impairment of coarse orientation discrimination than ES of PIT. Injections of the GABA agonist muscimol into PIT also impaired performance. These data suggest that the late cortical area PIT is part of the network that supports coarse orientation discrimination of a simple grating stimulus, at least after extensive training in this task at threshold. |
Jos J Adam; Simona Buetti; Dirk Kerzel Coordinated flexibility: How initial gaze position modulates eye-hand coordination and reaching Journal Article Journal of Experimental Psychology: Human Perception and Performance, 38 (4), pp. 891–901, 2012. @article{Adam2012, title = {Coordinated flexibility: How initial gaze position modulates eye-hand coordination and reaching}, author = {Jos J Adam and Simona Buetti and Dirk Kerzel}, doi = {10.1037/a0027592}, year = {2012}, date = {2012-01-01}, journal = {Journal of Experimental Psychology: Human Perception and Performance}, volume = {38}, number = {4}, pages = {891--901}, abstract = {Reaching to targets in space requires the coordination of eye and hand movements. In two experiments, we recorded eye and hand kinematics to examine the role of gaze position at target onset on eye-hand coordination and reaching performance. Experiment 1 showed that with eyes and hand aligned on the same peripheral start location, time lags between eye and hand onsets were small and initiation times were substantially correlated, suggesting simultaneous control and tight eye-hand coupling. With eyes and hand departing from different start locations (gaze aligned with the center of the range of possible target positions), time lags between eye and hand onsets were large and initiation times were largely uncorrelated, suggesting independent control and decoupling of eye and hand movements. Furthermore, initial gaze position strongly mediated manual reaching performance indexed by increments in movement time as a function of target distance. Experiment 2 confirmed the impact of target foveation in modulating the effect of target distance on movement time. Our findings reveal the operation of an overarching, flexible neural control system that tunes the operation and cooperation of saccadic and manual control systems depending on where the eyes look at target onset.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Reaching to targets in space requires the coordination of eye and hand movements. In two experiments, we recorded eye and hand kinematics to examine the role of gaze position at target onset on eye-hand coordination and reaching performance. Experiment 1 showed that with eyes and hand aligned on the same peripheral start location, time lags between eye and hand onsets were small and initiation times were substantially correlated, suggesting simultaneous control and tight eye-hand coupling. With eyes and hand departing from different start locations (gaze aligned with the center of the range of possible target positions), time lags between eye and hand onsets were large and initiation times were largely uncorrelated, suggesting independent control and decoupling of eye and hand movements. Furthermore, initial gaze position strongly mediated manual reaching performance indexed by increments in movement time as a function of target distance. Experiment 2 confirmed the impact of target foveation in modulating the effect of target distance on movement time. Our findings reveal the operation of an overarching, flexible neural control system that tunes the operation and cooperation of saccadic and manual control systems depending on where the eyes look at target onset. |
Robert Adam; Paul M Bays; Masud Husain Rapid decision-making under risk Journal Article Cognitive Neuroscience, 3 (1), pp. 52–61, 2012. @article{Adam2012a, title = {Rapid decision-making under risk}, author = {Robert Adam and Paul M Bays and Masud Husain}, year = {2012}, date = {2012-01-01}, journal = {Cognitive Neuroscience}, volume = {3}, number = {1}, pages = {52--61}, abstract = {Impulsivity is often characterized by rapid decisions under risk, but most current tests of decision-making do not impose time pressures on participants' choices. Here we introduce a new Traffic Lights test which requires people to choose whether to programme a risky, early eye movement before a traffic light turns green (earning them high rewards or a penalty) or wait for the green light before responding to obtain a small reward instead. Young participants demonstrated bimodal responses: an early, high-risk and a later, low-risk set of choices. By contrast, elderly people invariably waited for the green light and showed little risk-taking. Performance could be modelled as a race between two rise-to-threshold decision processes, one triggered by the green light and the other initiated before it. The test provides a useful measure of rapid decision-making under risk, with the potential to reveal how this process alters with aging or in patient groups.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Impulsivity is often characterized by rapid decisions under risk, but most current tests of decision-making do not impose time pressures on participants' choices. Here we introduce a new Traffic Lights test which requires people to choose whether to programme a risky, early eye movement before a traffic light turns green (earning them high rewards or a penalty) or wait for the green light before responding to obtain a small reward instead. Young participants demonstrated bimodal responses: an early, high-risk and a later, low-risk set of choices. By contrast, elderly people invariably waited for the green light and showed little risk-taking. Performance could be modelled as a race between two rise-to-threshold decision processes, one triggered by the green light and the other initiated before it. The test provides a useful measure of rapid decision-making under risk, with the potential to reveal how this process alters with aging or in patient groups. |
Robert Adam; Alexander P Leff; Nihal Sinha; Christopher Turner; Paul Bays; Bogdan Draganski; Masud Husain Dopamine reverses reward insensitivity in apathy following globus pallidus lesions Journal Article Cortex, 49 (5), pp. 1292–1303, 2013. @article{Adam2013, title = {Dopamine reverses reward insensitivity in apathy following globus pallidus lesions}, author = {Robert Adam and Alexander P Leff and Nihal Sinha and Christopher Turner and Paul Bays and Bogdan Draganski and Masud Husain}, doi = {10.1016/j.cortex.2012.04.013}, year = {2013}, date = {2013-01-01}, journal = {Cortex}, volume = {49}, number = {5}, pages = {1292--1303}, publisher = {Elsevier Ltd}, abstract = {Apathy is a complex, behavioural disorder associated with reduced spontaneous initiation of actions. Although present in mild forms in some healthy people, it is a pathological state in conditions such as Alzheimer's and Parkinson's disease where it can have profoundly devastating effects. Understanding the mechanisms underlying apathy is therefore of urgent concern but this has proven difficult because widespread brain changes in neurodegenerative diseases make interpretation difficult and there is no good animal model.Here we present a very rare case with profound apathy following bilateral, focal lesions of the basal ganglia, with globus pallidus regions that connect with orbitofrontal (OFC) and ventromedial prefrontal cortex (VMPFC) particularly affected. Using two measures of oculomotor decision-making we show that apathy in this individual was associated with reward insensitivity. However, reward sensitivity could be established partially with levodopa and more effectively with a dopamine receptor agonist. Concomitantly, there was an improvement in the patient's clinical state, with reduced apathy, greater motivation and increased social interactions. These findings provide a model system to study a key neuropsychiatric disorder. They demonstrate that reward insensitivity associated with basal ganglia dysfunction might be an important component of apathy that can be reversed by dopaminergic modulation.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Apathy is a complex, behavioural disorder associated with reduced spontaneous initiation of actions. Although present in mild forms in some healthy people, it is a pathological state in conditions such as Alzheimer's and Parkinson's disease where it can have profoundly devastating effects. Understanding the mechanisms underlying apathy is therefore of urgent concern but this has proven difficult because widespread brain changes in neurodegenerative diseases make interpretation difficult and there is no good animal model.Here we present a very rare case with profound apathy following bilateral, focal lesions of the basal ganglia, with globus pallidus regions that connect with orbitofrontal (OFC) and ventromedial prefrontal cortex (VMPFC) particularly affected. Using two measures of oculomotor decision-making we show that apathy in this individual was associated with reward insensitivity. However, reward sensitivity could be established partially with levodopa and more effectively with a dopamine receptor agonist. Concomitantly, there was an improvement in the patient's clinical state, with reduced apathy, greater motivation and increased social interactions. These findings provide a model system to study a key neuropsychiatric disorder. They demonstrate that reward insensitivity associated with basal ganglia dysfunction might be an important component of apathy that can be reversed by dopaminergic modulation. |
Jos J Adam; Thamar J H Bovend'Eerdt; Fren T Y Smulders; Pascal W M Van Gerven Strategic flexibility in response preparation: Effects of cue validity on reaction time and pupil dilation Journal Article Journal of Cognitive Psychology, 26 (2), pp. 166–177, 2014. @article{Adam2014, title = {Strategic flexibility in response preparation: Effects of cue validity on reaction time and pupil dilation}, author = {Jos J Adam and Thamar J H Bovend'Eerdt and Fren T Y Smulders and Pascal W M {Van Gerven}}, doi = {10.1080/20445911.2014.883399}, year = {2014}, date = {2014-01-01}, journal = {Journal of Cognitive Psychology}, volume = {26}, number = {2}, pages = {166--177}, abstract = {This study examined the ability of participants to strategically adapt their level of response preparation to the predictive value of preparatory cues. Participants performed the finger-precuing task under three levels of cue validity: 100, 75 and 50% valid. Response preparation was indexed by means of reaction time (RT) and pupil dilation, the latter providing a psychophysiological index of invested effort. Results showed a systematic increase in RT benefits (generated by valid cues) and RT costs (generated by invalid cues) with increments in the predictive value of cues. Converging with these behavioural effects, pupil dilation also increased systematically with greater cue validity during the cue-stimulus interval, suggesting more effortful response preparation with increases in cue validity. Together, these findings confirm the hypothesis that response preparation is flexible and that it can be strategically allocated in proportion to the relative frequency of valid/invalid preparatory cues.}, keywords = {}, pubstate = {published}, tppubtype = {article} } This study examined the ability of participants to strategically adapt their level of response preparation to the predictive value of preparatory cues. Participants performed the finger-precuing task under three levels of cue validity: 100, 75 and 50% valid. Response preparation was indexed by means of reaction time (RT) and pupil dilation, the latter providing a psychophysiological index of invested effort. Results showed a systematic increase in RT benefits (generated by valid cues) and RT costs (generated by invalid cues) with increments in the predictive value of cues. Converging with these behavioural effects, pupil dilation also increased systematically with greater cue validity during the cue-stimulus interval, suggesting more effortful response preparation with increases in cue validity. Together, these findings confirm the hypothesis that response preparation is flexible and that it can be strategically allocated in proportion to the relative frequency of valid/invalid preparatory cues. |
Ramina Adam; Kevin D Johnston; Stefan Everling Journal of Neurophysiology, 122 (2), pp. 672–690, 2019. @article{Adam2019, title = {Recovery of contralesional saccade choice and reaction time deficits after a unilateral endothelin-1-induced lesion in the macaque caudal prefrontal cortex}, author = {Ramina Adam and Kevin D Johnston and Stefan Everling}, doi = {10.1152/jn.00078.2019}, year = {2019}, date = {2019-08-01}, journal = {Journal of Neurophysiology}, volume = {122}, number = {2}, pages = {672--690}, publisher = {American Physiological Society Bethesda, MD}, abstract = {The caudal primate prefrontal cortex (PFC) is involved in target selection and visually guided saccades through both covert attention and overt orienting eye movements. Unilateral damage to the caudal PFC often leads to decreased awareness of a contralesional target alone, referred to as “neglect,” or when it is presented simultaneously with an ipsilesional target, referred to as “extinction.” In the current study, we examined whether deficits in contralesional target selection were due to contralesional oculomotor deficits, such as slower reaction times. We experimentally induced a focal ischemic lesion in the right caudal PFC of 4 male macaque monkeys using the vasoconstrictor endothelin-1 and measured saccade choice and reaction times on double-stimulus free-choice tasks and single-stimulus trials before and after the lesion. We found that 1) endothelin-1-induced lesions in the caudal PFC produced contralesional target selection deficits that varied in severity and duration based on lesion volume and location; 2) contralesional neglect-like deficits were transient and recovered by week 4 postlesion; 3) contralesional extinction-like deficits were longer lasting and recovered by weeks 8–16 postlesion; 4) contralesional reaction time returned to baseline well before the contralesional choice deficit had recovered; and 5) neither the mean reaction times nor the reaction time distributions could account for the degree of contralesional extinction on the free-choice task throughout recovery. These findings demonstrate that the saccade choice bias observed after a right caudal PFC lesion is not exclusively due to contralesional motor deficits, but instead reflects a combination of impaired motor and attentional processing.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The caudal primate prefrontal cortex (PFC) is involved in target selection and visually guided saccades through both covert attention and overt orienting eye movements. Unilateral damage to the caudal PFC often leads to decreased awareness of a contralesional target alone, referred to as “neglect,” or when it is presented simultaneously with an ipsilesional target, referred to as “extinction.” In the current study, we examined whether deficits in contralesional target selection were due to contralesional oculomotor deficits, such as slower reaction times. We experimentally induced a focal ischemic lesion in the right caudal PFC of 4 male macaque monkeys using the vasoconstrictor endothelin-1 and measured saccade choice and reaction times on double-stimulus free-choice tasks and single-stimulus trials before and after the lesion. We found that 1) endothelin-1-induced lesions in the caudal PFC produced contralesional target selection deficits that varied in severity and duration based on lesion volume and location; 2) contralesional neglect-like deficits were transient and recovered by week 4 postlesion; 3) contralesional extinction-like deficits were longer lasting and recovered by weeks 8–16 postlesion; 4) contralesional reaction time returned to baseline well before the contralesional choice deficit had recovered; and 5) neither the mean reaction times nor the reaction time distributions could account for the degree of contralesional extinction on the free-choice task throughout recovery. These findings demonstrate that the saccade choice bias observed after a right caudal PFC lesion is not exclusively due to contralesional motor deficits, but instead reflects a combination of impaired motor and attentional processing. |
Ramina Adam; Kevin D Johnston; Ravi S Menon; Stefan Everling Functional reorganization during the recovery of contralesional target selection deficits after prefrontal cortex lesions in macaque monkeys Journal Article NeuroImage, 207 , pp. 1–17, 2020. @article{Adam2020, title = {Functional reorganization during the recovery of contralesional target selection deficits after prefrontal cortex lesions in macaque monkeys}, author = {Ramina Adam and Kevin D Johnston and Ravi S Menon and Stefan Everling}, doi = {10.1016/j.neuroimage.2019.116339}, year = {2020}, date = {2020-01-01}, journal = {NeuroImage}, volume = {207}, pages = {1--17}, publisher = {Elsevier Ltd}, abstract = {Visual extinction has been characterized by the failure to respond to a visual stimulus in the contralesional hemifield when presented simultaneously with an ipsilesional stimulus (Corbetta and Shulman, 2011). Unilateral damage to the macaque frontoparietal cortex commonly leads to deficits in contralesional target selection that resemble visual extinction. Recently, we showed that macaque monkeys with unilateral lesions in the caudal prefrontal cortex (PFC) exhibited contralesional target selection deficits that recovered over 2–4 months (Adam et al., 2019). Here, we investigated the longitudinal changes in functional connectivity (FC) of the frontoparietal network after a small or large right caudal PFC lesion in four macaque monkeys. We collected ultra-high field resting-state fMRI at 7-T before the lesion and at weeks 1–16 post-lesion and compared the functional data with behavioural performance on a free-choice saccade task. We found that the pattern of frontoparietal network FC changes depended on lesion size, such that the recovery of contralesional extinction was associated with an initial increase in network FC that returned to baseline in the two small lesion monkeys, whereas FC continued to increase throughout recovery in the two monkeys with a larger lesion. We also found that the FC between contralesional dorsolateral PFC and ipsilesional parietal cortex correlated with behavioural recovery and that the contralesional dorsolateral PFC showed increasing degree centrality with the frontoparietal network. These findings suggest that both the contralesional and ipsilesional hemispheres play an important role in the recovery of function. Importantly, optimal compensation after large PFC lesions may require greater recruitment of distant and intact areas of the frontoparietal network, whereas recovery from smaller lesions was supported by a normalization of the functional network.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Visual extinction has been characterized by the failure to respond to a visual stimulus in the contralesional hemifield when presented simultaneously with an ipsilesional stimulus (Corbetta and Shulman, 2011). Unilateral damage to the macaque frontoparietal cortex commonly leads to deficits in contralesional target selection that resemble visual extinction. Recently, we showed that macaque monkeys with unilateral lesions in the caudal prefrontal cortex (PFC) exhibited contralesional target selection deficits that recovered over 2–4 months (Adam et al., 2019). Here, we investigated the longitudinal changes in functional connectivity (FC) of the frontoparietal network after a small or large right caudal PFC lesion in four macaque monkeys. We collected ultra-high field resting-state fMRI at 7-T before the lesion and at weeks 1–16 post-lesion and compared the functional data with behavioural performance on a free-choice saccade task. We found that the pattern of frontoparietal network FC changes depended on lesion size, such that the recovery of contralesional extinction was associated with an initial increase in network FC that returned to baseline in the two small lesion monkeys, whereas FC continued to increase throughout recovery in the two monkeys with a larger lesion. We also found that the FC between contralesional dorsolateral PFC and ipsilesional parietal cortex correlated with behavioural recovery and that the contralesional dorsolateral PFC showed increasing degree centrality with the frontoparietal network. These findings suggest that both the contralesional and ipsilesional hemispheres play an important role in the recovery of function. Importantly, optimal compensation after large PFC lesions may require greater recruitment of distant and intact areas of the frontoparietal network, whereas recovery from smaller lesions was supported by a normalization of the functional network. |
Rick A Adams; Eduardo Aponte; Louise Marshall; Karl J Friston Active inference and oculomotor pursuit: The dynamic causal modelling of eye movements Journal Article Journal of Neuroscience Methods, 242 , pp. 1–14, 2015. @article{Adams2015, title = {Active inference and oculomotor pursuit: The dynamic causal modelling of eye movements}, author = {Rick A Adams and Eduardo Aponte and Louise Marshall and Karl J Friston}, doi = {10.1016/j.jneumeth.2015.01.003}, year = {2015}, date = {2015-01-01}, journal = {Journal of Neuroscience Methods}, volume = {242}, pages = {1--14}, publisher = {Elsevier B.V.}, abstract = {Background: This paper introduces a new paradigm that allows one to quantify the Bayesian beliefs evidenced by subjects during oculomotor pursuit. Subjects' eye tracking responses to a partially occluded sinusoidal target were recorded non-invasively and averaged. These response averages were then analysed using dynamic causal modelling (DCM). In DCM, observed responses are modelled using biologically plausible generative or forward models - usually biophysical models of neuronal activity. New method: Our key innovation is to use a generative model based on a normative (Bayes-optimal) model of active inference to model oculomotor pursuit in terms of subjects' beliefs about how visual targets move and how their oculomotor system responds. Our aim here is to establish the face validity of the approach, by manipulating the content and precision of sensory information - and examining the ensuing changes in the subjects' implicit beliefs. These beliefs are inferred from their eye movements using the normative model. Results: We show that on average, subjects respond to an increase in the 'noise' of target motion by increasing sensory precision in their models of the target trajectory. In other words, they attend more to the sensory attributes of a noisier stimulus. Conversely, subjects only change kinetic parameters in their model but not precision, in response to increased target speed. Conclusions: Using this technique one can estimate the precisions of subjects' hierarchical Bayesian beliefs about target motion. We hope to apply this paradigm to subjects with schizophrenia, whose pursuit abnormalities may result from the abnormal encoding of precision.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Background: This paper introduces a new paradigm that allows one to quantify the Bayesian beliefs evidenced by subjects during oculomotor pursuit. Subjects' eye tracking responses to a partially occluded sinusoidal target were recorded non-invasively and averaged. These response averages were then analysed using dynamic causal modelling (DCM). In DCM, observed responses are modelled using biologically plausible generative or forward models - usually biophysical models of neuronal activity. New method: Our key innovation is to use a generative model based on a normative (Bayes-optimal) model of active inference to model oculomotor pursuit in terms of subjects' beliefs about how visual targets move and how their oculomotor system responds. Our aim here is to establish the face validity of the approach, by manipulating the content and precision of sensory information - and examining the ensuing changes in the subjects' implicit beliefs. These beliefs are inferred from their eye movements using the normative model. Results: We show that on average, subjects respond to an increase in the 'noise' of target motion by increasing sensory precision in their models of the target trajectory. In other words, they attend more to the sensory attributes of a noisier stimulus. Conversely, subjects only change kinetic parameters in their model but not precision, in response to increased target speed. Conclusions: Using this technique one can estimate the precisions of subjects' hierarchical Bayesian beliefs about target motion. We hope to apply this paradigm to subjects with schizophrenia, whose pursuit abnormalities may result from the abnormal encoding of precision. |
Rick A Adams; Markus Bauer; Dimitris Pinotsis; Karl J Friston Dynamic causal modelling of eye movements during pursuit: Confirming precision-encoding in V1 using MEG Journal Article Neuroimage, 132 , pp. 175–189, 2016. @article{Adams2016, title = {Dynamic causal modelling of eye movements during pursuit: Confirming precision-encoding in V1 using MEG}, author = {Rick A Adams and Markus Bauer and Dimitris Pinotsis and Karl J Friston}, doi = {10.1016/j.neuroimage.2016.02.055}, year = {2016}, date = {2016-01-01}, journal = {Neuroimage}, volume = {132}, pages = {175--189}, publisher = {The Authors}, abstract = {This paper shows that it is possible to estimate the subjective precision (inverse variance) of Bayesian beliefs during oculomotor pursuit. Subjects viewed a sinusoidal target, with or without random fluctuations in its motion. Eye trajectories and magnetoencephalographic (MEG) data were recorded concurrently. The target was periodically occluded, such that its reappearance caused a visual evoked response field (ERF). Dynamic causal modelling (DCM) was used to fit models of eye trajectories and the ERFs. The DCM for pursuit was based on predictive coding and active inference, and predicts subjects' eye movements based on their (subjective) Bayesian beliefs about target (and eye) motion. The precisions of these hierarchical beliefs can be inferred from behavioural (pursuit) data. The DCM for MEG data used an established biophysical model of neuronal activity that includes parameters for the gain of superficial pyramidal cells, which is thought to encode precision at the neuronal level. Previous studies (using DCM of pursuit data) suggest that noisy target motion increases subjective precision at the sensory level: i.e., subjects attend more to the target's sensory attributes. We compared (noisy motion-induced) changes in the synaptic gain based on the modelling of MEG data to changes in subjective precision estimated using the pursuit data. We demonstrate that imprecise target motion increases the gain of superficial pyramidal cells in V1 (across subjects). Furthermore, increases in sensory precision – inferred by our behavioural DCM – correlate with the increase in gain in V1, across subjects. This is a step towards a fully integrated model of brain computations, cortical responses and behaviour that may provide a useful clinical tool in conditions like schizophrenia.}, keywords = {}, pubstate = {published}, tppubtype = {article} } This paper shows that it is possible to estimate the subjective precision (inverse variance) of Bayesian beliefs during oculomotor pursuit. Subjects viewed a sinusoidal target, with or without random fluctuations in its motion. Eye trajectories and magnetoencephalographic (MEG) data were recorded concurrently. The target was periodically occluded, such that its reappearance caused a visual evoked response field (ERF). Dynamic causal modelling (DCM) was used to fit models of eye trajectories and the ERFs. The DCM for pursuit was based on predictive coding and active inference, and predicts subjects' eye movements based on their (subjective) Bayesian beliefs about target (and eye) motion. The precisions of these hierarchical beliefs can be inferred from behavioural (pursuit) data. The DCM for MEG data used an established biophysical model of neuronal activity that includes parameters for the gain of superficial pyramidal cells, which is thought to encode precision at the neuronal level. Previous studies (using DCM of pursuit data) suggest that noisy target motion increases subjective precision at the sensory level: i.e., subjects attend more to the target's sensory attributes. We compared (noisy motion-induced) changes in the synaptic gain based on the modelling of MEG data to changes in subjective precision estimated using the pursuit data. We demonstrate that imprecise target motion increases the gain of superficial pyramidal cells in V1 (across subjects). Furthermore, increases in sensory precision – inferred by our behavioural DCM – correlate with the increase in gain in V1, across subjects. This is a step towards a fully integrated model of brain computations, cortical responses and behaviour that may provide a useful clinical tool in conditions like schizophrenia. |
Owen J Adams; Nicholas Gaspelin Assessing introspective awareness of attention capture Journal Article Attention, Perception, and Psychophysics, 82 (4), pp. 1586–1598, 2020. @article{Adams2020, title = {Assessing introspective awareness of attention capture}, author = {Owen J Adams and Nicholas Gaspelin}, doi = {10.3758/s13414-019-01936-9}, year = {2020}, date = {2020-01-01}, journal = {Attention, Perception, and Psychophysics}, volume = {82}, number = {4}, pages = {1586--1598}, publisher = {Attention, Perception, & Psychophysics}, abstract = {Visual attention can sometimes be involuntarily captured by salient stimuli, and this may lead to impaired performance in a variety of real-world tasks. If observers were aware that their attention was being captured, they might be able to exert control and avoid subsequent distraction. However, it is unknown whether observers can detect attention capture when it occurs. In the current study, participants searched for a target shape and attempted to ignore a salient color distractor. On a subset of trials, participants then immediately classified whether the salient distractor captured their attention (“capture” vs. “no capture”). Participants were slower and less accurate at detecting the target on trials on which they reported “capture” than “no capture.” Follow-up experiments revealed that participants specifically detected covert shifts of attention to the salient item. Altogether, these results indicate that observers can have immediate awareness of visual distraction, at least under certain circumstances.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Visual attention can sometimes be involuntarily captured by salient stimuli, and this may lead to impaired performance in a variety of real-world tasks. If observers were aware that their attention was being captured, they might be able to exert control and avoid subsequent distraction. However, it is unknown whether observers can detect attention capture when it occurs. In the current study, participants searched for a target shape and attempted to ignore a salient color distractor. On a subset of trials, participants then immediately classified whether the salient distractor captured their attention (“capture” vs. “no capture”). Participants were slower and less accurate at detecting the target on trials on which they reported “capture” than “no capture.” Follow-up experiments revealed that participants specifically detected covert shifts of attention to the salient item. Altogether, these results indicate that observers can have immediate awareness of visual distraction, at least under certain circumstances. |
Rick A Adams; Daniel Bush; Fanfan Zheng; Sofie S Meyer; Raphael Kaplan; Stelios Orfanos; Tiago Reis Marques; Oliver D Howes; Neil Burgess Impaired theta phase coupling underlies frontotemporal dysconnectivity in schizophrenia Journal Article Brain, 143 (3), pp. 1261–1277, 2020. @article{Adams2020a, title = {Impaired theta phase coupling underlies frontotemporal dysconnectivity in schizophrenia}, author = {Rick A Adams and Daniel Bush and Fanfan Zheng and Sofie S Meyer and Raphael Kaplan and Stelios Orfanos and Tiago Reis Marques and Oliver D Howes and Neil Burgess}, doi = {10.1093/brain/awaa035}, year = {2020}, date = {2020-01-01}, journal = {Brain}, volume = {143}, number = {3}, pages = {1261--1277}, abstract = {Frontotemporal dysconnectivity is a key pathology in schizophrenia. The specific nature of this dysconnectivity is unknown, but animal models imply dysfunctional theta phase coupling between hippocampus and medial prefrontal cortex (mPFC). We tested this hypothesis by examining neural dynamics in 18 participants with a schizophrenia diagnosis, both medicated and unmedicated; and 26 age, sex and IQ matched control subjects. All participants completed two tasks known to elicit hippocampal-prefrontal theta coupling: a spatial memory task (during magnetoencephalography) and a memory integration task. In addition, an overlapping group of 33 schizophrenia and 29 control subjects underwent PET to measure the availability of GABAARs expressing the a5 subunit (concentrated on hippocampal somatostatin interneurons). We demonstrate-in the spatial memory task, during memory recall-that theta power increases in left medial temporal lobe (mTL) are impaired in schizophrenia, as is theta phase coupling between mPFC and mTL. Importantly, the latter cannot be explained by theta power changes, head movement, antipsychotics, cannabis use, or IQ, and is not found in other frequency bands. Moreover, mPFC-mTL theta coupling correlated strongly with performance in controls, but not in subjects with schizophrenia, who were mildly impaired at the spatial memory task and no better than chance on the memory integration task. Finally, mTL regions showing reduced phase coupling in schizophrenia magnetoencephalography participants overlapped substantially with areas of diminished a5-GABAAR availability in the wider schizophrenia PET sample. These results indicate that mPFC-mTL dysconnectivity in schizophrenia is due to a loss of theta phase coupling, and imply a5-GABAARs (and the cells that express them) have a role in this process.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Frontotemporal dysconnectivity is a key pathology in schizophrenia. The specific nature of this dysconnectivity is unknown, but animal models imply dysfunctional theta phase coupling between hippocampus and medial prefrontal cortex (mPFC). We tested this hypothesis by examining neural dynamics in 18 participants with a schizophrenia diagnosis, both medicated and unmedicated; and 26 age, sex and IQ matched control subjects. All participants completed two tasks known to elicit hippocampal-prefrontal theta coupling: a spatial memory task (during magnetoencephalography) and a memory integration task. In addition, an overlapping group of 33 schizophrenia and 29 control subjects underwent PET to measure the availability of GABAARs expressing the a5 subunit (concentrated on hippocampal somatostatin interneurons). We demonstrate-in the spatial memory task, during memory recall-that theta power increases in left medial temporal lobe (mTL) are impaired in schizophrenia, as is theta phase coupling between mPFC and mTL. Importantly, the latter cannot be explained by theta power changes, head movement, antipsychotics, cannabis use, or IQ, and is not found in other frequency bands. Moreover, mPFC-mTL theta coupling correlated strongly with performance in controls, but not in subjects with schizophrenia, who were mildly impaired at the spatial memory task and no better than chance on the memory integration task. Finally, mTL regions showing reduced phase coupling in schizophrenia magnetoencephalography participants overlapped substantially with areas of diminished a5-GABAAR availability in the wider schizophrenia PET sample. These results indicate that mPFC-mTL dysconnectivity in schizophrenia is due to a loss of theta phase coupling, and imply a5-GABAARs (and the cells that express them) have a role in this process. |
Hossein Adeli; Françoise Vitu; Gregory J Zelinsky A model of the superior colliculus predicts fixation locations during scene viewing and visual aearch Journal Article Journal of Neuroscience, 37 (6), pp. 1453–1467, 2017. @article{Adeli2017, title = {A model of the superior colliculus predicts fixation locations during scene viewing and visual aearch}, author = {Hossein Adeli and Fran{ç}oise Vitu and Gregory J Zelinsky}, doi = {10.1523/JNEUROSCI.0825-16.2016}, year = {2017}, date = {2017-01-01}, journal = {Journal of Neuroscience}, volume = {37}, number = {6}, pages = {1453--1467}, abstract = {Modern computational models of attention predict fixations using saliency maps and target maps, which prioritize locations for fixation based on feature contrast and target goals, respectively. But whereas many such models are biologically plausible, none have looked to the oculomotor system for design constraints or parameter specification. Conversely, although most models of saccade programming are tightly coupled to underlying neurophysiology, none have been tested using real-world stimuli and tasks. We combined the strengths of these two approaches in MASC, a model of attention in the superior colliculus (SC) that captures known neurophysiological constraints on saccade programming. We show that MASC predicted the fixation locations of humans freely viewing naturalistic scenes and performing exemplar and categorical search tasks, a breadth achieved by no other existing model. Moreover, it did this as well or better than its more specialized state-of-the-art competitors. MASC's predictive success stems from its inclusion of high-level but core principles of SC organization: an over-representation of foveal information, size-invariant population codes, cascaded population averaging over distorted visual and motor maps, and competition between motor point images for saccade programming, all of which cause further modulation of priority (attention) after projection of saliency and target maps to the SC. Only by incorporating these organizing brain principles into our models can we fully understand the transformation of complex visual information into the saccade programs underlying movements of overt attention. With MASC, a theoretical footing now exists to generate and test computationally explicit predictions of behavioral and neural responses in visually complex real-world contexts.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Modern computational models of attention predict fixations using saliency maps and target maps, which prioritize locations for fixation based on feature contrast and target goals, respectively. But whereas many such models are biologically plausible, none have looked to the oculomotor system for design constraints or parameter specification. Conversely, although most models of saccade programming are tightly coupled to underlying neurophysiology, none have been tested using real-world stimuli and tasks. We combined the strengths of these two approaches in MASC, a model of attention in the superior colliculus (SC) that captures known neurophysiological constraints on saccade programming. We show that MASC predicted the fixation locations of humans freely viewing naturalistic scenes and performing exemplar and categorical search tasks, a breadth achieved by no other existing model. Moreover, it did this as well or better than its more specialized state-of-the-art competitors. MASC's predictive success stems from its inclusion of high-level but core principles of SC organization: an over-representation of foveal information, size-invariant population codes, cascaded population averaging over distorted visual and motor maps, and competition between motor point images for saccade programming, all of which cause further modulation of priority (attention) after projection of saliency and target maps to the SC. Only by incorporating these organizing brain principles into our models can we fully understand the transformation of complex visual information into the saccade programs underlying movements of overt attention. With MASC, a theoretical footing now exists to generate and test computationally explicit predictions of behavioral and neural responses in visually complex real-world contexts. |
Kivilcim Afacan-Seref; Natalie A Steinemann; Annabelle Blangero; Simon P Kelly Dynamic interplay of value and sensory information in high-speed decision making Journal Article Current Biology, 28 (5), pp. 795–802, 2018. @article{AfacanSeref2018, title = {Dynamic interplay of value and sensory information in high-speed decision making}, author = {Kivilcim Afacan-Seref and Natalie A Steinemann and Annabelle Blangero and Simon P Kelly}, doi = {10.1016/j.cub.2018.01.071}, year = {2018}, date = {2018-03-01}, journal = {Current Biology}, volume = {28}, number = {5}, pages = {795--802}, abstract = {In dynamic environments, split-second sensorimotor decisions must be prioritized according to potential payoffs to maximize overall rewards. The impact of relative value on deliberative perceptual judgments has been examined extensively [1–6], but relatively little is known about value-biasing mechanisms in the common situation where physical evidence is strong but the time to act is severely limited. In prominent decision models, a noisy but statistically stationary representation of sensory evidence is integrated over time to an action-triggering bound, and value-biases are affected by starting the integrator closer to the more valuable bound. Here, we show significant departures from this account for humans making rapid sensory-instructed action choices. Behavior was best explained by a simple model in which the evidence representation—and hence, rate of accumulation—is itself biased by value and is non-stationary, increasing over the short decision time frame. Because the value bias initially dominates, the model uniquely predicts a dynamic ‘‘turn-around'' effect on low-value cues, where the accumulator first launches toward the incorrect action but is then re-routed to the correct one. This was clearly exhibited in electrophysiological signals reflecting motor preparation and evidence accumulation. Finally, we construct an extended model that implements this dynamic effect through plausible sensory neural response modulations and demonstrate the correspondence between decision signal dynamics simulated from a behavioral fit of that model and the empirical decision signals. Our findings suggest that value and sensory information can exert simultaneous and dynamically countervailing influences on the trajectory of the accumulation-to-bound process, driving rapid, sensory-guided actions.}, keywords = {}, pubstate = {published}, tppubtype = {article} } In dynamic environments, split-second sensorimotor decisions must be prioritized according to potential payoffs to maximize overall rewards. The impact of relative value on deliberative perceptual judgments has been examined extensively [1–6], but relatively little is known about value-biasing mechanisms in the common situation where physical evidence is strong but the time to act is severely limited. In prominent decision models, a noisy but statistically stationary representation of sensory evidence is integrated over time to an action-triggering bound, and value-biases are affected by starting the integrator closer to the more valuable bound. Here, we show significant departures from this account for humans making rapid sensory-instructed action choices. Behavior was best explained by a simple model in which the evidence representation—and hence, rate of accumulation—is itself biased by value and is non-stationary, increasing over the short decision time frame. Because the value bias initially dominates, the model uniquely predicts a dynamic ‘‘turn-around'' effect on low-value cues, where the accumulator first launches toward the incorrect action but is then re-routed to the correct one. This was clearly exhibited in electrophysiological signals reflecting motor preparation and evidence accumulation. Finally, we construct an extended model that implements this dynamic effect through plausible sensory neural response modulations and demonstrate the correspondence between decision signal dynamics simulated from a behavioral fit of that model and the empirical decision signals. Our findings suggest that value and sensory information can exert simultaneous and dynamically countervailing influences on the trajectory of the accumulation-to-bound process, driving rapid, sensory-guided actions. |
Arash Afraz; Patrick Cavanagh The gender-specific face aftereffect is based in retinotopic not spatiotopic coordinates across several natural image transformations Journal Article Journal of Vision, 9 (10), pp. 1–17, 2009. @article{Afraz2009, title = {The gender-specific face aftereffect is based in retinotopic not spatiotopic coordinates across several natural image transformations}, author = {Arash Afraz and Patrick Cavanagh}, doi = {10.1167/9.10.10}, year = {2009}, date = {2009-01-01}, journal = {Journal of Vision}, volume = {9}, number = {10}, pages = {1--17}, abstract = {In four experiments, we measured the gender-specific face-aftereffect following subject's eye movement, head rotation, or head movement toward the display and following movement of the adapting stimulus itself to a new test location. In all experiments, the face aftereffect was strongest at the retinal position, orientation, and size of the adaptor. There was no advantage for the spatiotopic location in any experiment nor was there an advantage for the location newly occupied by the adapting face after it moved in the final experiment. Nevertheless, the aftereffect showed a broad gradient of transfer across location, orientation and size that, although centered on the retinotopic values of the adapting stimulus, covered ranges far exceeding the tuning bandwidths of neurons in early visual cortices. These results are consistent with a high-level site of adaptation (e.g. FFA) where units of face analysis have modest coverage of visual field, centered in retinotopic coordinates, but relatively broad tolerance for variations in size and orientation.}, keywords = {}, pubstate = {published}, tppubtype = {article} } In four experiments, we measured the gender-specific face-aftereffect following subject's eye movement, head rotation, or head movement toward the display and following movement of the adapting stimulus itself to a new test location. In all experiments, the face aftereffect was strongest at the retinal position, orientation, and size of the adaptor. There was no advantage for the spatiotopic location in any experiment nor was there an advantage for the location newly occupied by the adapting face after it moved in the final experiment. Nevertheless, the aftereffect showed a broad gradient of transfer across location, orientation and size that, although centered on the retinotopic values of the adapting stimulus, covered ranges far exceeding the tuning bandwidths of neurons in early visual cortices. These results are consistent with a high-level site of adaptation (e.g. FFA) where units of face analysis have modest coverage of visual field, centered in retinotopic coordinates, but relatively broad tolerance for variations in size and orientation. |
Zaeinab Afsari; José P Ossandón; Peter Konig The dynamic effect of reading direction habit on spatial asymmetry of image perception Journal Article Journal of Vision, 16 (11), pp. 1–21, 2016. @article{Afsari2016, title = {The dynamic effect of reading direction habit on spatial asymmetry of image perception}, author = {Zaeinab Afsari and José P Ossandón and Peter Konig}, doi = {10.1167/16.11.8.doi}, year = {2016}, date = {2016-01-01}, journal = {Journal of Vision}, volume = {16}, number = {11}, pages = {1--21}, abstract = {Exploration of images after stimulus onset is initially biased to the left. Here, we studied the causes of such an asymmetry and investigated effects of reading habits, text primes, and priming by systematically biased eye movements on this spatial bias in visual exploration. Bilinguals first read text primes with right- to-left (RTL) or left-to-right (LTR) reading directions and subsequently explored natural images. In Experiment 1, native RTL speakers showed a leftward free-viewing shift after reading LTR primes but a weaker rightward bias after reading RTL primes. This demonstrates that reading direction dynamically influences the spatial bias. However, native LTR speakers wholearnedanRTL languagelateinlife showed a leftward bias after reading either LTR or RTL primes, which suggests the role of habit formation in the production of the spatial bias. In Experiment 2, LTR bilinguals showed a slightly enhanced leftward bias after reading LTR text primes in their second language. This might contribute to the differences of native RTL and LTR speakers observed in Experiment 1. In Experiment 3, LTR bilinguals read normal (LTR, habitual reading) and mirrored left-to-right (mLTR, nonhabitual reading) texts. We observed a strong leftward bias in both cases, indicating that the bias direction is influenced by habitual reading direction and is not secondary to the actual reading direction. This is confirmed in Experiment 4, in which LTR participants were asked to follow RTL and LTR moving dots in prior image presentation and showed no change in the normal spatial bias. In conclusion, the horizontal bias is a dynamic property and is modulated by habitual reading direction. Introduction}, keywords = {}, pubstate = {published}, tppubtype = {article} } Exploration of images after stimulus onset is initially biased to the left. Here, we studied the causes of such an asymmetry and investigated effects of reading habits, text primes, and priming by systematically biased eye movements on this spatial bias in visual exploration. Bilinguals first read text primes with right- to-left (RTL) or left-to-right (LTR) reading directions and subsequently explored natural images. In Experiment 1, native RTL speakers showed a leftward free-viewing shift after reading LTR primes but a weaker rightward bias after reading RTL primes. This demonstrates that reading direction dynamically influences the spatial bias. However, native LTR speakers wholearnedanRTL languagelateinlife showed a leftward bias after reading either LTR or RTL primes, which suggests the role of habit formation in the production of the spatial bias. In Experiment 2, LTR bilinguals showed a slightly enhanced leftward bias after reading LTR text primes in their second language. This might contribute to the differences of native RTL and LTR speakers observed in Experiment 1. In Experiment 3, LTR bilinguals read normal (LTR, habitual reading) and mirrored left-to-right (mLTR, nonhabitual reading) texts. We observed a strong leftward bias in both cases, indicating that the bias direction is influenced by habitual reading direction and is not secondary to the actual reading direction. This is confirmed in Experiment 4, in which LTR participants were asked to follow RTL and LTR moving dots in prior image presentation and showed no change in the normal spatial bias. In conclusion, the horizontal bias is a dynamic property and is modulated by habitual reading direction. Introduction |
Zaeinab Afsari; Ashima Keshava; José P Ossandón; Peter König Interindividual differences among native right-to-left readers and native left-to-right readers during free viewing task Journal Article Visual Cognition, 26 (6), pp. 430–441, 2018. @article{Afsari2018, title = {Interindividual differences among native right-to-left readers and native left-to-right readers during free viewing task}, author = {Zaeinab Afsari and Ashima Keshava and José P Ossandón and Peter König}, doi = {10.1080/13506285.2018.1473542}, year = {2018}, date = {2018-01-01}, journal = {Visual Cognition}, volume = {26}, number = {6}, pages = {430--441}, abstract = {Human visual exploration is not homogeneous but displays spatial biases. Specifically, early after the onset of a visual stimulus, the majority of eye movements target the left visual space. This horizontal asymmetry of image exploration is rather robust with respect to multiple image manipulations, yet can be dynamically modulated by preceding text primes. This characteristic points to an involvement of reading habits in the deployment of visual attention. Here, we report data of native right-to-left (RTL) readers with a larger variation and stronger modulation of horizontal spatial bias in comparison to native left-to-right (LTR) readers after preceding text primes. To investigate the influences of biological and cultural factors, we measure the correlation of the modulation of the horizontal spatial bias for native RTL readers and native LTR readers with multiple factors: age, gender, second language proficiency, and age at which the second language was acquired. The results demonstrate only weak or no correlations between the magnitude of the horizontal bias and the previously mentioned factors. We conclude that the spatial bias of viewing behaviour for native RTL readers is more variable than for native LTR readers, and this variance could not be demonstrated to be associated with interindividual differences. We speculate the role of strength of habit and/or the interindividual differences in the structural and functional brain regions as a cause of the RTL spatial bias among RTL native readers.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Human visual exploration is not homogeneous but displays spatial biases. Specifically, early after the onset of a visual stimulus, the majority of eye movements target the left visual space. This horizontal asymmetry of image exploration is rather robust with respect to multiple image manipulations, yet can be dynamically modulated by preceding text primes. This characteristic points to an involvement of reading habits in the deployment of visual attention. Here, we report data of native right-to-left (RTL) readers with a larger variation and stronger modulation of horizontal spatial bias in comparison to native left-to-right (LTR) readers after preceding text primes. To investigate the influences of biological and cultural factors, we measure the correlation of the modulation of the horizontal spatial bias for native RTL readers and native LTR readers with multiple factors: age, gender, second language proficiency, and age at which the second language was acquired. The results demonstrate only weak or no correlations between the magnitude of the horizontal bias and the previously mentioned factors. We conclude that the spatial bias of viewing behaviour for native RTL readers is more variable than for native LTR readers, and this variance could not be demonstrated to be associated with interindividual differences. We speculate the role of strength of habit and/or the interindividual differences in the structural and functional brain regions as a cause of the RTL spatial bias among RTL native readers. |
Mehmet N Ağaoğlu; Michael H Herzog; Haluk Öğmen Field-like interactions between motion-based reference frames Journal Article Attention, Perception, and Psychophysics, 77 (6), pp. 2082–2097, 2015. @article{Agaoglu2015, title = {Field-like interactions between motion-based reference frames}, author = {Mehmet N Ağaoğlu and Michael H Herzog and Haluk Öğmen}, doi = {10.3758/s13414-015-0890-9}, year = {2015}, date = {2015-01-01}, journal = {Attention, Perception, and Psychophysics}, volume = {77}, number = {6}, pages = {2082--2097}, abstract = {A reference frame is required to specify how motion is perceived. For example, the motion ofpart ofan object is usually perceived relative to the motion of the object itself. Johansson (Psychological Research, 38,379–393, 1976)pro-posed that the perceptual system carries out a vector decomposition, which rewsults in common and relative motion percepts. Because vector decomposition is an ill-posed problem, several studies have introduced constraints by means ofwhich the number of solutions can be substantially reduced. Here, we have adopted an alternative approach and studied how, rather than why, a subset ofsolutions is selected by the visual system. We propose that each retinotopic motion vector creates a reference-frame field in the retinotopic space, and that the fields created by different motion vectors interact in order to determine a motion vector that will serve as the reference frame at a given point and time in space. To test this theory, we performed a set ofpsychophysical experiments. The field-like influence of motion-based reference frames was manifested by increased nonspatiotopic percepts of the backward motion of a target square with decreasing distance from a drifting grating. We then sought to determine whether these field-like effects ofmotion-based reference frames can also be extended to stationary landmarks. The results suggest that reference-field interactions occur only between motion-generated fields. Finally, we investigated whether and how different reference fields interact with each other, and found that different reference-field interactions are nonlinear and depend on how the motion vectors are grouped. These findings are discussed from the perspective ofthe reference-frame metric field (RFMF) theory, according to which perceptual grouping operations play a central and essential role in determining the prevailing reference frames.}, keywords = {}, pubstate = {published}, tppubtype = {article} } A reference frame is required to specify how motion is perceived. For example, the motion ofpart ofan object is usually perceived relative to the motion of the object itself. Johansson (Psychological Research, 38,379–393, 1976)pro-posed that the perceptual system carries out a vector decomposition, which rewsults in common and relative motion percepts. Because vector decomposition is an ill-posed problem, several studies have introduced constraints by means ofwhich the number of solutions can be substantially reduced. Here, we have adopted an alternative approach and studied how, rather than why, a subset ofsolutions is selected by the visual system. We propose that each retinotopic motion vector creates a reference-frame field in the retinotopic space, and that the fields created by different motion vectors interact in order to determine a motion vector that will serve as the reference frame at a given point and time in space. To test this theory, we performed a set ofpsychophysical experiments. The field-like influence of motion-based reference frames was manifested by increased nonspatiotopic percepts of the backward motion of a target square with decreasing distance from a drifting grating. We then sought to determine whether these field-like effects ofmotion-based reference frames can also be extended to stationary landmarks. The results suggest that reference-field interactions occur only between motion-generated fields. Finally, we investigated whether and how different reference fields interact with each other, and found that different reference-field interactions are nonlinear and depend on how the motion vectors are grouped. These findings are discussed from the perspective ofthe reference-frame metric field (RFMF) theory, according to which perceptual grouping operations play a central and essential role in determining the prevailing reference frames. |
Mehmet N Ağaoğlu; Michael H Herzog; Haluk Öğmen The effective reference frame in perceptual judgments of motion direction Journal Article Vision Research, 107 , pp. 101–112, 2015. @article{Agaoglu2015a, title = {The effective reference frame in perceptual judgments of motion direction}, author = {Mehmet N Ağaoğlu and Michael H Herzog and Haluk Öğmen}, doi = {10.1016/j.visres.2014.12.009}, year = {2015}, date = {2015-01-01}, journal = {Vision Research}, volume = {107}, pages = {101--112}, abstract = {The retinotopic projection of stimulus motion depends both on the motion of the stimulus and the movements of the observer. In this study, we aimed to quantify the contributions of endogenous (retinotopic) and exogenous (spatiotopic and motion-based) reference frames on judgments of motion direction. We used a variant of the induced motion paradigm and we created different experimental conditions in which the predictions of each reference frame were different. Finally, assuming additive contributions from different reference frames, we used a linear model to account for the data. Our results suggest that the effective reference frame for motion perception emerges from an amalgamation of motion-based, retinotopic and spatiotopic reference frames. In determining the percept, the influence of relative motion, defined by a motion-based reference frame, dominates those of retinotopic and spatiotopic motions within a finite region. We interpret these findings within the context of the Reference Frame Metric Field (RFMF) theory, which states that local motion vectors might have perceptual reference-frame fields associated with them, and interactions between these fields determine the selection of the effective reference frame.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The retinotopic projection of stimulus motion depends both on the motion of the stimulus and the movements of the observer. In this study, we aimed to quantify the contributions of endogenous (retinotopic) and exogenous (spatiotopic and motion-based) reference frames on judgments of motion direction. We used a variant of the induced motion paradigm and we created different experimental conditions in which the predictions of each reference frame were different. Finally, assuming additive contributions from different reference frames, we used a linear model to account for the data. Our results suggest that the effective reference frame for motion perception emerges from an amalgamation of motion-based, retinotopic and spatiotopic reference frames. In determining the percept, the influence of relative motion, defined by a motion-based reference frame, dominates those of retinotopic and spatiotopic motions within a finite region. We interpret these findings within the context of the Reference Frame Metric Field (RFMF) theory, which states that local motion vectors might have perceptual reference-frame fields associated with them, and interactions between these fields determine the selection of the effective reference frame. |
Mehmet N Ağaoğlu; Susana T L Chung Can (should) theories of crowding be unified? Journal Article Journal of Vision, 16 (15), pp. 1–22, 2016. @article{Agaoglu2016, title = {Can (should) theories of crowding be unified?}, author = {Mehmet N Ağaoğlu and Susana T L Chung}, doi = {10.1167/16.15.10}, year = {2016}, date = {2016-01-01}, journal = {Journal of Vision}, volume = {16}, number = {15}, pages = {1--22}, abstract = {Objects in clutter are difficult to recognize, a phenomenon known as crowding. There is little consensus on the underlying mechanisms of crowding, and a large number of models have been proposed. There have also been attempts at unifying the explanations of crowding under a single model, such as the weighted feature model of Harrison and Bex (2015) and the texture synthesis model of Rosenholtz and colleagues (Balas, Nakano, & Rosenholtz, 2009; Keshvari & Rosenholtz, 2016). The goal of this work was to test various models of crowding and to assess whether a unifying account can be developed. Adopting Harrison and Bex's (2015) experimental paradigm, we asked observers to report the orientation of two concentric C-stimuli. Contrary to the predictions of their model, observers' recognition accuracy was worse for the inner C-stimulus. In addition, we demonstrated that the stimulus paradigm used by Harrison and Bex has a crucial confounding factor, eccentricity, which limits its usage to a very narrow range of stimulus parameters. Nevertheless, reporting the orientations of both C-stimuli in this paradigm proved very useful in pitting different crowding models against each other. Specifically, we tested deterministic and probabilistic versions of averaging, substitution, and attentional resolution models as well as the texture synthesis model. None of the models alone was able to explain the entire set of data. Based on these findings, we discuss whether the explanations of crowding can (should) be unified.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Objects in clutter are difficult to recognize, a phenomenon known as crowding. There is little consensus on the underlying mechanisms of crowding, and a large number of models have been proposed. There have also been attempts at unifying the explanations of crowding under a single model, such as the weighted feature model of Harrison and Bex (2015) and the texture synthesis model of Rosenholtz and colleagues (Balas, Nakano, & Rosenholtz, 2009; Keshvari & Rosenholtz, 2016). The goal of this work was to test various models of crowding and to assess whether a unifying account can be developed. Adopting Harrison and Bex's (2015) experimental paradigm, we asked observers to report the orientation of two concentric C-stimuli. Contrary to the predictions of their model, observers' recognition accuracy was worse for the inner C-stimulus. In addition, we demonstrated that the stimulus paradigm used by Harrison and Bex has a crucial confounding factor, eccentricity, which limits its usage to a very narrow range of stimulus parameters. Nevertheless, reporting the orientations of both C-stimuli in this paradigm proved very useful in pitting different crowding models against each other. Specifically, we tested deterministic and probabilistic versions of averaging, substitution, and attentional resolution models as well as the texture synthesis model. None of the models alone was able to explain the entire set of data. Based on these findings, we discuss whether the explanations of crowding can (should) be unified. |
Mehmet N Ağaoğlu; Aaron M Clarke; Michael H Herzog; Haluk Ögmen Motion-based nearest vector metric for reference frame selection in the perception of motion Journal Article Journal of Vision, 16 (7), pp. 1–16, 2016. @article{Agaoglu2016a, title = {Motion-based nearest vector metric for reference frame selection in the perception of motion}, author = {Mehmet N Ağaoğlu and Aaron M Clarke and Michael H Herzog and Haluk Ögmen}, doi = {10.1167/16.7.14}, year = {2016}, date = {2016-01-01}, journal = {Journal of Vision}, volume = {16}, number = {7}, pages = {1--16}, abstract = {We investigated how the visual system selects a reference frame for the perception of motion. Two concentric arcs underwent circular motion around the center of the display, where observers fixated. The outer (target) arc's angular velocity profile was modulated by a sine wave midflight whereas the inner (reference) arc moved at a constant angular speed. The task was to report whether the target reversed its direction of motion at any point during its motion. We investigated the effects of spatial and figural factors by systematically varying the radial and angular distances between the arcs, and their relative sizes. We found that the effectiveness of the reference frame decreases with increasing radial- and angular-distance measures. Drastic changes in the relative sizes of the arcs did not influence motion reversal thresholds, suggesting no influence of stimulus form on perceived motion. We also investigated the effect of common velocity by introducing velocity fluctuations to the reference arc as well. We found no effect of whether or not a reference frame has a constant motion. We examined several form- and motion-based metrics, which could potentially unify our findings. We found that a motion-based nearest vector metric can fully account for all the data reported here. These findings suggest that the selection of reference frames for motion processing does not result from a winner-take-all process, but instead, can be explained by a field whose strength decreases with the distance between the nearest motion vectors regardless of the form of the moving objects.}, keywords = {}, pubstate = {published}, tppubtype = {article} } We investigated how the visual system selects a reference frame for the perception of motion. Two concentric arcs underwent circular motion around the center of the display, where observers fixated. The outer (target) arc's angular velocity profile was modulated by a sine wave midflight whereas the inner (reference) arc moved at a constant angular speed. The task was to report whether the target reversed its direction of motion at any point during its motion. We investigated the effects of spatial and figural factors by systematically varying the radial and angular distances between the arcs, and their relative sizes. We found that the effectiveness of the reference frame decreases with increasing radial- and angular-distance measures. Drastic changes in the relative sizes of the arcs did not influence motion reversal thresholds, suggesting no influence of stimulus form on perceived motion. We also investigated the effect of common velocity by introducing velocity fluctuations to the reference arc as well. We found no effect of whether or not a reference frame has a constant motion. We examined several form- and motion-based metrics, which could potentially unify our findings. We found that a motion-based nearest vector metric can fully account for all the data reported here. These findings suggest that the selection of reference frames for motion processing does not result from a winner-take-all process, but instead, can be explained by a field whose strength decreases with the distance between the nearest motion vectors regardless of the form of the moving objects. |
Mehmet N Ağaoğlu; Haluk Öğmen; Susana T L Chung Unmasking saccadic uncrowding Journal Article Vision Research, 127 , pp. 152–164, 2016. @article{Agaoglu2016b, title = {Unmasking saccadic uncrowding}, author = {Mehmet N Ağaoğlu and Haluk Öğmen and Susana T L Chung}, doi = {10.1016/j.visres.2016.08.003}, year = {2016}, date = {2016-01-01}, journal = {Vision Research}, volume = {127}, pages = {152--164}, abstract = {Stimuli that are briefly presented around the time of saccades are often perceived with spatiotemporal distortions. These distortions do not always have deleterious effects on the visibility and identification of a stimulus. Recent studies reported that when a stimulus is the target of an intended saccade, it is released from both masking and crowding. Here, we investigated pre-saccadic changes in single and crowded letter recognition performance in the absence (Experiment 1) and the presence (Experiment 2) of backward masks to determine the extent to which saccadic “uncrowding” and “unmasking” mechanisms are similar. Our results show that pre-saccadic improvements in letter recognition performance are mostly due to the presence of masks and/or stimulus transients which occur after the target is presented. More importantly, we did not find any decrease in crowding strength before impending saccades. A simplified version of a dual-channel neural model, originally proposed to explain masking phenomena, with several saccadic add-on mechanisms, could account for our results in Experiment 1. However, this model falls short in explaining how saccades drastically reduced the effect of backward masking (Experiment 2). The addition of a remapping mechanism that alters the relative spatial positions of stimuli was needed to fully account for the improvements observed when backward masks followed the letter stimuli. Taken together, our results (i) are inconsistent with saccadic uncrowding, (ii) strongly support saccadic unmasking, and (iii) suggest that pre-saccadic letter recognition is modulated by multiple perisaccadic mechanisms with different time courses.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Stimuli that are briefly presented around the time of saccades are often perceived with spatiotemporal distortions. These distortions do not always have deleterious effects on the visibility and identification of a stimulus. Recent studies reported that when a stimulus is the target of an intended saccade, it is released from both masking and crowding. Here, we investigated pre-saccadic changes in single and crowded letter recognition performance in the absence (Experiment 1) and the presence (Experiment 2) of backward masks to determine the extent to which saccadic “uncrowding” and “unmasking” mechanisms are similar. Our results show that pre-saccadic improvements in letter recognition performance are mostly due to the presence of masks and/or stimulus transients which occur after the target is presented. More importantly, we did not find any decrease in crowding strength before impending saccades. A simplified version of a dual-channel neural model, originally proposed to explain masking phenomena, with several saccadic add-on mechanisms, could account for our results in Experiment 1. However, this model falls short in explaining how saccades drastically reduced the effect of backward masking (Experiment 2). The addition of a remapping mechanism that alters the relative spatial positions of stimuli was needed to fully account for the improvements observed when backward masks followed the letter stimuli. Taken together, our results (i) are inconsistent with saccadic uncrowding, (ii) strongly support saccadic unmasking, and (iii) suggest that pre-saccadic letter recognition is modulated by multiple perisaccadic mechanisms with different time courses. |
Mehmet N Ağaoğlu; Susana T L Chung Interaction between stimulus contrast and pre-saccadic crowding Journal Article Royal Society Open Science, 4 (2), pp. 1–17, 2017. @article{Agaoglu2017, title = {Interaction between stimulus contrast and pre-saccadic crowding}, author = {Mehmet N Ağaoğlu and Susana T L Chung}, doi = {10.1098/rsos.160559}, year = {2017}, date = {2017-01-01}, journal = {Royal Society Open Science}, volume = {4}, number = {2}, pages = {1--17}, abstract = {Objects that are briefly flashed around the time of saccades are mislocalized. Previously, robust interactions between saccadic perceptual distortions and stimulus contrast have been reported. It is also known that crowding depends on the contrast of the target and flankers. Here, we investigated how stimulus contrast and crowding interact with pre-saccadic perception. We asked observers to report the orientation of a tilted Gabor presented in the periphery, with or without four flanking vertically oriented Gabors. Observers performed the task either following a saccade or while maintaining fixation. Contrasts of the target and flankers were independently set to either high or low, with equal probability. In both the fixation and saccade conditions, the flanked conditions resulted in worse discrimination performance—the crowding effect. In the unflanked saccade trials, performance significantly decreased with target-to-saccade onset for low-contrast targets but not for high-contrast targets. In the presence of flankers, impending saccades reduced performance only for low-contrast, but not for high-contrast flankers. Interestingly, average performance in the fixation and saccade conditions was mostly similar in all contrast conditions. Moreover, the magnitude of crowding was influenced by saccades only when the target had high contrast and the flankers had low contrasts. Overall, our results are consistent with modulation of perisaccadic spatial localization by contrast and saccadic suppression, but at odds with a recent report of pre-saccadic release of crowding.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Objects that are briefly flashed around the time of saccades are mislocalized. Previously, robust interactions between saccadic perceptual distortions and stimulus contrast have been reported. It is also known that crowding depends on the contrast of the target and flankers. Here, we investigated how stimulus contrast and crowding interact with pre-saccadic perception. We asked observers to report the orientation of a tilted Gabor presented in the periphery, with or without four flanking vertically oriented Gabors. Observers performed the task either following a saccade or while maintaining fixation. Contrasts of the target and flankers were independently set to either high or low, with equal probability. In both the fixation and saccade conditions, the flanked conditions resulted in worse discrimination performance—the crowding effect. In the unflanked saccade trials, performance significantly decreased with target-to-saccade onset for low-contrast targets but not for high-contrast targets. In the presence of flankers, impending saccades reduced performance only for low-contrast, but not for high-contrast flankers. Interestingly, average performance in the fixation and saccade conditions was mostly similar in all contrast conditions. Moreover, the magnitude of crowding was influenced by saccades only when the target had high contrast and the flankers had low contrasts. Overall, our results are consistent with modulation of perisaccadic spatial localization by contrast and saccadic suppression, but at odds with a recent report of pre-saccadic release of crowding. |
Stephen J Agauas; Laura E Thomas Change detection for real-world objects in perihand space Journal Article Attention, Perception, and Psychophysics, 81 (7), pp. 2365–2383, 2019. @article{Agauas2019, title = {Change detection for real-world objects in perihand space}, author = {Stephen J Agauas and Laura E Thomas}, doi = {10.3758/s13414-019-01820-6}, year = {2019}, date = {2019-01-01}, journal = {Attention, Perception, and Psychophysics}, volume = {81}, number = {7}, pages = {2365--2383}, publisher = {Attention, Perception, & Psychophysics}, abstract = {Recent evidence has demonstrated that observers experience visual-processing biases in perihand space that may be tied to the hands' relevance for grasping actions. Our previous work suggested that when the hands are positioned to afford a power-grasp action, observers show increased temporal sensitivity that could aid with fast and forceful action, whereas when the hands are instead at the ready to perform a precision-grasp action, observers show enhanced spatial sensitivity that benefits delicate and detail-oriented actions. In the present investigation we seek to extend these previous findings by examining how object affordances may interact with hand positioning to shape visual biases in perihand space. Across three experiments, we examined how long participants took to perform a change detection task on photos of real objects, while we manipulated hand position (near/far from display), grasp posture (power/precision), and change type (orientation/identity). Participants viewed objects that afforded either a power grasp or a precision grasp, or were ungraspable. Although we were unable to uncover evidence of altered vision in perihand space in our first experiment, mirroring previous findings, in Experiments 2 and 3 our participants showed grasp-dependent biases near the hands when detecting changes to target objects that afforded a power grasp. Interestingly, ungraspable target objects were not subject to the same perihand space biases. Taken together, our results suggest that the influence of hand position on change detection performance is mediated not only by the hands' grasp posture, but also by a target object's affordances for grasping.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Recent evidence has demonstrated that observers experience visual-processing biases in perihand space that may be tied to the hands' relevance for grasping actions. Our previous work suggested that when the hands are positioned to afford a power-grasp action, observers show increased temporal sensitivity that could aid with fast and forceful action, whereas when the hands are instead at the ready to perform a precision-grasp action, observers show enhanced spatial sensitivity that benefits delicate and detail-oriented actions. In the present investigation we seek to extend these previous findings by examining how object affordances may interact with hand positioning to shape visual biases in perihand space. Across three experiments, we examined how long participants took to perform a change detection task on photos of real objects, while we manipulated hand position (near/far from display), grasp posture (power/precision), and change type (orientation/identity). Participants viewed objects that afforded either a power grasp or a precision grasp, or were ungraspable. Although we were unable to uncover evidence of altered vision in perihand space in our first experiment, mirroring previous findings, in Experiments 2 and 3 our participants showed grasp-dependent biases near the hands when detecting changes to target objects that afforded a power grasp. Interestingly, ungraspable target objects were not subject to the same perihand space biases. Taken together, our results suggest that the influence of hand position on change detection performance is mediated not only by the hands' grasp posture, but also by a target object's affordances for grasping. |
Elena Aggius-Vella; Monica Gori; Silvia Animali; Claudio Campus; Paola Binda Non-spatial skills differ in the front and rear peri-personal space Journal Article Neuropsychologia, 147 , pp. 1–8, 2020. @article{AggiusVella2020, title = {Non-spatial skills differ in the front and rear peri-personal space}, author = {Elena Aggius-Vella and Monica Gori and Silvia Animali and Claudio Campus and Paola Binda}, doi = {10.1016/j.neuropsychologia.2020.107619}, year = {2020}, date = {2020-01-01}, journal = {Neuropsychologia}, volume = {147}, pages = {1--8}, publisher = {Elsevier Ltd}, abstract = {In measuring behavioural and pupillary responses to auditory oddball stimuli delivered in the front and rear peri-personal space, we find that pupils dilate in response to rare stimuli, both target and distracters. Dilation in response to targets is stronger than the response to distracters, implying a task relevance effect on pupil responses. Crucially, pupil dilation in response to targets is also selectively modulated by the location of sound sources: stronger in the front than in the rear peri-personal space, in spite of matching behavioural performance. This supports the concept that even non-spatial skills, such as the ability to alert in response to behaviourally relevant events, are differentially engaged across subregions of the peri-personal space.}, keywords = {}, pubstate = {published}, tppubtype = {article} } In measuring behavioural and pupillary responses to auditory oddball stimuli delivered in the front and rear peri-personal space, we find that pupils dilate in response to rare stimuli, both target and distracters. Dilation in response to targets is stronger than the response to distracters, implying a task relevance effect on pupil responses. Crucially, pupil dilation in response to targets is also selectively modulated by the location of sound sources: stronger in the front than in the rear peri-personal space, in spite of matching behavioural performance. This supports the concept that even non-spatial skills, such as the ability to alert in response to behaviourally relevant events, are differentially engaged across subregions of the peri-personal space. |
Dimitris Agrafiotis; Nishan Canagarajah; David R Bull; Matthew Dye Perceptually optimised sign language video coding based on eye tracking analysis Journal Article Electronics Letters, 39 , pp. 1–2, 2003. @article{Agrafiotis2003, title = {Perceptually optimised sign language video coding based on eye tracking analysis}, author = {Dimitris Agrafiotis and Nishan Canagarajah and David R Bull and Matthew Dye}, doi = {10.1049/el}, year = {2003}, date = {2003-01-01}, journal = {Electronics Letters}, volume = {39}, pages = {1--2}, abstract = {A perceptually optimised approach to sign language video coding is presented. The proposed approach is based on the results (included) of an eye tracking study in the visual attention of sign language viewers. Results show reductions in bit rate of over 30% with very good subjective quality.}, keywords = {}, pubstate = {published}, tppubtype = {article} } A perceptually optimised approach to sign language video coding is presented. The proposed approach is based on the results (included) of an eye tracking study in the visual attention of sign language viewers. Results show reductions in bit rate of over 30% with very good subjective quality. |
Dimitris Agrafiotis; Nishan Canagarajah; David R Bull; Jim Kyle; Helen Seers; Matthew Dye A perceptually optimised video coding system for sign language communication at low bit rates Journal Article Signal Processing: Image Communication, 21 (7), pp. 531–549, 2006. @article{Agrafiotis2006, title = {A perceptually optimised video coding system for sign language communication at low bit rates}, author = {Dimitris Agrafiotis and Nishan Canagarajah and David R Bull and Jim Kyle and Helen Seers and Matthew Dye}, doi = {10.1016/j.image.2006.02.003}, year = {2006}, date = {2006-01-01}, journal = {Signal Processing: Image Communication}, volume = {21}, number = {7}, pages = {531--549}, abstract = {The ability to communicate remotely through the use of video as promised by wireless networks and already practised over fixed networks, is for deaf people as important as voice telephony is for hearing people. Sign languages are visual-spatial languages and as such demand good image quality for interaction and understanding. In this paper, we first analyse the sign language viewer's eye-gaze, based on the results of an eye-tracking study that we conducted, as well as the video content involved in sign language person-to-person communication. Based on this analysis we propose a sign language video coding system using foveated processing, which can lead to bit rate savings without compromising the comprehension of the coded sequence or equivalently produce a coded sequence with higher comprehension value at the same bit rate. We support this claim with the results of an initial comprehension assessment trial of such coded sequences by deaf users. The proposed system constitutes a new paradigm for coding sign language image sequences at limited bit rates. textcopyright 2006 Elsevier B.V. All rights reserved.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The ability to communicate remotely through the use of video as promised by wireless networks and already practised over fixed networks, is for deaf people as important as voice telephony is for hearing people. Sign languages are visual-spatial languages and as such demand good image quality for interaction and understanding. In this paper, we first analyse the sign language viewer's eye-gaze, based on the results of an eye-tracking study that we conducted, as well as the video content involved in sign language person-to-person communication. Based on this analysis we propose a sign language video coding system using foveated processing, which can lead to bit rate savings without compromising the comprehension of the coded sequence or equivalently produce a coded sequence with higher comprehension value at the same bit rate. We support this claim with the results of an initial comprehension assessment trial of such coded sequences by deaf users. The proposed system constitutes a new paradigm for coding sign language image sequences at limited bit rates. textcopyright 2006 Elsevier B.V. All rights reserved. |
D Agrafiotis; S J C Davies; N Canagarajah; D R Bull Towards efficient context-specific video coding based on gaze-tracking analysis Journal Article ACM Transactions on Multimedia Computing, Communications and Applications, 3 (4), pp. 1–15, 2007. @article{Agrafiotis2007, title = {Towards efficient context-specific video coding based on gaze-tracking analysis}, author = {D Agrafiotis and S J C Davies and N Canagarajah and D R Bull}, doi = {10.1145/1314303.1314307}, year = {2007}, date = {2007-01-01}, journal = {ACM Transactions on Multimedia Computing, Communications and Applications}, volume = {3}, number = {4}, pages = {1--15}, abstract = {This article discusses a framework for model-based, context-dependent video coding based on exploitation of characteristics of the human visual system. The system utilizes variable-quality coding based on priority maps which are created using mostly context-dependent rules. The technique is demonstrated through two case studies of specific video context, namely open signed content and football sequences. Eye-tracking analysis is employed for identifying the characteristics of each context, which are subsequently exploited for coding purposes, either directly or through a gaze prediction model. The framework is shown to achieve a considerable improvement in coding efficiency.}, keywords = {}, pubstate = {published}, tppubtype = {article} } This article discusses a framework for model-based, context-dependent video coding based on exploitation of characteristics of the human visual system. The system utilizes variable-quality coding based on priority maps which are created using mostly context-dependent rules. The technique is demonstrated through two case studies of specific video context, namely open signed content and football sequences. Eye-tracking analysis is employed for identifying the characteristics of each context, which are subsequently exploited for coding purposes, either directly or through a gaze prediction model. The framework is shown to achieve a considerable improvement in coding efficiency. |
Ioannis Agtzidis; Inga Meyhöfer; Michael Dorr; Rebekka Lencer Following Forrest Gump: Smooth pursuit related brain activation during free movie viewing Journal Article NeuroImage, 216 , pp. 1–11, 2020. @article{Agtzidis2020, title = {Following Forrest Gump: Smooth pursuit related brain activation during free movie viewing}, author = {Ioannis Agtzidis and Inga Meyhöfer and Michael Dorr and Rebekka Lencer}, doi = {10.1016/j.neuroimage.2019.116491}, year = {2020}, date = {2020-01-01}, journal = {NeuroImage}, volume = {216}, pages = {1--11}, abstract = {Most fMRI studies investigating smooth pursuit (SP) related brain activity have used simple synthetic stimuli such as a sinusoidally moving dot. However, real-life situations are much more complex and SP does not occur in isolation but within sequences of saccades and fixations. This raises the question whether the same brain networks for SP that have been identified under laboratory conditions are activated when following moving objects in a movie. Here, we used the publicly available studyforrest data set that provides eye movement recordings along with 3 T fMRI recordings from 15 subjects while watching the Hollywood movie “Forrest Gump”. All three major eye movement events, namely fixations, saccades, and smooth pursuit, were detected with a state-of-the-art algorithm. In our analysis, smooth pursuit (SP) was the eye movement of interest, while saccades were acting as the steady state of viewing behaviour due to their lower variability. For the fMRI analysis we used an event-related design modelling saccades and SP as regressors initially. Because of the interdependency of SP and content motion, we then added a new low-level content motion regressor to separate brain activations from these two sources. We identified higher BOLD-responses during SP than saccades bilaterally in MT+/V5, in middle cingulate extending to precuneus, and in the right temporoparietal junction. When the motion regressor was added, SP showed higher BOLD-response relative to saccades bilaterally in the cortex lining the superior temporal sulcus, precuneus, and supplementary eye field, presumably due to a confounding effect of background motion. Only parts of V2 showed higher activation during saccades in comparison to SP. Taken together, our approach should be regarded as proof of principle for deciphering brain activity related to SP, which is one of the most prominent eye movements besides saccades, in complex dynamic naturalistic situations.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Most fMRI studies investigating smooth pursuit (SP) related brain activity have used simple synthetic stimuli such as a sinusoidally moving dot. However, real-life situations are much more complex and SP does not occur in isolation but within sequences of saccades and fixations. This raises the question whether the same brain networks for SP that have been identified under laboratory conditions are activated when following moving objects in a movie. Here, we used the publicly available studyforrest data set that provides eye movement recordings along with 3 T fMRI recordings from 15 subjects while watching the Hollywood movie “Forrest Gump”. All three major eye movement events, namely fixations, saccades, and smooth pursuit, were detected with a state-of-the-art algorithm. In our analysis, smooth pursuit (SP) was the eye movement of interest, while saccades were acting as the steady state of viewing behaviour due to their lower variability. For the fMRI analysis we used an event-related design modelling saccades and SP as regressors initially. Because of the interdependency of SP and content motion, we then added a new low-level content motion regressor to separate brain activations from these two sources. We identified higher BOLD-responses during SP than saccades bilaterally in MT+/V5, in middle cingulate extending to precuneus, and in the right temporoparietal junction. When the motion regressor was added, SP showed higher BOLD-response relative to saccades bilaterally in the cortex lining the superior temporal sulcus, precuneus, and supplementary eye field, presumably due to a confounding effect of background motion. Only parts of V2 showed higher activation during saccades in comparison to SP. Taken together, our approach should be regarded as proof of principle for deciphering brain activity related to SP, which is one of the most prominent eye movements besides saccades, in complex dynamic naturalistic situations. |
Luis Aguado; Karisa B Parkington; Teresa Dieguez-Risco; José A Hinojosa; Roxane J Itier Joint modulation of facial expression processing by contextual congruency and task demands Journal Article Brain Sciences, 9 , pp. 1–20, 2019. @article{Aguado2019, title = {Joint modulation of facial expression processing by contextual congruency and task demands}, author = {Luis Aguado and Karisa B Parkington and Teresa Dieguez-Risco and José A Hinojosa and Roxane J Itier}, doi = {10.3390/brainsci9050116}, year = {2019}, date = {2019-01-01}, journal = {Brain Sciences}, volume = {9}, pages = {1--20}, abstract = {Faces showing expressions of happiness or anger were presented together with sentences that described happiness-inducing or anger-inducing situations. Two main variables were manipulated: (i) congruency between contexts and expressions (congruent/incongruent) and (ii) the task assigned to the participant, discriminating the emotion shown by the target face (emotion task) or judging whether the expression shown by the face was congruent or not with the context (congruency task). Behavioral and electrophysiological results (event-related potentials (ERP)) showed that processing facial expressions was jointly influenced by congruency and task demands. ERP results revealed task effects at frontal sites, with larger positive amplitudes between 250–450 ms in the congruency task, reflecting the higher cognitive effort required by this task. Effects of congruency appeared at latencies and locations corresponding to the early posterior negativity (EPN) and late positive potential (LPP) components that have previously been found to be sensitive to emotion and affective congruency. The magnitude and spatial distribution of the congruency effects varied depending on the task and the target expression. These results are discussed in terms of the modulatory role of context on facial expression processing and the different mechanisms underlying the processing of expressions of positive and negative emotions.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Faces showing expressions of happiness or anger were presented together with sentences that described happiness-inducing or anger-inducing situations. Two main variables were manipulated: (i) congruency between contexts and expressions (congruent/incongruent) and (ii) the task assigned to the participant, discriminating the emotion shown by the target face (emotion task) or judging whether the expression shown by the face was congruent or not with the context (congruency task). Behavioral and electrophysiological results (event-related potentials (ERP)) showed that processing facial expressions was jointly influenced by congruency and task demands. ERP results revealed task effects at frontal sites, with larger positive amplitudes between 250–450 ms in the congruency task, reflecting the higher cognitive effort required by this task. Effects of congruency appeared at latencies and locations corresponding to the early posterior negativity (EPN) and late positive potential (LPP) components that have previously been found to be sensitive to emotion and affective congruency. The magnitude and spatial distribution of the congruency effects varied depending on the task and the target expression. These results are discussed in terms of the modulatory role of context on facial expression processing and the different mechanisms underlying the processing of expressions of positive and negative emotions. |
Jordi Aguila; Javier Cudeiro; Casto Rivadulla Effects of static magnetic fields on the visual cortex: Reversible visual deficits and reduction of neuronal activity Journal Article Cerebral Cortex, 26 (2), pp. 628–638, 2016. @article{Aguila2016, title = {Effects of static magnetic fields on the visual cortex: Reversible visual deficits and reduction of neuronal activity}, author = {Jordi Aguila and Javier Cudeiro and Casto Rivadulla}, doi = {10.1093/cercor/bhu228}, year = {2016}, date = {2016-01-01}, journal = {Cerebral Cortex}, volume = {26}, number = {2}, pages = {628--638}, abstract = {Noninvasive brain stimulation techniques have been successfully used to modulate brain activity, have become a highly useful tool in basic and clinical research and, recently, have attracted increased attention due to their putative use as a method for neuro-enhancement. In this scenario, transcranial static magnetic stimulation (SMS) of moderate strength might represent an affordable, simple, and complementary method to other procedures, such as Transcranial Magnetic Stimulation or direct current stimulation, but its mechanisms and effects are not thoroughly understood. In this study, we show that static magnetic fields applied to visual cortex of awake primates cause reversible deficits in a visual detection task. Complementary experiments in anesthetized cats show that the visual deficits are a consequence of a strong reduction in neural activity. These results demonstrate that SMS is able to effectively modulate neuronal activity and could be considered to be a tool to be used for different purposes ranging from experimental studies to clinical applications.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Noninvasive brain stimulation techniques have been successfully used to modulate brain activity, have become a highly useful tool in basic and clinical research and, recently, have attracted increased attention due to their putative use as a method for neuro-enhancement. In this scenario, transcranial static magnetic stimulation (SMS) of moderate strength might represent an affordable, simple, and complementary method to other procedures, such as Transcranial Magnetic Stimulation or direct current stimulation, but its mechanisms and effects are not thoroughly understood. In this study, we show that static magnetic fields applied to visual cortex of awake primates cause reversible deficits in a visual detection task. Complementary experiments in anesthetized cats show that the visual deficits are a consequence of a strong reduction in neural activity. These results demonstrate that SMS is able to effectively modulate neuronal activity and could be considered to be a tool to be used for different purposes ranging from experimental studies to clinical applications. |
Jordi Aguila; Javier F Cudeiro; Casto Rivadulla Cerebral Cortex, 27 (6), pp. 3331–3345, 2017. @article{Aguila2017, title = {Suppression of V1 feedback produces a shift in the topographic representation of receptive fields of LGN cells by unmasking latent retinal drives}, author = {Jordi Aguila and Javier F Cudeiro and Casto Rivadulla}, doi = {10.1093/cercor/bhx071}, year = {2017}, date = {2017-01-01}, journal = {Cerebral Cortex}, volume = {27}, number = {6}, pages = {3331--3345}, abstract = {In awake monkeys, we used repetitive transcranial magnetic stimulation (rTMS) to focally inactivate visual cortex while measuring the responsiveness of parvocellular lateral geniculate nucleus (LGN) neurons. Effects were noted in 64/75 neurons, and could be divided into 2 main groups: (1) for 39 neurons, visual responsiveness decreased and visual latency increased without apparent shift in receptive field (RF) position and (2) a second group (n = 25, 33% of the recorded cells) whose excitability was not compromised, but whose RF position shifted an average of 4.5°. This change is related to the retinotopic correspondence observed between the recorded thalamic area and the affected cortical zone. The effect of inactivation for this group of neurons was compatible with silencing the original retinal drive and unmasking a second latent retinal drive onto the studied neuron. These results indicate novel and remarkable dynamics in thalamocortical circuitry that force us to reassess constraints on retinogeniculate transmission.}, keywords = {}, pubstate = {published}, tppubtype = {article} } In awake monkeys, we used repetitive transcranial magnetic stimulation (rTMS) to focally inactivate visual cortex while measuring the responsiveness of parvocellular lateral geniculate nucleus (LGN) neurons. Effects were noted in 64/75 neurons, and could be divided into 2 main groups: (1) for 39 neurons, visual responsiveness decreased and visual latency increased without apparent shift in receptive field (RF) position and (2) a second group (n = 25, 33% of the recorded cells) whose excitability was not compromised, but whose RF position shifted an average of 4.5°. This change is related to the retinotopic correspondence observed between the recorded thalamic area and the affected cortical zone. The effect of inactivation for this group of neurons was compatible with silencing the original retinal drive and unmasking a second latent retinal drive onto the studied neuron. These results indicate novel and remarkable dynamics in thalamocortical circuitry that force us to reassess constraints on retinogeniculate transmission. |
Carlos Aguilar; Eric Castet Gaze-contingent simulation of retinopathy: Some potential pitfalls and remedies Journal Article Vision Research, 51 (9), pp. 997–1012, 2011. @article{Aguilar2011, title = {Gaze-contingent simulation of retinopathy: Some potential pitfalls and remedies}, author = {Carlos Aguilar and Eric Castet}, doi = {10.1016/j.visres.2011.02.010}, year = {2011}, date = {2011-01-01}, journal = {Vision Research}, volume = {51}, number = {9}, pages = {997--1012}, publisher = {Elsevier Ltd}, abstract = {Many important results in visual neuroscience rely on the use of gaze-contingent retinal stabilization techniques. Our work focuses on the important fraction of these studies that is concerned with the retinal stabilization of visual filters that degrade some specific portions of the visual field. For instance, macular scotomas, often induced by age related macular degeneration, can be simulated by continuously displaying a gaze-contingent mask in the center of the visual field. The gaze-contingent rules used in most of these studies imply only a very minimal processing of ocular data. By analyzing the relationship between gaze and scotoma locations for different oculo-motor patterns, we show that such a minimal processing might have adverse perceptual and oculomotor consequences due mainly to two potential problems: (a) a transient blink-induced motion of the scotoma while gaze is static, and (b) the intrusion of post-saccadic slow eye movements. We have developed new gaze-contingent rules to solve these two problems. We have also suggested simple ways of tackling two unrecognized problems that are a potential source of mismatch between gaze and scotoma locations. Overall, the present work should help design, describe and test the paradigms used to simulate retinopathy with gaze-contingent displays.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Many important results in visual neuroscience rely on the use of gaze-contingent retinal stabilization techniques. Our work focuses on the important fraction of these studies that is concerned with the retinal stabilization of visual filters that degrade some specific portions of the visual field. For instance, macular scotomas, often induced by age related macular degeneration, can be simulated by continuously displaying a gaze-contingent mask in the center of the visual field. The gaze-contingent rules used in most of these studies imply only a very minimal processing of ocular data. By analyzing the relationship between gaze and scotoma locations for different oculo-motor patterns, we show that such a minimal processing might have adverse perceptual and oculomotor consequences due mainly to two potential problems: (a) a transient blink-induced motion of the scotoma while gaze is static, and (b) the intrusion of post-saccadic slow eye movements. We have developed new gaze-contingent rules to solve these two problems. We have also suggested simple ways of tackling two unrecognized problems that are a potential source of mismatch between gaze and scotoma locations. Overall, the present work should help design, describe and test the paradigms used to simulate retinopathy with gaze-contingent displays. |
Carlos Aguilar; Eric Castet Evaluation of a gaze-controlled vision enhancement system for reading in visually impaired people Journal Article PLoS ONE, 12 (4), pp. e0174910, 2017. @article{Aguilar2017, title = {Evaluation of a gaze-controlled vision enhancement system for reading in visually impaired people}, author = {Carlos Aguilar and Eric Castet}, doi = {10.1371/journal.pone.0174910}, year = {2017}, date = {2017-01-01}, journal = {PLoS ONE}, volume = {12}, number = {4}, pages = {e0174910}, abstract = {People with low vision, especially those with Central Field Loss (CFL), need magnification to read. The flexibility of Electronic Vision Enhancement Systems (EVES) offers several ways of magnifying text. Due to the restricted field of view of EVES, the need for magnification is conflicting with the need to navigate through text (panning). We have developed and implemented a real-time gaze-controlled system whose goal is to optimize the possibility of magnifying a portion of text while maintaining global viewing of the other portions of the text (condition 1). Two other conditions were implemented that mimicked commercially available advanced systems known as CCTV (closed-circuit television systems)-conditions 2 and 3. In these two conditions, magnification was uniformly applied to the whole text without any possibility to specifically select a region of interest. The three conditions were implemented on the same computer to remove differences that might have been induced by dissimilar equipment. A gaze-contingent artificial 10° scotoma (a mask continuously displayed in real time on the screen at the gaze location) was used in the three conditions in order to simulate macular degeneration. Ten healthy subjects with a gaze-contingent scotoma read aloud sentences from a French newspaper in nine experimental one-hour sessions. Reading speed was measured and constituted the main dependent variable to compare the three conditions. All subjects were able to use condition 1 and they found it slightly more comfortable to use than condition 2 (and similar to condition 3). Importantly, reading speed results did not show any significant difference between the three systems. In addition, learning curves were similar in the three conditions. This proof of concept study suggests that the principles underlying the gaze-controlled enhanced system might be further developed and fruitfully incorporated in different kinds of EVES for low vision reading.}, keywords = {}, pubstate = {published}, tppubtype = {article} } People with low vision, especially those with Central Field Loss (CFL), need magnification to read. The flexibility of Electronic Vision Enhancement Systems (EVES) offers several ways of magnifying text. Due to the restricted field of view of EVES, the need for magnification is conflicting with the need to navigate through text (panning). We have developed and implemented a real-time gaze-controlled system whose goal is to optimize the possibility of magnifying a portion of text while maintaining global viewing of the other portions of the text (condition 1). Two other conditions were implemented that mimicked commercially available advanced systems known as CCTV (closed-circuit television systems)-conditions 2 and 3. In these two conditions, magnification was uniformly applied to the whole text without any possibility to specifically select a region of interest. The three conditions were implemented on the same computer to remove differences that might have been induced by dissimilar equipment. A gaze-contingent artificial 10° scotoma (a mask continuously displayed in real time on the screen at the gaze location) was used in the three conditions in order to simulate macular degeneration. Ten healthy subjects with a gaze-contingent scotoma read aloud sentences from a French newspaper in nine experimental one-hour sessions. Reading speed was measured and constituted the main dependent variable to compare the three conditions. All subjects were able to use condition 1 and they found it slightly more comfortable to use than condition 2 (and similar to condition 3). Importantly, reading speed results did not show any significant difference between the three systems. In addition, learning curves were similar in the three conditions. This proof of concept study suggests that the principles underlying the gaze-controlled enhanced system might be further developed and fruitfully incorporated in different kinds of EVES for low vision reading. |
Stephanie Ahken; Gilles Comeau; Sylvie Hébert; Ramesh Balasubramaniam Eye movement patterns during the processing of musical and linguistic syntactic incongruities. Journal Article Psychomusicology: Music, Mind, and Brain, 22 (1), pp. 18–25, 2012. @article{Ahken2012, title = {Eye movement patterns during the processing of musical and linguistic syntactic incongruities.}, author = {Stephanie Ahken and Gilles Comeau and Sylvie Hébert and Ramesh Balasubramaniam}, doi = {10.1037/a0026751}, year = {2012}, date = {2012-01-01}, journal = {Psychomusicology: Music, Mind, and Brain}, volume = {22}, number = {1}, pages = {18--25}, abstract = {It has been suggested that music and language share syntax-supporting brain mechanisms. Consequently, violations of syntax in either domain may have similar effects. The present study examined the effects of syntactic incongruities on eye movements and reading time in both music and language domains. In the music notation condition, the syntactic incongruities violated the prevailing musical tonality (i.e., the last bar of the incongruent sequence was a nontonic chord or nontonic note in the given key). In the linguistic condition, syntactic incongruities violated the expected grammatical structure (i.e., sentences with anomalies carrying the progressive –ing affix or the past tense inflection). Eighteen pianists were asked to sight-read and play musical phrases (music condition) and read sentences aloud (linguistic condition). Syntactic incongruities in both domains were associated with an increase in the mean proportion and duration of fixations in the target region of interest, as well as longer reading duration. The results are consistent with the growing evidence of a shared network of neural structures for syntactic processing, while not ruling out the possibility of independent networks for each domain.}, keywords = {}, pubstate = {published}, tppubtype = {article} } It has been suggested that music and language share syntax-supporting brain mechanisms. Consequently, violations of syntax in either domain may have similar effects. The present study examined the effects of syntactic incongruities on eye movements and reading time in both music and language domains. In the music notation condition, the syntactic incongruities violated the prevailing musical tonality (i.e., the last bar of the incongruent sequence was a nontonic chord or nontonic note in the given key). In the linguistic condition, syntactic incongruities violated the expected grammatical structure (i.e., sentences with anomalies carrying the progressive –ing affix or the past tense inflection). Eighteen pianists were asked to sight-read and play musical phrases (music condition) and read sentences aloud (linguistic condition). Syntactic incongruities in both domains were associated with an increase in the mean proportion and duration of fixations in the target region of interest, as well as longer reading duration. The results are consistent with the growing evidence of a shared network of neural structures for syntactic processing, while not ruling out the possibility of independent networks for each domain. |
Elsa Ahlén; Charlotte S Hills; Hashim M Hanif; Cristina Rubino; Jason J S Barton Learning to read upside-down: A study of perceptual expertise and its acquisition Journal Article Experimental Brain Research, 232 (3), pp. 1025–1036, 2014. @article{Ahlen2014, title = {Learning to read upside-down: A study of perceptual expertise and its acquisition}, author = {Elsa Ahlén and Charlotte S Hills and Hashim M Hanif and Cristina Rubino and Jason J S Barton}, doi = {10.1007/s00221-013-3813-9}, year = {2014}, date = {2014-01-01}, journal = {Experimental Brain Research}, volume = {232}, number = {3}, pages = {1025--1036}, abstract = {Reading is an expert visual and ocular motor function, learned mainly in a single orientation. Characterizing the features of this expertise can be accomplished by contrasts between reading of normal and inverted text, in which perceptual but not linguistic factors are altered. Our goal was to examine this inversion effect in healthy subjects reading text, to derive behavioral and ocular motor markers of perceptual expertise in reading, and to study these parameters before and after training with inverted reading. Seven subjects engaged in a 10-week program of 30 half-hour sessions of reading inverted text. Before and after training, we assessed reading of upright and inverted single words for response time and word-length effects, as well as reading of paragraphs for time required, accuracy, and ocular motor parameters. Before training, inverted reading was characterized by long reading times and large word-length effects, with eye movements showing more and longer fixations, more and smaller forward saccades, and more regressive saccades. Training partially reversed many of these effects in single word and text reading, with the best gains occurring in reading aloud time and proportion of regressive saccades and the least change in forward saccade amplitude. We conclude that reading speed and ocular motor parameters can serve as markers of perceptual expertise during reading and that training with inverted text over 10 weeks results in significant gains of reading expertise in this unfamiliar orientation. This approach may be useful in the rehabilitation of patients with hemianopic dyslexia.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Reading is an expert visual and ocular motor function, learned mainly in a single orientation. Characterizing the features of this expertise can be accomplished by contrasts between reading of normal and inverted text, in which perceptual but not linguistic factors are altered. Our goal was to examine this inversion effect in healthy subjects reading text, to derive behavioral and ocular motor markers of perceptual expertise in reading, and to study these parameters before and after training with inverted reading. Seven subjects engaged in a 10-week program of 30 half-hour sessions of reading inverted text. Before and after training, we assessed reading of upright and inverted single words for response time and word-length effects, as well as reading of paragraphs for time required, accuracy, and ocular motor parameters. Before training, inverted reading was characterized by long reading times and large word-length effects, with eye movements showing more and longer fixations, more and smaller forward saccades, and more regressive saccades. Training partially reversed many of these effects in single word and text reading, with the best gains occurring in reading aloud time and proportion of regressive saccades and the least change in forward saccade amplitude. We conclude that reading speed and ocular motor parameters can serve as markers of perceptual expertise during reading and that training with inverted text over 10 weeks results in significant gains of reading expertise in this unfamiliar orientation. This approach may be useful in the rehabilitation of patients with hemianopic dyslexia. |
Sheeraz Ahmad; He Huang; Angela J Yu Cost-sensitive Bayesian control policy in human active sensing Journal Article Frontiers in Human Neuroscience, 8 (December), pp. 1–12, 2014. @article{Ahmad2014, title = {Cost-sensitive Bayesian control policy in human active sensing}, author = {Sheeraz Ahmad and He Huang and Angela J Yu}, doi = {10.3389/fnhum.2014.00955}, year = {2014}, date = {2014-01-01}, journal = {Frontiers in Human Neuroscience}, volume = {8}, number = {December}, pages = {1--12}, abstract = {An important but poorly understood aspect of sensory processing is the role of active sensing, the use of self-motion such as eye or head movements to focus sensing resources on the most rewarding or informative aspects of the sensory environment. Here, we present behavioral data from a visual search experiment, as well as a Bayesian model of within-trial dynamics of sensory processing and eye movements. Within this Bayes-optimal inference and control framework, which we call C-DAC (Context-Dependent Active Controller), various types of behavioral costs, such as temporal delay, response error, and sensor repositioning cost, are explicitly minimized. This contrasts with previously proposed algorithms that optimize abstract statistical objectives such as anticipated information gain (Infomax) (Butko and Movellan, 2010) and expected posterior maximum (greedy MAP) (Najemnik and Geisler, 2005). We find that C-DAC captures human visual search dynamics better than previous models, in particular a certain form of "confirmation bias" apparent in the way human subjects utilize prior knowledge about the spatial distribution of the search target to improve search speed and accuracy. We also examine several computationally efficient approximations to C-DAC that may present biologically more plausible accounts of the neural computations underlying active sensing, as well as practical tools for solving active sensing problems in engineering applications. To summarize, this paper makes the following key contributions: human visual search behavioral data, a context-sensitive Bayesian active sensing model, a comparative study between different models of human active sensing, and a family of efficient approximations to the optimal model.}, keywords = {}, pubstate = {published}, tppubtype = {article} } An important but poorly understood aspect of sensory processing is the role of active sensing, the use of self-motion such as eye or head movements to focus sensing resources on the most rewarding or informative aspects of the sensory environment. Here, we present behavioral data from a visual search experiment, as well as a Bayesian model of within-trial dynamics of sensory processing and eye movements. Within this Bayes-optimal inference and control framework, which we call C-DAC (Context-Dependent Active Controller), various types of behavioral costs, such as temporal delay, response error, and sensor repositioning cost, are explicitly minimized. This contrasts with previously proposed algorithms that optimize abstract statistical objectives such as anticipated information gain (Infomax) (Butko and Movellan, 2010) and expected posterior maximum (greedy MAP) (Najemnik and Geisler, 2005). We find that C-DAC captures human visual search dynamics better than previous models, in particular a certain form of "confirmation bias" apparent in the way human subjects utilize prior knowledge about the spatial distribution of the search target to improve search speed and accuracy. We also examine several computationally efficient approximations to C-DAC that may present biologically more plausible accounts of the neural computations underlying active sensing, as well as practical tools for solving active sensing problems in engineering applications. To summarize, this paper makes the following key contributions: human visual search behavioral data, a context-sensitive Bayesian active sensing model, a comparative study between different models of human active sensing, and a family of efficient approximations to the optimal model. |
Mehrnoosh Ahmadi; Mitra Judi; Anahita Khorrami; Javad Mahmoudi-Gharaei; Mehdi Tehrani-Doost Initial orientation of attention towards emotional faces in children with attention deficit hyperactivity disorder Journal Article Iranian Journal of Psychiatry, 6 (3), pp. 87–91, 2011. @article{Ahmadi2011, title = {Initial orientation of attention towards emotional faces in children with attention deficit hyperactivity disorder}, author = {Mehrnoosh Ahmadi and Mitra Judi and Anahita Khorrami and Javad Mahmoudi-Gharaei and Mehdi Tehrani-Doost}, year = {2011}, date = {2011-01-01}, journal = {Iranian Journal of Psychiatry}, volume = {6}, number = {3}, pages = {87--91}, abstract = {OBJECTIVE: Early recognition of negative emotions is considered to be of vital importance. It seems that children with attention deficit hyperactivity disorder have some difficulties recognizing facial emotional expressions, especially negative ones. This study investigated the preference of children with attention deficit hyperactivity disorder for negative (angry, sad) facial expressions compared to normal children. METHOD: Participants were 35 drug naive boys with ADHD, aged between 6-11 years,and 31 matched healthy children. Visual orientation data were recorded while participants viewed face pairs (negative-neutral pairs) shown for 3000ms. The number of first fixations made to each expression was considered as an index of initial orientation. RESULTS: Group comparisons revealed no difference between attention deficit hyperactivity disorder group and their matched healthy counterparts in initial orientation of attention. A tendency towards negative emotions was found within the normal group, while no difference was observed between initial allocation of attention toward negative and neutral expressions in children with ADHD. CONCLUSION: Children with attention deficit hyperactivity disorder do not have significant preference for negative facial expressions. In contrast, normal children have a significant preference for negative facial emotions rather than neutral faces.}, keywords = {}, pubstate = {published}, tppubtype = {article} } OBJECTIVE: Early recognition of negative emotions is considered to be of vital importance. It seems that children with attention deficit hyperactivity disorder have some difficulties recognizing facial emotional expressions, especially negative ones. This study investigated the preference of children with attention deficit hyperactivity disorder for negative (angry, sad) facial expressions compared to normal children. METHOD: Participants were 35 drug naive boys with ADHD, aged between 6-11 years,and 31 matched healthy children. Visual orientation data were recorded while participants viewed face pairs (negative-neutral pairs) shown for 3000ms. The number of first fixations made to each expression was considered as an index of initial orientation. RESULTS: Group comparisons revealed no difference between attention deficit hyperactivity disorder group and their matched healthy counterparts in initial orientation of attention. A tendency towards negative emotions was found within the normal group, while no difference was observed between initial allocation of attention toward negative and neutral expressions in children with ADHD. CONCLUSION: Children with attention deficit hyperactivity disorder do not have significant preference for negative facial expressions. In contrast, normal children have a significant preference for negative facial emotions rather than neutral faces. |
Byunghoon “Tony” Ahn; Jason M Harley Facial expressions when learning with a Queer History App: Application of the control value theory of achievement emotions Journal Article British Journal of Educational Technology, 51 (5), pp. 1563–1576, 2020. @article{Ahn2020, title = {Facial expressions when learning with a Queer History App: Application of the control value theory of achievement emotions}, author = {Byunghoon “Tony” Ahn and Jason M Harley}, doi = {10.1111/bjet.12989}, year = {2020}, date = {2020-01-01}, journal = {British Journal of Educational Technology}, volume = {51}, number = {5}, pages = {1563--1576}, abstract = {Learning analytics (LA) incorporates analyzing cognitive, social and emotional processes in learning scenarios to make informed decisions regarding instructional design and delivery. Research has highlighted important roles that emotions play in learning. We have extended this field of research by exploring the role of emotions in a relatively uncommon learning scenario: learning about queer history with a multimedia mobile app. Specifically, we used an automatic facial recognition software (FaceReader 7) to measure learners' discrete emotions and a counter-balanced multiple-choice quiz to assess learning. We also used an eye tracker (EyeLink 1000) to identify the emotions learners experienced while they read specific content, as opposed to the emotions they experienced over the course of the entire learning session. A total of 33 out of 57 of the learners' data were eligible to be analyzed. Results revealed that learners expressed more negative-activating emotions (ie, anger, anxiety) and negative-deactivating emotions (ie, sadness) than positive-activating emotions (ie, happiness). Learners with an angry emotion profile had the highest learning gains. The importance of examining typically undesirable emotions in learning, such as anger, is discussed using the control-value theory of achievement emotions. Further, this study describes a multimodal methodology to integrate behavioral trace data into learning analytics research.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Learning analytics (LA) incorporates analyzing cognitive, social and emotional processes in learning scenarios to make informed decisions regarding instructional design and delivery. Research has highlighted important roles that emotions play in learning. We have extended this field of research by exploring the role of emotions in a relatively uncommon learning scenario: learning about queer history with a multimedia mobile app. Specifically, we used an automatic facial recognition software (FaceReader 7) to measure learners' discrete emotions and a counter-balanced multiple-choice quiz to assess learning. We also used an eye tracker (EyeLink 1000) to identify the emotions learners experienced while they read specific content, as opposed to the emotions they experienced over the course of the entire learning session. A total of 33 out of 57 of the learners' data were eligible to be analyzed. Results revealed that learners expressed more negative-activating emotions (ie, anger, anxiety) and negative-deactivating emotions (ie, sadness) than positive-activating emotions (ie, happiness). Learners with an angry emotion profile had the highest learning gains. The importance of examining typically undesirable emotions in learning, such as anger, is discussed using the control-value theory of achievement emotions. Further, this study describes a multimodal methodology to integrate behavioral trace data into learning analytics research. |
Danbi Ahn; Matthew J Abbott; Keith Rayner; Victor S Ferreira; Tamar H Gollan Minimal overlap in language control across production and comprehension: Evidence from read-aloud versus eye-tracking tasks Journal Article Journal of Neurolinguistics, 54 , pp. 1–22, 2020. @article{Ahn2020a, title = {Minimal overlap in language control across production and comprehension: Evidence from read-aloud versus eye-tracking tasks}, author = {Danbi Ahn and Matthew J Abbott and Keith Rayner and Victor S Ferreira and Tamar H Gollan}, doi = {10.1016/j.jneuroling.2019.100885}, year = {2020}, date = {2020-01-01}, journal = {Journal of Neurolinguistics}, volume = {54}, pages = {1--22}, publisher = {Elsevier}, abstract = {Bilinguals are remarkable at language control—switching between languages only when they want. However, language control in production can involve switch costs. That is, switching to another language takes longer than staying in the same language. Moreover, bilinguals sometimes produce language intrusion errors, mistakenly producing words in an unintended language (e.g., Spanish–English bilinguals saying “pero” instead of “but”). Switch costs are also found in comprehension. For example, reading times are longer when bilinguals read sentences with language switches compared to sentences with no language switches. Given that both production and comprehension involve switch costs, some language–control mechanisms might be shared across modalities. To test this, we compared language switch costs found in eye–movement measures during silent sentence reading (comprehension) and intrusion errors produced when reading aloud switched words in mixed–language paragraphs (production). Bilinguals who made more intrusion errors during the read–aloud task did not show different switch cost patterns in most measures in the silent–reading task, except on skipping rates. We suggest that language switching is mostly controlled by separate, modality–specific processes in production and comprehension, although some points of overlap might indicate the role of domain general control and how it can influence individual differences in bilingual language control.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Bilinguals are remarkable at language control—switching between languages only when they want. However, language control in production can involve switch costs. That is, switching to another language takes longer than staying in the same language. Moreover, bilinguals sometimes produce language intrusion errors, mistakenly producing words in an unintended language (e.g., Spanish–English bilinguals saying “pero” instead of “but”). Switch costs are also found in comprehension. For example, reading times are longer when bilinguals read sentences with language switches compared to sentences with no language switches. Given that both production and comprehension involve switch costs, some language–control mechanisms might be shared across modalities. To test this, we compared language switch costs found in eye–movement measures during silent sentence reading (comprehension) and intrusion errors produced when reading aloud switched words in mixed–language paragraphs (production). Bilinguals who made more intrusion errors during the read–aloud task did not show different switch cost patterns in most measures in the silent–reading task, except on skipping rates. We suggest that language switching is mostly controlled by separate, modality–specific processes in production and comprehension, although some points of overlap might indicate the role of domain general control and how it can influence individual differences in bilingual language control. |
Aarit Ahuja; David L Sheinberg Behavioral and oculomotor evidence for visual simulation of object movement Journal Article Journal of Vision, 19 (6), pp. 1–17, 2019. @article{Ahuja2019, title = {Behavioral and oculomotor evidence for visual simulation of object movement}, author = {Aarit Ahuja and David L Sheinberg}, doi = {10.1167/19.6.13}, year = {2019}, date = {2019-06-01}, journal = {Journal of Vision}, volume = {19}, number = {6}, pages = {1--17}, publisher = {The Association for Research in Vision and Ophthalmology}, abstract = {We regularly interact with moving objects in our environment. Yet, little is known about how we extrapolate the future movements of visually perceived objects. One possibility is that movements are experienced by a mental visual simulation, allowing one to internally picture an object's upcoming motion trajectory, even as the object itself remains stationary. Here we examined this possibility by asking human participants to make judgments about the future position of a falling ball on an obstacle-filled display. We found that properties of the ball's trajectory were highly predictive of subjects' reaction times and accuracy on the task. We also found that the eye movements subjects made while attempting to ascertain where the ball might fall had significant spatiotemporal overlap with those made while actually perceiving the ball fall. These findings suggest that subjects simulated the ball's trajectory to inform their responses. Finally, we trained a convolutional neural network to see whether this problem could be solved by simple image analysis as opposed to the more intricate simulation strategy we propose. We found that while the network was able to solve our task, the model's output did not effectively or consistently predict human behavior. This implies that subjects employed a different strategy for solving our task, and bolsters the conclusion that they were engaging in visual simulation. The current study thus provides support for visual simulation of motion as a means of understanding complex visual scenes and paves the way for future investigations of this phenomenon at a neural level.}, keywords = {}, pubstate = {published}, tppubtype = {article} } We regularly interact with moving objects in our environment. Yet, little is known about how we extrapolate the future movements of visually perceived objects. One possibility is that movements are experienced by a mental visual simulation, allowing one to internally picture an object's upcoming motion trajectory, even as the object itself remains stationary. Here we examined this possibility by asking human participants to make judgments about the future position of a falling ball on an obstacle-filled display. We found that properties of the ball's trajectory were highly predictive of subjects' reaction times and accuracy on the task. We also found that the eye movements subjects made while attempting to ascertain where the ball might fall had significant spatiotemporal overlap with those made while actually perceiving the ball fall. These findings suggest that subjects simulated the ball's trajectory to inform their responses. Finally, we trained a convolutional neural network to see whether this problem could be solved by simple image analysis as opposed to the more intricate simulation strategy we propose. We found that while the network was able to solve our task, the model's output did not effectively or consistently predict human behavior. This implies that subjects employed a different strategy for solving our task, and bolsters the conclusion that they were engaging in visual simulation. The current study thus provides support for visual simulation of motion as a means of understanding complex visual scenes and paves the way for future investigations of this phenomenon at a neural level. |
Désirée S Aichert; Nicola M Wöstmann; Anna Costa; Christine Macare; Johanna R Wenig; Hans-Jürgen Möller; Katya Rubia; Ulrich Ettinger Associations between trait impulsivity and prepotent response inhibition Journal Article Journal of Clinical and Experimental Neuropsychology, 34 (10), pp. 37–41, 2012. @article{Aichert2012, title = {Associations between trait impulsivity and prepotent response inhibition}, author = {Désirée S Aichert and Nicola M Wöstmann and Anna Costa and Christine Macare and Johanna R Wenig and Hans-Jürgen Möller and Katya Rubia and Ulrich Ettinger}, doi = {10.1080/13803395.2012.706261}, year = {2012}, date = {2012-01-01}, journal = {Journal of Clinical and Experimental Neuropsychology}, volume = {34}, number = {10}, pages = {37--41}, abstract = {This study addresses the relationship between trait impulsivity and inhibitory control, two features known to be impaired in a number ofpsychiatric conditions. While impulsivity is often measured using psychometric self-report questionnaires, the inhibition ofinappropriate, impulsive motor responses is typically measured using experimental laboratory tasks. It remains unclear, however, whether psychometrically assessed impulsivity and experimentally operationalized inhibitory performance are related to each other. Therefore, we investigated the relationship between these two traits in a large sample using correlative and latent variable analysis. A total of 504 healthy individuals completed the Barratt Impulsiveness Scale (BIS-11) and a battery of four prepotent response inhibi- tion paradigms: the antisaccade, Stroop, stop-signal, and go/no-go tasks. We found significant associations of BIS impulsivity with commission errors on the go/no-go task and directional errors on the antisaccade task, over and above effects of age, gender, and intelligence. Latent variable analysis (a) supported the idea that all four inhibitory measures load on the same underlying construct termed “prepotent response inhibition” and (b) revealed that 12% of variance of the prepotent response inhibition construct could be explained by BIS impulsivity. Overall, the magnitude of associations observed was small, indicating that while a portion of variance in prepotent response inhibition can be explained by psychometric trait impulsivity, the majority of variance remains unexplained. Thus, these findings suggest that prepotent response inhibition paradigms can account for psychometric trait impulsivity only to a limited extent. Implications for studies of patient populations with symptoms of impulsivity are discussed.}, keywords = {}, pubstate = {published}, tppubtype = {article} } This study addresses the relationship between trait impulsivity and inhibitory control, two features known to be impaired in a number ofpsychiatric conditions. While impulsivity is often measured using psychometric self-report questionnaires, the inhibition ofinappropriate, impulsive motor responses is typically measured using experimental laboratory tasks. It remains unclear, however, whether psychometrically assessed impulsivity and experimentally operationalized inhibitory performance are related to each other. Therefore, we investigated the relationship between these two traits in a large sample using correlative and latent variable analysis. A total of 504 healthy individuals completed the Barratt Impulsiveness Scale (BIS-11) and a battery of four prepotent response inhibi- tion paradigms: the antisaccade, Stroop, stop-signal, and go/no-go tasks. We found significant associations of BIS impulsivity with commission errors on the go/no-go task and directional errors on the antisaccade task, over and above effects of age, gender, and intelligence. Latent variable analysis (a) supported the idea that all four inhibitory measures load on the same underlying construct termed “prepotent response inhibition” and (b) revealed that 12% of variance of the prepotent response inhibition construct could be explained by BIS impulsivity. Overall, the magnitude of associations observed was small, indicating that while a portion of variance in prepotent response inhibition can be explained by psychometric trait impulsivity, the majority of variance remains unexplained. Thus, these findings suggest that prepotent response inhibition paradigms can account for psychometric trait impulsivity only to a limited extent. Implications for studies of patient populations with symptoms of impulsivity are discussed. |
Désirée S Aichert; Birgit Derntl; Nicola M Wöstmann; Julia K Groß; Sandra Dehning; Anja Cerovecki; Hans-Jürgen Möller; Ute Habel; Michael Riedel; Ulrich Ettinger Intact emotion-cognition interaction in schizophrenia patients and first-degree relatives: Evidence from an emotional antisaccade task Journal Article Brain and Cognition, 82 (3), pp. 329–336, 2013. @article{Aichert2013, title = {Intact emotion-cognition interaction in schizophrenia patients and first-degree relatives: Evidence from an emotional antisaccade task}, author = {Désirée S Aichert and Birgit Derntl and Nicola M Wöstmann and Julia K Groß and Sandra Dehning and Anja Cerovecki and Hans-Jürgen Möller and Ute Habel and Michael Riedel and Ulrich Ettinger}, doi = {10.1016/j.bandc.2013.05.007}, year = {2013}, date = {2013-01-01}, journal = {Brain and Cognition}, volume = {82}, number = {3}, pages = {329--336}, publisher = {Elsevier Inc.}, abstract = {Schizophrenia patients have deficits in cognitive control as well as in a number of emotional domains. The antisaccade task is a measure of cognitive control that requires the inhibition of a reflex-like eye movement to a peripheral stimulus. Antisaccade performance has been shown to be modulated by the emotional content of the peripheral stimuli, with emotional stimuli leading to higher error rates than neutral stimuli, reflecting an implicit emotion processing effect. The aim of the present study was to investigate the impact on antisaccade performance of threat-related emotional facial stimuli in schizophrenia patients, first-degree relatives of schizophrenia patients and healthy controls. Fifteen patients, 22 relatives and 26 controls, matched for gender, age and verbal intelligence, carried out an antisaccade task with pictures of faces displaying disgusted, fearful and neutral expressions as peripheral stimuli. We observed higher antisaccade error rates in schizophrenia patients compared to first-degree relatives and controls. Relatives and controls did not differ significantly from each other. Antisaccade error rate was influenced by the emotional nature of the stimuli: participants had higher antisaccade error rates in response to fearful faces compared to neutral and disgusted faces. As this emotional influence on cognitive control did not differ between groups we conclude that implicit processing of emotional faces is intact in patients with schizophrenia and those at risk for the illness.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Schizophrenia patients have deficits in cognitive control as well as in a number of emotional domains. The antisaccade task is a measure of cognitive control that requires the inhibition of a reflex-like eye movement to a peripheral stimulus. Antisaccade performance has been shown to be modulated by the emotional content of the peripheral stimuli, with emotional stimuli leading to higher error rates than neutral stimuli, reflecting an implicit emotion processing effect. The aim of the present study was to investigate the impact on antisaccade performance of threat-related emotional facial stimuli in schizophrenia patients, first-degree relatives of schizophrenia patients and healthy controls. Fifteen patients, 22 relatives and 26 controls, matched for gender, age and verbal intelligence, carried out an antisaccade task with pictures of faces displaying disgusted, fearful and neutral expressions as peripheral stimuli. We observed higher antisaccade error rates in schizophrenia patients compared to first-degree relatives and controls. Relatives and controls did not differ significantly from each other. Antisaccade error rate was influenced by the emotional nature of the stimuli: participants had higher antisaccade error rates in response to fearful faces compared to neutral and disgusted faces. As this emotional influence on cognitive control did not differ between groups we conclude that implicit processing of emotional faces is intact in patients with schizophrenia and those at risk for the illness. |
C J Aine; H J Bockholt; J R Bustillo; J M Cañive; A Caprihan; C Gasparovic; F M Hanlon; J M Houck; R E Jung; J Lauriello; J Liu; A R Mayer; N I Perrone-Bizzozero; S Posse; Julia M Stephen; J A Turner; V P Clark; Vince D Calhoun Multimodal neuroimaging in schizophrenia: Description and dissemination Journal Article Neuroinformatics, 15 (4), pp. 343–364, 2017. @article{Aine2017, title = {Multimodal neuroimaging in schizophrenia: Description and dissemination}, author = {C J Aine and H J Bockholt and J R Bustillo and J M Ca{ñ}ive and A Caprihan and C Gasparovic and F M Hanlon and J M Houck and R E Jung and J Lauriello and J Liu and A R Mayer and N I Perrone-Bizzozero and S Posse and Julia M Stephen and J A Turner and V P Clark and Vince D Calhoun}, doi = {10.1007/s12021-017-9338-9}, year = {2017}, date = {2017-01-01}, journal = {Neuroinformatics}, volume = {15}, number = {4}, pages = {343--364}, publisher = {Neuroinformatics}, abstract = {In this paper we describe an open-access collection ofmultimodal neuroimaging data in schizophrenia for release to the community. Data were acquired from approximately 100 patients with schizophrenia and 100 age-matched controls during rest as well as several task activation paradigms targeting a hierarchy of cognitive constructs. Neuroimaging data include structural MRI, functional MRI, diffusion MRI, MR spectroscopic imaging, and magnetoencephalography. For three of the hypothesis-driven projects, task activation paradigms were acquired on subsets of~200 volunteers which examined a range of sensory and cognitive processes (e.g., auditory sensory gating, auditory/visual multisensory integration, visual transverse patterning). Neuropsychological data were also acquired and genetic material via saliva samples were collected from most of the participants and have been typed for both genome-wide polymorphism data as well as genome-wide methylation data. Some results are also present- ed from the individual studies as well as from our data-driven multimodal analyses (e.g., multimodal examinations of network structure and network dynamics and multitask fMRI data analysis across projects). All data will be released through the Mind Research Network's collaborative informatics and neuroimaging suite (COINS).}, keywords = {}, pubstate = {published}, tppubtype = {article} } In this paper we describe an open-access collection ofmultimodal neuroimaging data in schizophrenia for release to the community. Data were acquired from approximately 100 patients with schizophrenia and 100 age-matched controls during rest as well as several task activation paradigms targeting a hierarchy of cognitive constructs. Neuroimaging data include structural MRI, functional MRI, diffusion MRI, MR spectroscopic imaging, and magnetoencephalography. For three of the hypothesis-driven projects, task activation paradigms were acquired on subsets of~200 volunteers which examined a range of sensory and cognitive processes (e.g., auditory sensory gating, auditory/visual multisensory integration, visual transverse patterning). Neuropsychological data were also acquired and genetic material via saliva samples were collected from most of the participants and have been typed for both genome-wide polymorphism data as well as genome-wide methylation data. Some results are also present- ed from the individual studies as well as from our data-driven multimodal analyses (e.g., multimodal examinations of network structure and network dynamics and multitask fMRI data analysis across projects). All data will be released through the Mind Research Network's collaborative informatics and neuroimaging suite (COINS). |
Cordelia D Aitkin; Elio M Santos; Eileen Kowler Anticipatory smooth eye movements in autism spectrum disorder Journal Article PLoS ONE, 8 (12), pp. e83230, 2013. @article{Aitkin2013, title = {Anticipatory smooth eye movements in autism spectrum disorder}, author = {Cordelia D Aitkin and Elio M Santos and Eileen Kowler}, doi = {10.1371/journal.pone.0083230}, year = {2013}, date = {2013-01-01}, journal = {PLoS ONE}, volume = {8}, number = {12}, pages = {e83230}, abstract = {Smooth pursuit eye movements are important for vision because they maintain the line of sight on targets that move smoothly within the visual field. Smooth pursuit is driven by neural representations of motion, including a surprisingly strong influence of high-level signals representing expected motion. We studied anticipatory smooth eye movements (defined as smooth eye movements in the direction of expected future motion) produced by salient visual cues in a group of high-functioning observers with Autism Spectrum Disorder (ASD), a condition that has been associated with difficulties in either generating predictions, or translating predictions into effective motor commands. Eye movements were recorded while participants pursued the motion of a disc that moved within an outline drawing of an inverted Y-shaped tube. The cue to the motion path was a visual barrier that blocked the untraveled branch (right or left) of the tube. ASD participants showed strong anticipatory smooth eye movements whose velocity was the same as that of a group of neurotypical participants. Anticipatory smooth eye movements appeared on the very first cued trial, indicating that trial-by-trial learning was not responsible for the responses. These results are significant because they show that anticipatory capacities are intact in high-functioning ASD in cases where the cue to the motion path is highly salient and unambiguous. Once the ability to generate anticipatory pursuit is demonstrated, the study of the anticipatory responses with a variety of types of cues provides a window into the perceptual or cognitive processes that underlie the interpretation of events in natural environments or social situations.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Smooth pursuit eye movements are important for vision because they maintain the line of sight on targets that move smoothly within the visual field. Smooth pursuit is driven by neural representations of motion, including a surprisingly strong influence of high-level signals representing expected motion. We studied anticipatory smooth eye movements (defined as smooth eye movements in the direction of expected future motion) produced by salient visual cues in a group of high-functioning observers with Autism Spectrum Disorder (ASD), a condition that has been associated with difficulties in either generating predictions, or translating predictions into effective motor commands. Eye movements were recorded while participants pursued the motion of a disc that moved within an outline drawing of an inverted Y-shaped tube. The cue to the motion path was a visual barrier that blocked the untraveled branch (right or left) of the tube. ASD participants showed strong anticipatory smooth eye movements whose velocity was the same as that of a group of neurotypical participants. Anticipatory smooth eye movements appeared on the very first cued trial, indicating that trial-by-trial learning was not responsible for the responses. These results are significant because they show that anticipatory capacities are intact in high-functioning ASD in cases where the cue to the motion path is highly salient and unambiguous. Once the ability to generate anticipatory pursuit is demonstrated, the study of the anticipatory responses with a variety of types of cues provides a window into the perceptual or cognitive processes that underlie the interpretation of events in natural environments or social situations. |
Avigael M Aizenman; Trafton Drew; Krista A Ehinger; Dianne Georgian-smith; Jeremy M Wolfe Comparing search patterns in digital breast tomosynthesis and full-field digital mammography: An eye tracking study Journal Article Journal of Medical Imaging, 4 (4), pp. 1–22, 2017. @article{Aizenman2017, title = {Comparing search patterns in digital breast tomosynthesis and full-field digital mammography: An eye tracking study}, author = {Avigael M Aizenman and Trafton Drew and Krista A Ehinger and Dianne Georgian-smith and Jeremy M Wolfe}, doi = {10.1117/1.JMI.4.4.045501}, year = {2017}, date = {2017-01-01}, journal = {Journal of Medical Imaging}, volume = {4}, number = {4}, pages = {1--22}, abstract = {As a promising imaging modality, digital breast tomosynthesis (DBT) leads to better diagnostic per- formance than traditional full-field digital mammograms (FFDM) alone. DBT allows different planes of the breast to be visualized, reducing occlusion from overlapping tissue. Although DBT is gaining popularity, best practices for search strategies in this medium are unclear. Eye tracking allowed us to describe search patterns adopted by radiologists searching DBT and FFDM images. Eleven radiologists examined eight DBT and FFDM cases. Observers marked suspicious masses with mouse clicks. Eye position was recorded at 1000 Hz and was coregistered with slice/depth plane as the radiologist scrolled through the DBT images, allowing a 3-D representation of eye position. Hit rate for masses was higher for tomography cases than 2-D cases and DBT led to lower false positive rates. However, search duration was much longer for DBT cases than FFDM. DBT was associated with longer fixations but similar saccadic amplitude compared with FFDM. When comparing radiologists' eye movements to a previous study, which tracked eye movements as radiologists read chest CT, we found DBT viewers did not align with previously identified “driller” or “scanner” strategies, although their search strategy most closely aligns with a type of vigorous drilling strategy.}, keywords = {}, pubstate = {published}, tppubtype = {article} } As a promising imaging modality, digital breast tomosynthesis (DBT) leads to better diagnostic per- formance than traditional full-field digital mammograms (FFDM) alone. DBT allows different planes of the breast to be visualized, reducing occlusion from overlapping tissue. Although DBT is gaining popularity, best practices for search strategies in this medium are unclear. Eye tracking allowed us to describe search patterns adopted by radiologists searching DBT and FFDM images. Eleven radiologists examined eight DBT and FFDM cases. Observers marked suspicious masses with mouse clicks. Eye position was recorded at 1000 Hz and was coregistered with slice/depth plane as the radiologist scrolled through the DBT images, allowing a 3-D representation of eye position. Hit rate for masses was higher for tomography cases than 2-D cases and DBT led to lower false positive rates. However, search duration was much longer for DBT cases than FFDM. DBT was associated with longer fixations but similar saccadic amplitude compared with FFDM. When comparing radiologists' eye movements to a previous study, which tracked eye movements as radiologists read chest CT, we found DBT viewers did not align with previously identified “driller” or “scanner” strategies, although their search strategy most closely aligns with a type of vigorous drilling strategy. |
Suzon Ajasse; Ryad B Benosman; Jean Lorenceau Effects of pupillary responses to luminance and attention on visual spatial discrimination Journal Article Journal of Vision, 18 (11), pp. 1–14, 2018. @article{Ajasse2018, title = {Effects of pupillary responses to luminance and attention on visual spatial discrimination}, author = {Suzon Ajasse and Ryad B Benosman and Jean Lorenceau}, doi = {10.1167/18.11.6}, year = {2018}, date = {2018-01-01}, journal = {Journal of Vision}, volume = {18}, number = {11}, pages = {1--14}, abstract = {The optic quality of the eyes is, at least in part, determined by pupil size. Large pupils let more light enter the eyes, but degrade the point spread function, and thus the spatial resolution that can be achieved (Campbell & Gregory, 1960). In natural conditions, the pupil is mainly driven by the luminance (and possibly the color and contrast) at the gazed location, but is also modulated by attention and cognitive factors. Whether changes in eyes' optics related to pupil size modulation by luminance and attention impacts visual processing was assessed in two experiments. In Experiment 1, we measured pupil size using a constantly visible display made of four disks with different luminance levels, with no other task than fixating the disks in succession. The results confirmed that pupil size depends on the luminance of the gazed stimulus. Experiment 2, using similar settings as Experiment 1, used a two-interval forced-choice design to test whether discriminating high spatial frequencies that requires covert attention to parafoveal stimuli is better during the fixation of bright disks that entails a small pupil size, and hence better eyes' optics, as compared to fixating dark disks that entails a large pupil size, and hence poorer eyes' optics. As in Experiment 1, we observed large modulations of pupil size depending on the luminance of the gazed stimulus, but pupil dynamics was more variable, with marked pupil dilation during stimulus encoding, presumably because the demanding spatial frequency discrimination task engaged attention. However, discrimination performance and mean pupil size were not correlated. Despite this lack of correlation, the slopes of pupil dilation during stimulus encoding were correlated to performance, while the slopes of pupil dilation during decision-making were not. We discuss these results regarding the possible functional roles of pupil size modulations.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The optic quality of the eyes is, at least in part, determined by pupil size. Large pupils let more light enter the eyes, but degrade the point spread function, and thus the spatial resolution that can be achieved (Campbell & Gregory, 1960). In natural conditions, the pupil is mainly driven by the luminance (and possibly the color and contrast) at the gazed location, but is also modulated by attention and cognitive factors. Whether changes in eyes' optics related to pupil size modulation by luminance and attention impacts visual processing was assessed in two experiments. In Experiment 1, we measured pupil size using a constantly visible display made of four disks with different luminance levels, with no other task than fixating the disks in succession. The results confirmed that pupil size depends on the luminance of the gazed stimulus. Experiment 2, using similar settings as Experiment 1, used a two-interval forced-choice design to test whether discriminating high spatial frequencies that requires covert attention to parafoveal stimuli is better during the fixation of bright disks that entails a small pupil size, and hence better eyes' optics, as compared to fixating dark disks that entails a large pupil size, and hence poorer eyes' optics. As in Experiment 1, we observed large modulations of pupil size depending on the luminance of the gazed stimulus, but pupil dynamics was more variable, with marked pupil dilation during stimulus encoding, presumably because the demanding spatial frequency discrimination task engaged attention. However, discrimination performance and mean pupil size were not correlated. Despite this lack of correlation, the slopes of pupil dilation during stimulus encoding were correlated to performance, while the slopes of pupil dilation during decision-making were not. We discuss these results regarding the possible functional roles of pupil size modulations. |
Sara Ajina; Christopher Kennard; Geraint Rees; Holly Bridge Motion area V5/MT+ response to global motion in the absence of V1 resembles early visual cortex Journal Article Brain, 138 (1), pp. 164–178, 2015. @article{Ajina2015, title = {Motion area V5/MT+ response to global motion in the absence of V1 resembles early visual cortex}, author = {Sara Ajina and Christopher Kennard and Geraint Rees and Holly Bridge}, doi = {10.1093/brain/awu328}, year = {2015}, date = {2015-01-01}, journal = {Brain}, volume = {138}, number = {1}, pages = {164--178}, abstract = {Motion area V5/MT+ shows a variety of characteristic visual responses, often linked to perception, which are heavily influenced by its rich connectivity with the primary visual cortex (V1). This human motion area also receives a number of inputs from other visual regions, including direct subcortical connections and callosal connections with the contralateral hemisphere. Little is currently known about such alternative inputs to V5/MT+ and how they may drive and influence its activity. Using functional magnetic resonance imaging, the response of human V5/MT+ to increasing the proportion of coherent motion was measured in seven patients with unilateral V1 damage acquired during adulthood, and a group of healthy age-matched controls. When V1 was damaged, the typical V5/MT+ response to increasing coherence was lost. Rather, V5/MT+ in patients showed a negative trend with coherence that was similar to coherence-related activity in V1 of healthy control subjects. This shift to a response-pattern more typical of early visual cortex suggests that in the absence of V1, V5/MT+ activity may be shaped by similar direct subcortical input. This is likely to reflect intact residual pathways rather than a change in connectivity, and has important implications for blindsight function. It also confirms predictions that V1 is critically involved in normal V5/MT+ global motion processing, consistent with a convergent model of V1 input to V5/MT+. Historically, most attempts to model cortical visual responses do not consider the contribution of direct subcortical inputs that may bypass striate cortex, such as input to V5/MT+. We have shown that the signal change driven by these non-striate pathways can be measured, and suggest that models of the intact visual system may benefit from considering their contribution.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Motion area V5/MT+ shows a variety of characteristic visual responses, often linked to perception, which are heavily influenced by its rich connectivity with the primary visual cortex (V1). This human motion area also receives a number of inputs from other visual regions, including direct subcortical connections and callosal connections with the contralateral hemisphere. Little is currently known about such alternative inputs to V5/MT+ and how they may drive and influence its activity. Using functional magnetic resonance imaging, the response of human V5/MT+ to increasing the proportion of coherent motion was measured in seven patients with unilateral V1 damage acquired during adulthood, and a group of healthy age-matched controls. When V1 was damaged, the typical V5/MT+ response to increasing coherence was lost. Rather, V5/MT+ in patients showed a negative trend with coherence that was similar to coherence-related activity in V1 of healthy control subjects. This shift to a response-pattern more typical of early visual cortex suggests that in the absence of V1, V5/MT+ activity may be shaped by similar direct subcortical input. This is likely to reflect intact residual pathways rather than a change in connectivity, and has important implications for blindsight function. It also confirms predictions that V1 is critically involved in normal V5/MT+ global motion processing, consistent with a convergent model of V1 input to V5/MT+. Historically, most attempts to model cortical visual responses do not consider the contribution of direct subcortical inputs that may bypass striate cortex, such as input to V5/MT+. We have shown that the signal change driven by these non-striate pathways can be measured, and suggest that models of the intact visual system may benefit from considering their contribution. |
Sara Ajina; Franco Pestilli; Ariel Rokem; Christopher Kennard; Holly Bridge Human blindsight is mediated by an intact geniculo-extrastriate pathway Journal Article eLife, 4 , pp. 1–23, 2015. @article{Ajina2015a, title = {Human blindsight is mediated by an intact geniculo-extrastriate pathway}, author = {Sara Ajina and Franco Pestilli and Ariel Rokem and Christopher Kennard and Holly Bridge}, doi = {10.7554/eLife.08935}, year = {2015}, date = {2015-01-01}, journal = {eLife}, volume = {4}, pages = {1--23}, abstract = {Although damage to the primary visual cortex (V1) causes hemianopia, many patients retain some residual vision; known as blindsight. We show that blindsight may be facilitated by an intact white-matter pathway between the lateral geniculate nucleus and motion area hMT+. Visual psychophysics, diffusion-weighted magnetic resonance imaging and fibre tractography were applied in 17 patients with V1 damage acquired during adulthood and 9 age-matched controls. Individuals with V1 damage were subdivided into blindsight positive (preserved residual vision) and negative (no residual vision) according to psychophysical performance. All blindsight positive individuals showed intact geniculo-hMT+ pathways, while this pathway was significantly impaired or not measurable in blindsight negative individuals. Two white matter pathways previously implicated in blindsight: (i) superior colliculus to hMT+ and (ii) between hMT+ in each hemisphere were not consistently present in blindsight positive cases. Understanding the visual pathways crucial for residual vision may direct future rehabilitation strategies for hemianopia patients.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Although damage to the primary visual cortex (V1) causes hemianopia, many patients retain some residual vision; known as blindsight. We show that blindsight may be facilitated by an intact white-matter pathway between the lateral geniculate nucleus and motion area hMT+. Visual psychophysics, diffusion-weighted magnetic resonance imaging and fibre tractography were applied in 17 patients with V1 damage acquired during adulthood and 9 age-matched controls. Individuals with V1 damage were subdivided into blindsight positive (preserved residual vision) and negative (no residual vision) according to psychophysical performance. All blindsight positive individuals showed intact geniculo-hMT+ pathways, while this pathway was significantly impaired or not measurable in blindsight negative individuals. Two white matter pathways previously implicated in blindsight: (i) superior colliculus to hMT+ and (ii) between hMT+ in each hemisphere were not consistently present in blindsight positive cases. Understanding the visual pathways crucial for residual vision may direct future rehabilitation strategies for hemianopia patients. |
Sara Ajina; Geraint Rees; Christopher Kennard; Holly Bridge Abnormal contrast responses in the extrastriate cortex of blindsight patients Journal Article Journal of Neuroscience, 35 (21), pp. 8201–8213, 2015. @article{Ajina2015b, title = {Abnormal contrast responses in the extrastriate cortex of blindsight patients}, author = {Sara Ajina and Geraint Rees and Christopher Kennard and Holly Bridge}, doi = {10.1523/JNEUROSCI.3075-14.2015}, year = {2015}, date = {2015-01-01}, journal = {Journal of Neuroscience}, volume = {35}, number = {21}, pages = {8201--8213}, abstract = {When the human primary visual cortex (V1) is damaged, the dominant geniculo-striate pathway can no longer convey visual information to the occipital cortex. However, many patients with such damage retain some residual visual function that must rely on an alternative pathway directly to extrastriate occipital regions. This residual vision is most robust for moving stimuli, suggesting a role for motion area hMT+. However, residual vision also requires high-contrast stimuli, which is inconsistent with hMT+ sensitivity to contrast in which even low-contrast levels elicit near-maximal neural activation. We sought to investigate this discrepancy by measuring behavioral and neural responses to increasing contrast in patients with V1 damage. Eight patients underwent behavioral testing and functional magnetic resonance imaging to record contrast sensitivity in hMT+ of their damaged hemisphere, using Gabor stimuli with a spatial frequency of 1 cycle/degrees. The responses from hMT+ of the blind hemisphere were compared with hMT+ and V1 responses in the sighted hemisphere of patients and a group of age-matched controls. Unlike hMT+, neural responses in V1 tend to increase linearly with increasing contrast, likely reflecting a dominant parvocellular channel input. Across all patients, the responses in hMT+ of the blind hemisphere no longer showed early saturation but increased linearly with contrast. Given the spatiotemporal parameters used in this study and the known direct subcortical projections from the koniocellular layers of the lateral geniculate nucleus to hMT+, we propose that this altered contrast sensitivity in hMT+ could be consistent with input from the koniocellular pathway.}, keywords = {}, pubstate = {published}, tppubtype = {article} } When the human primary visual cortex (V1) is damaged, the dominant geniculo-striate pathway can no longer convey visual information to the occipital cortex. However, many patients with such damage retain some residual visual function that must rely on an alternative pathway directly to extrastriate occipital regions. This residual vision is most robust for moving stimuli, suggesting a role for motion area hMT+. However, residual vision also requires high-contrast stimuli, which is inconsistent with hMT+ sensitivity to contrast in which even low-contrast levels elicit near-maximal neural activation. We sought to investigate this discrepancy by measuring behavioral and neural responses to increasing contrast in patients with V1 damage. Eight patients underwent behavioral testing and functional magnetic resonance imaging to record contrast sensitivity in hMT+ of their damaged hemisphere, using Gabor stimuli with a spatial frequency of 1 cycle/degrees. The responses from hMT+ of the blind hemisphere were compared with hMT+ and V1 responses in the sighted hemisphere of patients and a group of age-matched controls. Unlike hMT+, neural responses in V1 tend to increase linearly with increasing contrast, likely reflecting a dominant parvocellular channel input. Across all patients, the responses in hMT+ of the blind hemisphere no longer showed early saturation but increased linearly with contrast. Given the spatiotemporal parameters used in this study and the known direct subcortical projections from the koniocellular layers of the lateral geniculate nucleus to hMT+, we propose that this altered contrast sensitivity in hMT+ could be consistent with input from the koniocellular pathway. |
Sara Ajina; Holly Bridge Blindsight relies on a functional connection between hMT+ and the lateral geniculate nucleus, not the pulvinar Journal Article PLoS Biology, 16 (7), pp. e2005769, 2018. @article{Ajina2018, title = {Blindsight relies on a functional connection between hMT+ and the lateral geniculate nucleus, not the pulvinar}, author = {Sara Ajina and Holly Bridge}, doi = {10.1371/journal.pbio.2005769}, year = {2018}, date = {2018-01-01}, journal = {PLoS Biology}, volume = {16}, number = {7}, pages = {e2005769}, abstract = {When the primary visual cortex (V1) is damaged, the principal visual pathway is lost, causing a loss of vision in the opposite visual field. While conscious vision is impaired, patients can still respond to certain images; this is known as ‘blindsight'. Recently, a direct anatomical connection between the lateral geniculate nucleus (LGN) and human motion area hMT+ has been implicated in blindsight. However, a functional connection between these structures has not been demonstrated. We quantified functional MRI responses to motion in 14 patients with unilateral V1 damage (with and without blindsight). Patients with blindsight showed significant activity and a preserved sensitivity to speed in motion area hMT+, which was absent in patients without blindsight. We then compared functional connectivity between motion area hMT+ and a number of structures implicated in blindsight, including the ventral pulvinar. Only patients with blindsight showed an intact functional connection with the LGN but not the other structures, supporting a specific functional role for the LGN in blindsight.}, keywords = {}, pubstate = {published}, tppubtype = {article} } When the primary visual cortex (V1) is damaged, the principal visual pathway is lost, causing a loss of vision in the opposite visual field. While conscious vision is impaired, patients can still respond to certain images; this is known as ‘blindsight'. Recently, a direct anatomical connection between the lateral geniculate nucleus (LGN) and human motion area hMT+ has been implicated in blindsight. However, a functional connection between these structures has not been demonstrated. We quantified functional MRI responses to motion in 14 patients with unilateral V1 damage (with and without blindsight). Patients with blindsight showed significant activity and a preserved sensitivity to speed in motion area hMT+, which was absent in patients without blindsight. We then compared functional connectivity between motion area hMT+ and a number of structures implicated in blindsight, including the ventral pulvinar. Only patients with blindsight showed an intact functional connection with the LGN but not the other structures, supporting a specific functional role for the LGN in blindsight. |
Sara Ajina; Holly Bridge Subcortical pathways to extrastriate visual cortex underlie residual vision following bilateral damage to V1 Journal Article Neuropsychologia, 128 , pp. 140–149, 2019. @article{Ajina2019, title = {Subcortical pathways to extrastriate visual cortex underlie residual vision following bilateral damage to V1}, author = {Sara Ajina and Holly Bridge}, doi = {10.1016/j.neuropsychologia.2018.01.007}, year = {2019}, date = {2019-01-01}, journal = {Neuropsychologia}, volume = {128}, pages = {140--149}, publisher = {Elsevier Ltd}, abstract = {Residual vision, or blindsight, following damage to the primary visual cortex (V1) has been investigated for almost half a century. While there have been many studies of patients with unilateral damage to V1, far fewer have examined bilateral damage, mainly due to the rarity of such patients. Here we re-examine the residual visual function and underlying pathways of previously studied patient SBR who, as a young adult, suffered bilateral damage restricted to V1 which rendered him cortically blind. While earlier work compared his visual cortex to healthy, sighted participants, here we consider how his visual responses and connections compare to patients with unilateral damage to V1 in addition to sighted participants. Detection of drifting Gabor patches of different contrasts (1%, 5%, 10%, 50% and 100%) was tested in SBR and a group of eight patients with unilateral damage to V1. Performance was compared to the neural activation in motion area hMT+ measured using functional magnetic resonance imaging. Diffusion tractography was also used to determine the white matter microstructure of the visual pathways in all participants. Like the patients with unilateral damage, patient SBR showed increased % BOLD signal change to the high contrast stimuli that he could detect compared to the lower contrast stimuli that were not detectable. Diffusion tractography suggests this information is conveyed by a direct pathway between the lateral geniculate nucleus (LGN) and hMT+ since this pathway had microstructure that was comparable to the healthy control group. In contrast, the pathway between LGN and V1 had reduced integrity compared to controls. A further finding of note was that, unlike control participants, SBR showed similar patterns of contralateral and ipsilateral activity in hMT+, in addition to healthy white matter microstructure in the tract connecting hMT+ between the two hemispheres. This raises the possibility of increased connectivity between the two hemispheres in the absence of V1 input. In conclusion, the pattern of visual function and anatomy in bilateral cortical damage is comparable to that seen in a group of patients with unilateral damage. Thus, while the intact hemisphere may play a role in residual vision in patients with unilateral damage, its influence is not evident with the methodology employed here.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Residual vision, or blindsight, following damage to the primary visual cortex (V1) has been investigated for almost half a century. While there have been many studies of patients with unilateral damage to V1, far fewer have examined bilateral damage, mainly due to the rarity of such patients. Here we re-examine the residual visual function and underlying pathways of previously studied patient SBR who, as a young adult, suffered bilateral damage restricted to V1 which rendered him cortically blind. While earlier work compared his visual cortex to healthy, sighted participants, here we consider how his visual responses and connections compare to patients with unilateral damage to V1 in addition to sighted participants. Detection of drifting Gabor patches of different contrasts (1%, 5%, 10%, 50% and 100%) was tested in SBR and a group of eight patients with unilateral damage to V1. Performance was compared to the neural activation in motion area hMT+ measured using functional magnetic resonance imaging. Diffusion tractography was also used to determine the white matter microstructure of the visual pathways in all participants. Like the patients with unilateral damage, patient SBR showed increased % BOLD signal change to the high contrast stimuli that he could detect compared to the lower contrast stimuli that were not detectable. Diffusion tractography suggests this information is conveyed by a direct pathway between the lateral geniculate nucleus (LGN) and hMT+ since this pathway had microstructure that was comparable to the healthy control group. In contrast, the pathway between LGN and V1 had reduced integrity compared to controls. A further finding of note was that, unlike control participants, SBR showed similar patterns of contralateral and ipsilateral activity in hMT+, in addition to healthy white matter microstructure in the tract connecting hMT+ between the two hemispheres. This raises the possibility of increased connectivity between the two hemispheres in the absence of V1 input. In conclusion, the pattern of visual function and anatomy in bilateral cortical damage is comparable to that seen in a group of patients with unilateral damage. Thus, while the intact hemisphere may play a role in residual vision in patients with unilateral damage, its influence is not evident with the methodology employed here. |
Sara Ajina; Miriam Pollard; Holly Bridge The superior colliculus and amygdala support evaluation of face trait in blindsight Journal Article Frontiers in Neurology, 11 , pp. 1–18, 2020. @article{Ajina2020, title = {The superior colliculus and amygdala support evaluation of face trait in blindsight}, author = {Sara Ajina and Miriam Pollard and Holly Bridge}, doi = {10.3389/fneur.2020.00769}, year = {2020}, date = {2020-01-01}, journal = {Frontiers in Neurology}, volume = {11}, pages = {1--18}, abstract = {Humans can respond rapidly to viewed expressions of fear, even in the absence of conscious awareness. This is demonstrated using visual masking paradigms in healthy individuals and in patients with cortical blindness due to damage to the primary visual cortex (V1) - so called affective blindsight. Humans have also been shown to implicitly process facial expressions representing important social dimensions. Two major axes, dominance and trustworthiness, are proposed to characterize the social dimensions of face evaluation. The processing of both types of implicit stimuli is believed to occur via similar subcortical pathways involving the amygdala. However, we do not know whether unconscious processing of more subtle expressions of facial traits can occur in blindsight, and if so, how. To test this, we studied 13 patients with unilateral V1 damage and visual field loss. We assessed their ability to detect and discriminate faces that had been manipulated along two orthogonal axes of trustworthiness and dominance to generate five trait levels inside the blind visual field: dominant, submissive, trustworthy, untrustworthy, and neutral. We compared neural activity and functional connectivity in patients classified as blindsight positive or negative for these stimuli. We found that dominant faces were most likely to be detected above chance, with individuals demonstrating unique interactions between performance and face trait. Only patients with blindsight (n = 8) showed significant preference in the superior colliculus and amygdala for face traits in the blind visual field, and a critical functional connection between the amygdala and superior colliculus in the damaged hemisphere. We also found a significant correlation between behavioral performance and fMRI activity in the amygdala and lateral geniculate nucleus across all participants. Our findings confirm that affective blindsight involving the superior colliculus and amygdala extends to the processing of socially salient but emotionally neutral facial expressions when V1 is damaged. This pathway is distinct from that which supports motion blindsight, as both types of blindsight can exist in the absence of the other with corresponding patterns of residual connectivity.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Humans can respond rapidly to viewed expressions of fear, even in the absence of conscious awareness. This is demonstrated using visual masking paradigms in healthy individuals and in patients with cortical blindness due to damage to the primary visual cortex (V1) - so called affective blindsight. Humans have also been shown to implicitly process facial expressions representing important social dimensions. Two major axes, dominance and trustworthiness, are proposed to characterize the social dimensions of face evaluation. The processing of both types of implicit stimuli is believed to occur via similar subcortical pathways involving the amygdala. However, we do not know whether unconscious processing of more subtle expressions of facial traits can occur in blindsight, and if so, how. To test this, we studied 13 patients with unilateral V1 damage and visual field loss. We assessed their ability to detect and discriminate faces that had been manipulated along two orthogonal axes of trustworthiness and dominance to generate five trait levels inside the blind visual field: dominant, submissive, trustworthy, untrustworthy, and neutral. We compared neural activity and functional connectivity in patients classified as blindsight positive or negative for these stimuli. We found that dominant faces were most likely to be detected above chance, with individuals demonstrating unique interactions between performance and face trait. Only patients with blindsight (n = 8) showed significant preference in the superior colliculus and amygdala for face traits in the blind visual field, and a critical functional connection between the amygdala and superior colliculus in the damaged hemisphere. We also found a significant correlation between behavioral performance and fMRI activity in the amygdala and lateral geniculate nucleus across all participants. Our findings confirm that affective blindsight involving the superior colliculus and amygdala extends to the processing of socially salient but emotionally neutral facial expressions when V1 is damaged. This pathway is distinct from that which supports motion blindsight, as both types of blindsight can exist in the absence of the other with corresponding patterns of residual connectivity. |
Başak Akdoğan; Fuat Balcı; Hedderik van Rijn Temporal expectation indexed by pupillary response Journal Article Timing & Time Perception, 4 (4), pp. 354–370, 2016. @article{Akdogan2016, title = {Temporal expectation indexed by pupillary response}, author = {Başak Akdoğan and Fuat Balcı and Hedderik van Rijn}, doi = {10.1163/22134468-00002075}, year = {2016}, date = {2016-01-01}, journal = {Timing & Time Perception}, volume = {4}, number = {4}, pages = {354--370}, abstract = {Forming temporal expectations plays an instrumental role for the optimization of behavior and allo- cation of attentional resources. Although the effects of temporal expectations on visual attention are well-established, the question of whether temporal predictions modulate the behavioral outputs of the autonomic nervous system such as the pupillary response remains unanswered. Therefore, this study aimed to obtain an online measure of pupil size while human participants were asked to dif- ferentiate between visual targets presented after varying time intervals since trial onset. Specifically, we manipulated temporal predictability in the presentation of target stimuli consisting of letters which appeared after either a short or long delay duration (1.5 vs. 3 s) in the majority of trials (75%) within different test blocks. In the remaining trials (25%), no target stimulus was present to investi- gate the trajectory of preparatory pupillary response under a low level of temporal uncertainty. The results revealed that the rate of preparatory pupillary response was contingent upon the time of target appearance such that pupils dilated at a higher rate when the targets were expected to appear after a shorter as compared to a longer delay period irrespective of target presence. The finding that pupil size can track temporal regularities and exhibit differential preparatory response between dif- ferent delay conditions points to the existence of a distributed neural network subserving temporal information processing which is crucial for cognitive functioning and goal-directed behavior.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Forming temporal expectations plays an instrumental role for the optimization of behavior and allo- cation of attentional resources. Although the effects of temporal expectations on visual attention are well-established, the question of whether temporal predictions modulate the behavioral outputs of the autonomic nervous system such as the pupillary response remains unanswered. Therefore, this study aimed to obtain an online measure of pupil size while human participants were asked to dif- ferentiate between visual targets presented after varying time intervals since trial onset. Specifically, we manipulated temporal predictability in the presentation of target stimuli consisting of letters which appeared after either a short or long delay duration (1.5 vs. 3 s) in the majority of trials (75%) within different test blocks. In the remaining trials (25%), no target stimulus was present to investi- gate the trajectory of preparatory pupillary response under a low level of temporal uncertainty. The results revealed that the rate of preparatory pupillary response was contingent upon the time of target appearance such that pupils dilated at a higher rate when the targets were expected to appear after a shorter as compared to a longer delay period irrespective of target presence. The finding that pupil size can track temporal regularities and exhibit differential preparatory response between dif- ferent delay conditions points to the existence of a distributed neural network subserving temporal information processing which is crucial for cognitive functioning and goal-directed behavior. |
Ozgur E Akman; Richard A Clement; David S Broomhead; Sabira K Mannan; Ian Moorhead; Hugh R Wilson Probing bottom-up processing with multistable images Journal Article Journal of Eye Movement Research, 1 (3), pp. 1–7, 2009. @article{Akman2009, title = {Probing bottom-up processing with multistable images}, author = {Ozgur E Akman and Richard A Clement and David S Broomhead and Sabira K Mannan and Ian Moorhead and Hugh R Wilson}, year = {2009}, date = {2009-01-01}, journal = {Journal of Eye Movement Research}, volume = {1}, number = {3}, pages = {1--7}, abstract = {The selection of fixation targets involves a combination of top-down and bottom-up processing. The role of bottom-up processing can be enhanced by using multistable stimuli because their constantly changing appearance seems to depend predominantly on stimulusdriven factors. We used this approach to investigate whether visual processing models based on V1 need to be extended to incorporate specific computations attributed to V4. Eye movements of 8 subjects were recorded during free viewing of the Marroquin pattern in which illusory circles appear and disappear. Fixations were concentrated on features arranged in concentric rings within the pattern. Comparison with simulated fixation data demonstrated that the saliency of these features can be predicted with appropriate weighting of lateral connections in existing V1 models.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The selection of fixation targets involves a combination of top-down and bottom-up processing. The role of bottom-up processing can be enhanced by using multistable stimuli because their constantly changing appearance seems to depend predominantly on stimulusdriven factors. We used this approach to investigate whether visual processing models based on V1 need to be extended to incorporate specific computations attributed to V4. Eye movements of 8 subjects were recorded during free viewing of the Marroquin pattern in which illusory circles appear and disappear. Fixations were concentrated on features arranged in concentric rings within the pattern. Comparison with simulated fixation data demonstrated that the saliency of these features can be predicted with appropriate weighting of lateral connections in existing V1 models. |
Umair Akram; Jason G Ellis; Andriy Myachykov; Nicola L Barclay Preferential attention towards the eye-region amongst individuals with insomnia Journal Article Journal of Sleep Research, 26 (1), pp. 84–91, 2017. @article{Akram2017, title = {Preferential attention towards the eye-region amongst individuals with insomnia}, author = {Umair Akram and Jason G Ellis and Andriy Myachykov and Nicola L Barclay}, doi = {10.1111/jsr.12456}, year = {2017}, date = {2017-01-01}, journal = {Journal of Sleep Research}, volume = {26}, number = {1}, pages = {84--91}, abstract = {People with insomnia often perceive their own facial appearance as more tired compared with the appearance of others. Evidence also highlights the eye-region in projecting tiredness cues to perceivers, and tiredness judgements often rely on preferential attention towards this region. Using a novel eye-tracking paradigm, this study examined: (i) whether individuals with insomnia display preferential attention towards the eyeregion, relative to nose and mouth regions, whilst observing faces compared with normal-sleepers; and (ii) whether an attentional bias towards the eye-region amongst individuals with insomnia is self-specific or general in nature. Twenty individuals with DSM-5 Insomnia Disorder and 20 normal-sleepers viewed 48 neutral facial photographs (24 of themselves, 24 of other people) for periods of 4000 ms. Eye movements were recorded using eye-tracking, and first fixation onset, first fixation duration and total gaze duration were examined for three interest-regions (eyes, nose, mouth). Significant group 9 interest-region interactions indicated that, regardless of the face presented, participants with insomnia were quicker to attend to, and spent more time observing, the eye-region relative to the nose and mouth regions compared with normal-sleepers. However, no group 9 face 9 interest-region interactions were established. Thus, whilst individuals with insomnia displayed preferential attention towards the eye-region in general, this effect was not accentuated during self-perception. Insomnia appears to be characterized by a general, rather than self-specific, attentional bias towards the eye-region. These findings contribute to our understanding of face perception in insomnia, and provide tentative support for cognitive models of insomnia demonstrating that individuals with insomnia monitor faces in general, with a specific focus around the eye-region, for cues associated with tiredness.}, keywords = {}, pubstate = {published}, tppubtype = {article} } People with insomnia often perceive their own facial appearance as more tired compared with the appearance of others. Evidence also highlights the eye-region in projecting tiredness cues to perceivers, and tiredness judgements often rely on preferential attention towards this region. Using a novel eye-tracking paradigm, this study examined: (i) whether individuals with insomnia display preferential attention towards the eyeregion, relative to nose and mouth regions, whilst observing faces compared with normal-sleepers; and (ii) whether an attentional bias towards the eye-region amongst individuals with insomnia is self-specific or general in nature. Twenty individuals with DSM-5 Insomnia Disorder and 20 normal-sleepers viewed 48 neutral facial photographs (24 of themselves, 24 of other people) for periods of 4000 ms. Eye movements were recorded using eye-tracking, and first fixation onset, first fixation duration and total gaze duration were examined for three interest-regions (eyes, nose, mouth). Significant group 9 interest-region interactions indicated that, regardless of the face presented, participants with insomnia were quicker to attend to, and spent more time observing, the eye-region relative to the nose and mouth regions compared with normal-sleepers. However, no group 9 face 9 interest-region interactions were established. Thus, whilst individuals with insomnia displayed preferential attention towards the eye-region in general, this effect was not accentuated during self-perception. Insomnia appears to be characterized by a general, rather than self-specific, attentional bias towards the eye-region. These findings contribute to our understanding of face perception in insomnia, and provide tentative support for cognitive models of insomnia demonstrating that individuals with insomnia monitor faces in general, with a specific focus around the eye-region, for cues associated with tiredness. |
Evin Aktar; Maartje E J Raijmakers; Mariska E Kret Pupil mimicry in infants and parents Journal Article Cognition and Emotion, 34 (6), pp. 1160–1170, 2020. @article{Aktar2020, title = {Pupil mimicry in infants and parents}, author = {Evin Aktar and Maartje E J Raijmakers and Mariska E Kret}, doi = {10.1080/02699931.2020.1732875}, year = {2020}, date = {2020-01-01}, journal = {Cognition and Emotion}, volume = {34}, number = {6}, pages = {1160--1170}, publisher = {Taylor & Francis}, abstract = {Changes in pupil size can reflect social interest or affect, and tend to get mimicked by observers during eye contact. Pupil mimicry has recently been observed in young infants, whereas it is unknown whether the extent and the speed of infants' pupil mimicry response are identical to that of adults. Moreover, the question of whether pupil mimicry in infants is modulated by the race of the observed other remains to be explored. In two studies, pupil mimicry was investigated in infants and their parents. In the first study, 6-, 12- and 18-month-olds (n = 194) and their parents (n = 192) observed eyes with dynamically dilating, constricting, or static pupils. Infants mimicked the pupil sizes of the observed eyes like their parents, but responded slower. Study 2 replicated these findings in a new sample of infants (n = 55, 12-month-olds) and parents (n = 64), and further showed that the pupil mimicry response was not significantly modulated by the race of the observed partner neither in infants nor in parents. We conclude that pupil mimicry is an ancient bonding mechanism that helps to connect people.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Changes in pupil size can reflect social interest or affect, and tend to get mimicked by observers during eye contact. Pupil mimicry has recently been observed in young infants, whereas it is unknown whether the extent and the speed of infants' pupil mimicry response are identical to that of adults. Moreover, the question of whether pupil mimicry in infants is modulated by the race of the observed other remains to be explored. In two studies, pupil mimicry was investigated in infants and their parents. In the first study, 6-, 12- and 18-month-olds (n = 194) and their parents (n = 192) observed eyes with dynamically dilating, constricting, or static pupils. Infants mimicked the pupil sizes of the observed eyes like their parents, but responded slower. Study 2 replicated these findings in a new sample of infants (n = 55, 12-month-olds) and parents (n = 64), and further showed that the pupil mimicry response was not significantly modulated by the race of the observed partner neither in infants nor in parents. We conclude that pupil mimicry is an ancient bonding mechanism that helps to connect people. |
Nadia Alahyane; Denis Pélisson Adaptation of saccadic eye movements: Transfer and specificity Journal Article Annals of the New York Academy of Sciences, 1004 (1), pp. 69–77, 2003. @article{Alahyane2003, title = {Adaptation of saccadic eye movements: Transfer and specificity}, author = {Nadia Alahyane and Denis Pélisson}, doi = {10.1196/annals.1303.008}, year = {2003}, date = {2003-01-01}, journal = {Annals of the New York Academy of Sciences}, volume = {1004}, number = {1}, pages = {69--77}, abstract = {The present study was designed to test whether the adaptation of saccadic eye movements depends only on the eye displacement vector of the trained saccade or also on eye position information. Using the double-step target paradigm in eight human subjects, we first induced in a single session two "opposite directions adaptations" (ODA) of horizontal saccades of the same vector. Each ODA (backward or forward) was linked to one vertical eye position (12.5 degrees up or 25 degrees down) and alternated from trial to trial. The results showed that opposite changes of saccade amplitude can develop simultaneously, indicating that saccadic adaptation depends on orbital eye position. This finding has important functional implications because in everyday life our eyes saccade from constantly changing orbital positions. A comparison of these data to two control conditions in which training trials of a single type (backward or forward) were presented at both 12.5 degrees and -25 degrees eye elevations further indicated that eye position specificity is complete for backward, but not for forward, adaptation. Finally, the control conditions also indicated that the adaptation of a single saccade fully transferred to untrained saccades of the same vector, but initiated from different vertical eye positions. In conclusion, our study indicates that saccadic adaptation mechanisms use vectorial eye displacement signals, but can also take eye position signals into account as a contextual cue when the training involves conflicting saccade amplitude changes}, keywords = {}, pubstate = {published}, tppubtype = {article} } The present study was designed to test whether the adaptation of saccadic eye movements depends only on the eye displacement vector of the trained saccade or also on eye position information. Using the double-step target paradigm in eight human subjects, we first induced in a single session two "opposite directions adaptations" (ODA) of horizontal saccades of the same vector. Each ODA (backward or forward) was linked to one vertical eye position (12.5 degrees up or 25 degrees down) and alternated from trial to trial. The results showed that opposite changes of saccade amplitude can develop simultaneously, indicating that saccadic adaptation depends on orbital eye position. This finding has important functional implications because in everyday life our eyes saccade from constantly changing orbital positions. A comparison of these data to two control conditions in which training trials of a single type (backward or forward) were presented at both 12.5 degrees and -25 degrees eye elevations further indicated that eye position specificity is complete for backward, but not for forward, adaptation. Finally, the control conditions also indicated that the adaptation of a single saccade fully transferred to untrained saccades of the same vector, but initiated from different vertical eye positions. In conclusion, our study indicates that saccadic adaptation mechanisms use vectorial eye displacement signals, but can also take eye position signals into account as a contextual cue when the training involves conflicting saccade amplitude changes |
Nadia Alahyane; Ansgar Koene; Denis Pélisson Transfer of adaptation from visually guided saccades to averaging saccades elicited by double visual targets Journal Article European Journal of Neuroscience, 20 (3), pp. 827–836, 2004. @article{Alahyane2004a, title = {Transfer of adaptation from visually guided saccades to averaging saccades elicited by double visual targets}, author = {Nadia Alahyane and Ansgar Koene and Denis Pélisson}, doi = {10.1111/j.1460-9568.2004.03536.x}, year = {2004}, date = {2004-01-01}, journal = {European Journal of Neuroscience}, volume = {20}, number = {3}, pages = {827--836}, abstract = {The adaptive mechanisms that control the amplitude of visually guided saccades (VGS) are only partially elucidated. In this study, we investigated, in six human subjects, the transfer of VGS adaptation to averaging saccades elicited by the simultaneous presentation of two visual targets. The generation of averaging saccades requires the transformation of two representations encoding the desired eye displacement toward each of the two targets into a single representation encoding the averaging saccade (averaging programming site). We aimed to evaluate whether VGS adaptation acts upstream (hypothesis 1) or at/below (hypothesis 2) the level of averaging saccades programming. Using the double-step target paradigm, we simultaneously induced a backward adaptation of 17.5 degrees horizontal VGS and a forward adaptation of 17.5 degrees oblique VGS performed along the +/- 40 degrees directions relative to the azimuth. We measured the effects of this dual adaptation protocol on averaging saccades triggered by two simultaneous targets located at 17.5 degrees along the +/- 40 degrees directions. To increase the yield of averaging saccades, we instructed the subjects to move their eyes as fast as possible to an intermediate position between the two targets. We found that the amplitude of averaging saccades was smaller after VGS adaptation than before and differed significantly from that predicted by hypothesis 1, but not by hypothesis 2, with an adaptation transfer of 50%. These findings indicate that VGS adaptation largely occurs at/below the averaging saccade programming site. Based on current knowledge of the neural substrate of averaging saccades, we suggest that VGS adaptation mainly acts at the level of the superior colliculus or downstream.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The adaptive mechanisms that control the amplitude of visually guided saccades (VGS) are only partially elucidated. In this study, we investigated, in six human subjects, the transfer of VGS adaptation to averaging saccades elicited by the simultaneous presentation of two visual targets. The generation of averaging saccades requires the transformation of two representations encoding the desired eye displacement toward each of the two targets into a single representation encoding the averaging saccade (averaging programming site). We aimed to evaluate whether VGS adaptation acts upstream (hypothesis 1) or at/below (hypothesis 2) the level of averaging saccades programming. Using the double-step target paradigm, we simultaneously induced a backward adaptation of 17.5 degrees horizontal VGS and a forward adaptation of 17.5 degrees oblique VGS performed along the +/- 40 degrees directions relative to the azimuth. We measured the effects of this dual adaptation protocol on averaging saccades triggered by two simultaneous targets located at 17.5 degrees along the +/- 40 degrees directions. To increase the yield of averaging saccades, we instructed the subjects to move their eyes as fast as possible to an intermediate position between the two targets. We found that the amplitude of averaging saccades was smaller after VGS adaptation than before and differed significantly from that predicted by hypothesis 1, but not by hypothesis 2, with an adaptation transfer of 50%. These findings indicate that VGS adaptation largely occurs at/below the averaging saccade programming site. Based on current knowledge of the neural substrate of averaging saccades, we suggest that VGS adaptation mainly acts at the level of the superior colliculus or downstream. |