EyeLink fMRI/MEG出版物
所有EyeLink功能磁共振成像和MEG研究出版物(同时进行眼睛跟踪)至2023年(一些早于2024年)均按年份列出。您可以使用Visual Cortex、Neural Plasticity、MEG等关键词搜索出版物。您还可以搜索个人作者姓名。如果我们错过了任何EyeLink功能磁共振成像或MEG文章,请给我们发电子邮件!
2023 |
Jonathon Whitlock; Ryan Hubbard; Huiyu Ding; Lili Sahakyan Trial-level fluctuations in pupil dilation at encoding reflect strength of relational binding. Journal Article In: Journal of Experimental Psychology: Learning, Memory, and Cognition, pp. 1–18, 2023. @article{Whitlock2023, Eye-tracking methodologies have revealed that eye movements and pupil dilations are influenced by our previous experiences. Dynamic fluctuations in pupil size during learning reflect in part the formation of memories for learned information, while viewing behavior during memory testing is influenced by memory retrieval and drawn to previously learned associations. However, no study to date has linked fluctuations in pupil dilation at encoding to the magnitude of viewing behavior at test. The current investigation involved monitoring eye movements both in single item recognition and relational recognition tasks. In the item task, all faces were presented with the same background scene and memory for faces was subsequently tested, whereas in the relational task each face was presented with its own unique background scene and memory for the face-scene association was subsequently tested. Pupil size changes during encoding predicted the magnitude of preferential viewing during test, as well as future recognition accuracy. These effects emerged only in the relational task, but not in the item task, and were replicated in an additional experiment in which stimulus luminance was more tightly controlled. A follow-up experiment and additional analyses ruled out differences in orienting instructions or number of fixations to the encoding display as explanations of the observed effects. The results shed light on the links between pupil dilation, memory encoding, and eye movement patterns during recognition and suggest that trial-level fluctuations in pupil dilation during encoding reflect relational binding of items to their context rather than general memory formation or strength. |
Robert L. Whitwell; Mehul A. Garach; Melvyn A. Goodale; Irene Sperandio In: Philosophical Transactions of the Royal Society B: Biological Sciences, vol. 378, no. 1869, pp. 1–11, 2023. @article{Whitwell2023, Perceiving and grasping an object present an animal with different sets of computational problems. The solution in primates entails the specialization of separate neural networks for visual processing with different object representations. This explains why the Ebbinghaus illusion minimally affects the grasping hand's in-flight aperture, which normally scales with target size, even though the size of the target disc remains misperceived. An attractive alternative account, however, posits that grasps are refractory to the illusion because participants fixate on the target and fail to attend to the surrounding context. To test this account, we tracked both limb and gaze while participants made forced-choice judgments of relative disc size in the Ebbinghaus illusion or did so in combination with grasping or manually estimating the size of one of the discs. We replicated the classic dissociation: grasp aperture was refractory to the measured illusory effect on perceived size, while judgments and manual estimates of disc size were not. Importantly, the number of display-wide saccades per second and the percentage of total fixation time or fixations directed at the selected disc failed to explain the dissociation. Our findings support the contention that object perception and goal-directed action rely on distinct visual representations. This article is part of a discussion meeting issue 'New approaches to 3D vision'. |
Bogusława Whyatt; Olga Witczak; Ewa Tomczak-Łukaszewska; Olha Lehka-Paul The proof of the translation process is in the reading of the target text: An eyetracking reception study Journal Article In: Ampersand, vol. 11, pp. 1–10, 2023. @article{Whyatt2023, This article is an attempt to bridge the divide between translation process research (TPR) which has investigated how translators as specialised bilingual professionals use their expertise to translate texts and translation reception which explores how the texts are read and received by the target language readers. Over the last thirty years, TPR has provided empirically grounded findings to demonstrate the complexity of the cognitive processes in the translator's mind but much less empirical interest has been paid to how translated texts are read and processed by the readers. To redress this imbalance, we hypothesise that the cognitive effort invested in reading a translated text can be taken as proof of how successful the translation process has been. We report on an exploratory study in which two groups of participants read a high-quality and a low-quality translation of the same text while their eye movements were recorded by an eyetracker. We compare the readers' cognitive effort indexed by character-adjusted dwell time, number of runs and re-reading in the second and third run with the translators' character-adjusted cognitive effort invested in producing the target texts. The results show that the relationship between the translation process and the reading experience is not straightforward and depends on the quality of the target text. |
Susanne M. Veen; Robert A. Perera; Laura Manning-Franke; Amma A. Agyemang; Karen Skop; Scott R. Sponheim; Elisabeth A. Wilde; Alexander Stamenkovic; James S. Thomas; William C. Walker Executive function and relation to static balance metrics in chronic mild TBI: A LIMBIC-CENC secondary analysis Journal Article In: Frontiers in Neurology, vol. 13, pp. 1–16, 2023. @article{Veen2023, Introduction: Among patients with traumatic brain injury (TBI), postural instability often persists chronically with negative consequences such as higher fall risk. One explanation may be reduced executive function (EF) required to effectively process, interpret and combine, sensory information. In other populations, a decline in higher cognitive functions are associated with a decline in walking and balance skills. Considering the link between EF decline and reduction in functional capacity, we investigated whether specific tests of executive function could predict balance function in a cohort of individuals with a history of chronic mild TBI (mTBI) and compared to individuals with a negative history of mTBI. Methods: Secondary analysis was performed on the local LIMBIC-CENC cohort (N = 338, 259 mTBI, mean 45 ± STD 10 age). Static balance was assessed with the sensory organization test (SOT). Hierarchical regression was used for each EF test outcome using the following blocks: (1) the number of TBIs sustained, age, and sex; (2) the separate Trail making test (TMT); (3) anti-saccade eye tracking items (error, latency, and accuracy); (4) Oddball distractor stimulus P300 and N200 at PZ and FZ response; and (5) Oddball target stimulus P300 and N200 at PZ and FZ response. Results: The full model with all predictors accounted for between 15.2% and 21.5% of the variability in the balance measures. The number of TBI's) showed a negative association with the SOT2 score (p = 0.002). Additionally, longer times to complete TMT part B were shown to be related to a worse SOT1 score (p = 0.038). EEG distractors had the most influence on the SOT3 score (p = 0.019). Lastly, the SOT-composite and SOT5 scores were shown to be associated with longer inhibition latencies and errors (anti-saccade latency and error |
Olof J. Werf; Teresa Schuhmann; Tom Graaf; Sanne Ten Oever; Alexander T. Sack Investigating the role of task relevance during rhythmic sampling of spatial locations Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–11, 2023. @article{Werf2023, Recently it has been discovered that visuospatial attention operates rhythmically, rather than being stably employed over time. A low-frequency 7–8 Hz rhythmic mechanism coordinates periodic windows to sample relevant locations and to shift towards other, less relevant locations in a visual scene. Rhythmic sampling theories would predict that when two locations are relevant 8 Hz sampling mechanisms split into two, effectively resulting in a 4 Hz sampling frequency at each location. Therefore, it is expected that rhythmic sampling is influenced by the relative importance of locations for the task at hand. To test this, we employed an orienting task with an arrow cue, where participants were asked to respond to a target presented in one visual field. The cue-to-target interval was systematically varied, allowing us to assess whether performance follows a rhythmic pattern across cue-to-target delays. We manipulated a location's task relevance by altering the validity of the cue, thereby predicting the correct location in 60%, 80% or 100% of trials. Results revealed significant 4 Hz performance fluctuations at cued right visual field targets with low cue validity (60%), suggesting regular sampling of both locations. With high cue validity (80%), we observed a peak at 8 Hz towards non-cued targets, although not significant. These results were in line with our hypothesis suggesting a goal-directed balancing of attentional sampling (cued location) and shifting (non-cued location) depending on the relevance of locations in a visual scene. However, considering the hemifield specificity of the effect together with the absence of expected effects for cued trials in the high valid conditions we further discuss the interpretation of the data. |
Joeri F. L. Helden; Marnix Naber In: Neuroscience, vol. 509, pp. 201–209, 2023. @article{Helden2023, The inversion of a picture of a face hampers the accuracy and speed at which observers can perceptually process it. Event-related potentials and pupillary responses, successfully used as biomarkers of face inversion in the past, suggest that the perception of visual features, that are organized in an unfamiliar manner, recruits demanding additional processes. However, it remains unclear whether such inversion effects generalize beyond face stimuli and whether indeed more mental effort is needed to process inverted images. Here we aimed to study the effects of natural scene inversion on visual evoked potentials and pupil dilations. We simultaneously measured responses of 47 human participants to presentations of images showing upright or inverted natural scenes. For inverted scenes, we observed relatively stronger occipito-temporo-parietal N1 peak amplitudes and larger pupil dilations (on top of an initial orienting response) than for upright scenes. This study revealed neural and physiological markers of natural scene inversion that are in line with inversion effects of other stimulus types and demonstrates the robustness and generalizability of the phenomenon that unfamiliar configurations of visual content require increased processing effort. |
Elle Heusden; Christian N. L. Olivers; Mieke Donk The effects of eccentricity on attentional capture Journal Article In: Attention, Perception, & Psychophysics, pp. 1–17, 2023. @article{Heusden2023a, Visual attention may be captured by an irrelevant yet salient distractor, thereby slowing search for a relevant target. This phenomenon has been widely studied using the additional singleton paradigm in which search items are typically all presented at one and the same eccentricity. Yet, differences in eccentricity may well bias the competition between target and distractor. Here we investigate how attentional capture is affected by the relative eccentricities of a target and a distractor. Participants searched for a shape-defined target in a grid of homogeneous nontargets of the same color. On 75% of trials, one of the nontarget items was replaced by a salient color-defined distractor. Crucially, target and distractor eccentricities were independently manipulated across three levels of eccentricity (i.e., near, middle, and far). Replicating previous work, we show that the presence of a distractor slows down search. Interestingly, capture as measured by manual reaction times was not affected by target and distractor eccentricity, whereas capture as measured by the eyes was: items close to fixation were more likely to be selected than items presented further away. Furthermore, the effects of target and distractor eccentricity were largely additive, suggesting that the competition between saliency- and relevance-driven selection was modulated by an independent eccentricity-based spatial component. Implications of the dissociation between manual and oculomotor responses are also discussed. |
Elle Heusden; Christian N. L. Olivers; Mieke Donk The eyes prefer targets nearby fixation: Quantifying eccentricity-dependent attentional biases in oculomotor selection Journal Article In: Vision Research, vol. 205, pp. 1–11, 2023. @article{Heusden2023, An important function of peripheral vision is to provide the target of the next eye movement. Here we investigate the extent to which the eyes are biased to select a target closer to fixation over one further away. Participants were presented with displays containing two identical singleton targets and were asked to move their eyes to either one of them. The targets could be presented at three different eccentricities relative to central fixation. In one condition both singletons were presented at the same eccentricity, providing an estimate of the speed of selection at each of the eccentricities. The saccadic latency distributions from this same-eccentricity condition were then used to predict the selection bias when both targets were presented at different eccentricities. The results show that when targets are presented at different eccentricities, participants are biased to select the item closest to fixation. This eccentricity-based bias was considerably stronger than predicted on the basis of saccadic latency distributions in the same-eccentricity condition. This rules out speed of processing per se as a sole explanation for such a bias. Instead, the results are consistent with attentional competition being weighted in favour of items close to fixation. |
Janneke E. P. Leeuwen; Sebastian J. Crutch; Jason D. Warren Thinking eyes: Visual thinking strategies and the social brain Journal Article In: Frontiers in Psychology, vol. 14, pp. 1–16, 2023. @article{Leeuwen2023, The foundation of art processes in the social brain can guide the scientific study of how human beings perceive and interact with their environment. Here, we applied the theoretical frameworks of the social and artistic brain connectomes to an eye-tracking paradigm with the aim to elucidate how different viewing conditions and social cues influence gaze patterns and personal resonance with artworks and complex imagery in healthy adults. We compared two viewing conditions that encourage personal or social perspective taking—modeled on the well-known Visual Thinking Strategies (VTS) method—to a viewing condition during which only contextual information about the image was provided. Our findings showed that the viewing conditions that used VTS techniques directed the gaze more toward highly salient social cues (Animate elements) in artworks and complex imagery, compared to when only contextual information was provided. We furthermore found that audio cues also directed visual attention, whereby listening to a personal reflection by another person (VTS) had a stronger effect than contextual information. However, we found no effect of viewing condition on the personal resonance with the artworks and complex images when taking the random effects of the image selection into account. Our study provides a neurobiological grounding of the VTS method in the social brain, revealing that this pedagogical method of engaging viewers with artworks measurably shapes people's visual exploration patterns. This is not only of relevance to (art) education but also has implications for art-based diagnostic and therapeutic applications. |
Janneke E. P. Leeuwen; Amy McDougall; Dimitris Mylonas; Aida Suárez-González; Sebastian J. Crutch; Jason D. Warren Pupil responses to colorfulness are selectively reduced in healthy older adults Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–16, 2023. @article{Leeuwen2023a, The alignment between visual pathway signaling and pupil dynamics offers a promising non-invasive method to further illuminate the mechanisms of human color perception. However, only limited research has been done in this area and the effects of healthy aging on pupil responses to the different color components have not been studied yet. Here we aim to address this by modelling the effects of color lightness and chroma (colorfulness) on pupil responses in young and older adults, in a closely controlled passive viewing experiment with 26 broad-spectrum digital color fields. We show that pupil responses to color lightness and chroma are independent from each other in both young and older adults. Pupil responses to color lightness levels are unaffected by healthy aging, when correcting for smaller baseline pupil sizes in older adults. Older adults exhibit weaker pupil responses to chroma increases, predominantly along the Green–Magenta axis, while relatively sparing the Blue–Yellow axis. Our findings complement behavioral studies in providing physiological evidence that colors fade with age, with implications for color-based applications and interventions both in healthy aging and later-life neurodegenerative disorders. |
Florence Van Meenen; Nicolas Masson; Leen Catrysse; Liesje Coertjens Taking a closer look at how higher education students process and use (discrepant) peer feedback Journal Article In: Learning and Instruction, vol. 84, pp. 1–11, 2023. @article{VanMeenen2023, Little is known on how students process peer feedback (PF) and use it to improve their work. We asked 59 participants to read the feedback of two peers on a fictional essay and to revise it, while we recorded their gaze behaviour. Regarding the PF processing subphase, discrepant PF led to more transitions, but only for participants who reported the discrepancy afterwards. Counterintuitively, participants who did not report the discrepancy, showed longer first-pass reading times. Concerning the PF use subphase, dwell time on essay correlated positively with the quality of the revised essays assessed by professors. Participants with a high-quality revision spent more time addressing higher order comments, corrected one or two lower order aspects at a time and proofread in the end, in which they went beyond the suggestions provided in the PF. These insights can be used when designing training to foster students' uptake of (discrepant) PF. |
Dirk Moorselaar; Changrun Huang; Jan Theeuwes Electrophysiological indices of distractor processing in visual search are shaped by target expectations Journal Article In: Journal of Cognitive Neuroscience, vol. 35, no. 6, pp. 1032–1044, 2023. @article{Moorselaar2023, Although in many cases salient stimuli capture attention involuntarily, it has been proposed recently that under certain conditions, the bottom–up signal generated by such stimuli can be proactively suppressed. In support of this signal suppression hypothesis, ERP studies have demonstrated that salient stimuli that do not capture attention elicit a distractor positivity (PD), a putative neural index of suppression. At the same time, it is becoming increasingly clear that regularities across preceding search episodes have a large influence on attentional selection. Yet to date, studies in support of the signal suppression hypothesis have largely ignored the role of selection history on the processing of distractors. The current study addressed this issue by examining how electrophysiological markers of attentional selection (N2pc) and suppression (PD) elicited by targets and dis-tractors, respectively, were modulated when the search target randomly varied instead of being fixed across trials. Results showed that although target selection was unaffected by this manipulation, both in terms of manual response times, as well as in terms of the N2pc component, the PD component was reliably attenuated when the target features varied randomly across trials. This result demonstrates that the distractor PD, which is typically considered the marker of selective distractor processing, cannot unequivocally be attributed to suppression only, as it also, at least in part, reflects the upweighting of target features. |
Bas Opheusden; Ionatan Kuperwajs; Gianni Galbiati; Zahy Bnaya; Yunqi Li; Wei Ji Ma Expertise increases planning depth in human gameplay Journal Article In: Nature, vol. 618, no. 7967, pp. 1000–1005, 2023. @article{Opheusden2023, A hallmark of human intelligence is the ability to plan multiple steps into the future1,2. Despite decades of research3–5, it is still debated whether skilled decision-makers plan more steps ahead than novices6–8. Traditionally, the study of expertise in planning has used board games such as chess, but the complexity of these games poses a barrier to quantitative estimates of planning depth. Conversely, common planning tasks in cognitive science often have a lower complexity9,10 and impose a ceiling for the depth to which any player can plan. Here we investigate expertise in a complex board game that offers ample opportunity for skilled players to plan deeply. We use model fitting methods to show that human behaviour can be captured using a computational cognitive model based on heuristic search. To validate this model, we predict human choices, response times and eye movements. We also perform a Turing test and a reconstruction experiment. Using the model, we find robust evidence for increased planning depth with expertise in both laboratory and large-scale mobile data. Experts memorize and reconstruct board features more accurately. Using complex tasks combined with precise behavioural modelling might expand our understanding of human planning and help to bridge the gap with progress in artificial intelligence. |
Nele Vanbilsen; Valentina Pergher; Marc M. Van Hulle Effects of task-specific strategy on attentional control game training: Preliminary data from healthy adults Journal Article In: Current Psychology, pp. 1–15, 2023. @article{Vanbilsen2023, Although recent studies showed the beneficial effect of video game training, it is still unclear whether the used strategy plays an important role in enhancing performance in the trained cognitive ability and in promoting transfers to other cognitive domains. We investigated behaviourally the effect of strategy on the outcomes of visual attentional control game training and both behaviourally and in terms of EEG-based event-related potentials (ERPs), the effect on other cognitive domains. We recruited 21 healthy adults, divided into three groups: a strategy-training group (STG) instructed to use a specific strategy, a non-strategy training group (NSTG) that self-developed their strategy, and a passive control group (PCG) that underwent only pre- and post-tests. Our results showed that the use of a specific strategy made the STG participants respond faster to the trained contrast level task, but not on the contour exercises task. Furthermore, both STG and NSTG showed pre- and post-transfers, however no significant differences were found when comparing the groups, for both behaviour and ERP responses. In conclusion, we believe these preliminary results provide evidence for the importance of strategy choice in cognitive training protocols. |
Martin R. Vasilev; Michael Lowman; Katherine Bills; Fabrice B. R. Parmentier; Julie A. Kirkby Unexpected sounds inhibit the movement of the eyes during reading and letter scanning Journal Article In: Psychophysiology, vol. 60, no. 12, pp. 1–19, 2023. @article{Vasilev2023, Novel sounds that unexpectedly deviate from a repetitive sound sequence are well known to cause distraction. Such unexpected sounds have also been shown to cause global motor inhibition, suggesting that they trigger a neurophysiological response aimed at stopping ongoing actions. Recently, evidence from eye movements has suggested that unexpected sounds also temporarily pause the movements of the eyes during reading, though it is unclear if this effect is due to inhibition of oculomotor planning or inhibition of language processes. Here, we sought to distinguish between these two possibilities by comparing a natural reading task to a letter scanning task that involves similar oculomotor demands to reading, but no higher level lexical processing. Participants either read sentences for comprehension or scanned letter strings of these sentences for the letter ‘o' in three auditory conditions: silence, standard, and novel sounds. The results showed that novel sounds were equally distracting in both tasks, suggesting that they generally inhibit ongoing oculomotor processes independent of lexical processing. These results suggest that novel sounds may have a global suppressive effect on eye-movement control. |
Audrey Vialatte; Eric Chabanat; Agnès Witko; Laure Pisella In: Cognitive Neuropsychology, pp. 1–28, 2023. @article{Vialatte2023, Some dyslexics cannot process multiple letters simultaneously. It has been argued that this reduced visuo-attentional (VA) letter span could result from poor reading ability and experience. Here, moving away from reading context, we showed that dyslexic group exhibited slower visual search than normal readers group for “symbols”, defined as graphic stimuli made up of separable visual features, but not for filled objects. Slowness in symbol visual search was explained by reduced VA field and atypical ocular behaviour when processing those letter-like stimuli and was associated with reduced VA letter span and impaired elementary visuo-spatial perception. Such a basic visual search deficit can hardly be attributed to poor reading ability and experience. Moreover, because it is specific to letter-like stimuli (i.e., “symbols”), it can specifically hinder reading acquisition. Symbol visual search can easily be tested in the pre-reading phase, opening up prospects for early risk detection and prevention of VA dyslexia. |
Sarah Villard; Tyler K. Perrachione; Sung-Joo Lim; Ayesha Alam; Gerald Kidd In: The Journal of the Acoustical Society of America, vol. 154, no. 2, pp. 1152–1167, 2023. @article{Villard2023, The task of processing speech masked by concurrent speech/noise can pose a substantial challenge to listeners. However, performance on such tasks may not directly reflect the amount of listening effort they elicit. Changes in pupil size and neural oscillatory power in the alpha range (8–12 Hz) are prominent neurophysiological signals known to reflect listening effort; however, measurements obtained through these two approaches are rarely correlated, suggesting that they may respond differently depending on the specific cognitive demands (and, by extension, the specific type of effort) elicited by specific tasks. This study aimed to compare changes in pupil size and alpha power elicited by different types of auditory maskers (highly confusable intelligible speech maskers, speech-envelope-modulated speech-shaped noise, and unmodulated speech-shaped noise maskers) in young, normal-hearing listeners. Within each condition, the target-to-masker ratio was set at the participant's individually estimated 75% correct point on the psychometric function. The speech masking condition elicited a significantly greater increase in pupil size than either of the noise masking conditions, whereas the unmodulated noise masking condition elicited a significantly greater increase in alpha oscillatory power than the speech masking condition, suggesting that the effort needed to solve these respective tasks may have different neural origins. |
Tiansheng Xia; Yingqi Yan; Jiayue Guo Color in web-advertising: The effect of color hue contrast on web satisfaction and advertising memory Journal Article In: Current Psychology, pp. 1–14, 2023. @article{Xia2023, There has been a growth in e-commerce, presenting consumers with varied forms of advertising. A key goal of web advertising is to leave a lasting impression on the user, and web satisfaction is an important measure of the quality and usability of a web page after an ad is placed on it. This experiment manipulated participants' purpose in web browsing (free browsing versus goal oriented) and the color combination of the web background and the vertical-ad background (high or low hue contrast) to predict users' satisfaction with the web page and the degree of ad recall. The psychological mechanisms of this effect were also explored using an eye-tracking device to record and analyze eye movements. The participants were 120 university students, 64.2% of whom were female and 35.8% of whom were male. During free browsing, participants could simulate the daily use of a browser to browse the web and were given 120 s to do so, and in the task-oriented browsing condition, participants were told in advance that they had to summarize the headlines of each news item one at a time within 120 s. The results showed that, in the free-viewing task, the hue contrast between the ad–web background colors negatively affected web satisfaction and ad memory whereas there was no significant difference in this effect in the goal-oriented task. Furthermore, in the free-viewing task, the level of attentional intrusion mediated the effect of ad–web hue contrast on the degree of ad recall; color harmony mediated the effect of hue contrast on the user's evaluation of web satisfaction. These results can act as a new reference for web design research and marketing practice. |
Yanfang Xia; Jelena Wehrli; Samuel Gerster; Marijn Kroes; Maxime Houtekamer; Dominik R. Bach Measuring human context fear conditioning and retention after consolidation Journal Article In: Learning and Memory, vol. 30, no. 7, pp. 139–150, 2023. @article{Xia2023a, Fear conditioning is a laboratory paradigm commonly used to investigate aversive learning and memory. In context fear conditioning, a configuration of elemental cues (conditioned stimulus [CTX]) predicts an aversive event (unconditioned stimulus [US]). To quantify context fear acquisition in humans, previous work has used startle eyeblink responses (SEBRs), skin conductance responses (SCRs), and verbal reports, but different quantification methods have rarely been compared. Moreover, preclinical intervention studies mandate recall tests several days after acquisition, and it is unclear how to induce and measure context fear memory retention over such a time interval. First, we used a semi-immersive virtual reality paradigm. In two experiments (N = 23 and N = 28), we found successful declarative learning and memory retention over 7 d but no evidence of other conditioned responses. Next, we used a configural fear conditioning paradigm with five static room images as CTXs in two experiments (N = 29 and N = 24). Besides successful declarative learning and memory retention after 7 d, SCR and pupil dilation in response to CTX onset differentiated CTX+/CTX− during acquisition training, and SEBR and pupil dilation differentiated CTX+/CTX− during the recall test, with medium to large effect sizes for the most sensitive indices (SEBR: Hedge's g = 0.56 and g = 0.69; pupil dilation: Hedge's g = 0.99 and g = 0.88). Our results demonstrate that with a configural learning paradigm, context fear memory retention can be demonstrated over 7 d, and we provide robust and replicable measurement methods to this end. |
Naiqi G. Xiao; Lauren L. Emberson Visual perception is highly flexible and context dependent in young infants: A case of top-down-modulated motion perception Journal Article In: Psychological Science, vol. 34, no. 8, pp. 875–886, 2023. @article{Xiao2023, Top-down modulation is an essential cognitive component in human perception. Despite mounting evidence of top-down perceptual modulation in adults, it is largely unknown whether infants can engage in this cognitive function. Here, we examined top-down modulation of motion perception in 6- to 8-month-old infants (recruited in North America) via their smooth-pursuit eye movements. In four experiments, we demonstrated that infants' perception of motion direction can be flexibly shaped by briefly learned predictive cues when no coherent motion is available. The current findings present a novel insight into infant perception and its development: Infant perceptual systems respond to predictive signals engendered from higher-level learning systems, leading to a flexible and context-dependent modulation of perception. This work also suggests that the infant brain is sophisticated, interconnected, and active when placed in a context in which it can learn and predict. |
Xue-Zhen Xiao; Gaoding Jia; Aiping Wang Semantic preview benefit of Tibetan-Chinese bilinguals during Chinese reading Journal Article In: Language Learning and Development, vol. 19, no. 1, pp. 1–15, 2023. @article{Xiao2023a, When reading Chinese, skilled native readers regularly gain a preview benefit (PB) when the parafoveal word is orthographically or semantically related to the target word. Evidence shows that non-native, beginning Chinese readers can obtain an orthographic PB during Chinese reading, which indicates the parafoveal processing of low-level visual information. However, whether non-native Chinese readers who are more proficient in Chinese can make use of high-level parafoveal information remains unknown. Therefore, this study examined parafoveal processing during Chinese reading among Tibetan-Chinese bilinguals with high Chinese proficiency and compared their PB effects with those from native Chinese readers. Tibetan-Chinese bilinguals demonstrated both orthographic and semantic PB but did not show phonological PB and only differed from native Chinese in the identical PB when preview characters were identical to the targets. These findings demonstrate that non-native Chinese readers can extract semantic information from parafoveal preview during Chinese reading and highlight the modulation of parafoveal processing efficiency by reading proficiency. The results are in line with the direct route to access the mental lexicon of visual Chinese characters among non-native Chinese speakers. |
Mo Xiaohong; Xie Zhihao; Luh Ding-Bang A hybrid macro and micro method for consumer emotion and behavior research Journal Article In: IEEE Access, vol. 11, pp. 83430–83445, 2023. @article{Xiaohong2023, To investigate impacts of intelligent and fashion factors of sports bras on consumers' emotions, decision-making and behavior, a quantitative analysis method combing macro affective computing and micro emotion data was proposed. The context where a consumer purchased sports bras was first simulated. In this process, an eye tracker and a multi-channel physiological recorder were utilized to collect physiological signal data from participants in an experimental setting. Then, big data and machine learning were both adopted to macroscopically perform data pre-processing, build a computational model, fulfill relevant prediction and evaluation, analyze correlations in physiological data features, and explore potential values existing in data. Furthermore, highly correlated data features were extracted to investigate micro causalities and identify reasons why consumer behavior and decision-making were supported by data about emotional physiology. The proposed method may provide considerably reliable data support for designers, product service providers, and other practitioners. As an innovative and universal integration approach, it has the potential to be applied in medical science, psychology, management science and other fields. |
Pei Xie; Han-Bin Sang; Chao-Zheng Huang; Ai-Bao Zhou Effect of body-related information on food attentional bias in women with body weight dissatisfaction Journal Article In: Scientific Reports, vol. 13, no. 1, pp. 1–10, 2023. @article{Xie2023, Women with body weight dissatisfaction (BWD) have long-term negative assessments of their body weight, which are often associated with poor eating behavior. In this study, we investigated the effect of body-related information on the food cue processing and attention of women with BWD. Sixty-eight women were recruited and assigned to either a BWD (NPSS-F > 2) (n = 32) or a no body weight dissatisfaction (NBWD) group (NPSS-F < 1) (n = 36). We measured attentional bias to food cues (high- and low-calorie) with a food probe task after exposure to body-related information and recorded eye tracking data. Body-related images were presented prior to a pair of stimulus images (food–neutral or neutral–neutral). Body-related information and food type were repeated measure factors in our study. Our results showed that the first fixation duration bias for high-calorie foods was significantly longer than for low-calorie foods after exposure to overweight cues in the BWD group. Compared with the NBWD group, the BWD group showed longer first fixation duration bias for high-calorie foods after exposure to overweight cues. The direction for high-calorie foods was significantly more often than that for low-calorie foods in the BWD group after exposure to body-related information. Our findings suggest that compared to women with NBWD, women with BWD may be more susceptible to body-related information, resulting in increased attention to high-calorie foods. |
Weizhen Xie; Weiwei Zhang Pupillary evidence reveals the influence of conceptual association on brightness perception Journal Article In: Psychonomic Bulletin & Review, vol. 30, no. 4, pp. 1388–1395, 2023. @article{Xie2023a, Our visual experience often varies based on momentary thoughts and feelings. For example, when positive concepts are invoked, visual objects may appear brighter (e.g., a “brighter” smile). However, it remains unclear whether this phenomenological experience is driven by a genuine top-down modulation of brightness perception or by a mere response bias. To investigate this issue, we use pupillometry as a more objective measure of perceived brightness. We asked participants to judge the brightness level of an isoluminant gray color patch after evaluating the valence of a positive or negative word. We found that the gray color patch elicited greater pupillary light reflex and more frequent “brighter” responses after observers had evaluated the valence of a positive word. As pupillary light reflex is unlikely driven by voluntary control, these results suggest that the conceptual association between affect and luminance can modulate brightness perception. |
Zedong Xie; Meng Zhang; Zunping Ma The impact of mental simulation on subsequent tourist experience–dual evidence from eye tracking and self-reported measurement Journal Article In: Current Issues in Tourism, vol. 26, no. 18, pp. 2915–2930, 2023. @article{Xie2023c, Tourism research has always sought to find ways to improve tourists' experience evaluation and create added value for them. However, the academic community has focused on the on-site and post-travel stages of tourists, and neglected the pre-travel stage. This study examines the influence of guided mental simulation of an upcoming tourist experience on subsequent on-site tourist experience and experience evaluation. The research simulated real-world experience with tour videos shot from the first-person perspective, and measured the variables using both eye movements and self-reporting. Multivariate ANOVA and multigroup analysis were then performed on the data. The results showed that a process simulation of tourists having an engagement experience and an outcome simulation of tourists having a sight-seeing experience resulted in a higher engagement level and higher emotional response during the on-site experience, higher evaluation of the experience, and a greater impact of engagement level on their evaluation. This study expands the research on tourists' psychological experience in the pre-travel stage. Results indicate that the period from the moment consumers book or purchase the tourist product to the moment they actually embark on the tourist experience is a valuable marketing window. |
Luzi Xu; Zhong Yang; Huichao Ji; Wei Chen; Zhuomian Lin; Yushang Huang; Xiaowei Ding Direct evidence for proactive suppression of salient-but-irrelevant emotional information inputs Journal Article In: Emotion, vol. 23, no. 7, pp. 2039–2058, 2023. @article{Xu2023a, It has long been debated whether emotional information inherently captures attention. The mainstream view suggests that the attentional processing of emotional information is automatic and difficult to be controlled. Here, we provide direct evidence that salient-but-irrelevant emotional information inputs can be proactively suppressed. First, we demonstrated that both negative and positive emotional distractors (fearful and happy faces) induced attentional capture effects (i.e., more attention allocated to emotional distractors than neutral distractors) in the singleton-detection mode (Experiment 1), but attentional suppression effects (i.e., less attention allocated to emotional distractors than neutral distractors) in the feature-search mode that strengthened task motivation (Experiment 2). The suppression effects in the feature-search mode disappeared when emotional information was disrupted through face inversion, showing that the suppression effects were driven by emotional information rather than low-level visual factors (Experiment 3). Furthermore, the suppression effects also disappeared when the identity of emotional faces became unpredictable (Experiment 4), suggesting that the suppression was highly dependent on the predictability of emotional distractors. Importantly, we reproduced the suppression effects using eye-tracking methods and found that there was no attentional capture by emotional distractors before the appearance of the attentional suppression effects (Experiment 5). These findings suggest that irrelevant emotional stimuli that have the potential to cause distraction can be proactively suppressed by the attention system |
Mengran Xu; Katelyn Rowe; Christine Purdon To approach or to avoid: The role of ambivalent motivation towards high calorie food images in restrained eaters Journal Article In: Cognitive Therapy and Research, vol. 47, no. 4, pp. 669–680, 2023. @article{Xu2023b, Background: Individuals who engage in restrained eating are often torn between eating enjoyment and weight control. Recent research found visual attention to threat varied according to motivation, and people with ambivalent motivation about threat showed greater anxiety. Methods: A total number of 225 individuals high in restrained eating completed a passive viewing task in which they were presented with image pairs of high calorie food and neutral objects while their eye movements were tracked. Participants also rated their motivation to look towards and away from food images and completed measures of mood and thought-shape fusion. Results: Two-thirds of participants reported strong motivation to look at food images, and the rest were highly motivated to avoid, were indifferent, or were ambivalent. Visual attention to food images varied according to motivation. Ambivalent individuals had higher thought-shape fusion scores and were more restrained in their eating than engagers and indifferent individuals. Conclusions: These findings suggest that motivation to attend to and avoid food images are important factors to study, as they are associated with attentional biases and eating pathology. Clinical implications are also discussed. |
Ying Xu; Jia-Qiong Xie; Fu-Xing Wang; Rebecca L. Monk; James Gaskin; Jin-Liang Wang The impact of Weibo features on user's information comprehension: The mediating role of cognitive load Journal Article In: Social Science Computer Review, vol. 41, no. 6, pp. 2010–2028, 2023. @article{Xu2023d, Social media, such as Microblogs, have become an important source for people to obtain information. However, we know little about how this would influence our comprehension over online information. Based on the cognitive load theory, this research explores whether and how two important features of Weibo, which are the feedback function and information fragmentation, would increase cognitive load and may in turn hinder users' information comprehension in Weibo. A 2 (feedback or non-feedback) × 2 (strong-interference or weak-interference information) between-participants experimental design was conducted. Our results revealed that the Weibo feedback function and interference information exerted a negative impact over information comprehension via inducing increased cognitive load. Specifically, these results deepened our understanding regarding the impact of Weibo features on online information comprehension and suggest the mechanism by which this occurs. This finding has implications for how to minimize the potential cost of using Weibo and maximize the adaptive development of social media. |
Zhenjie Xu; Jie Hu; Yingying Wang Bilateral eye movements disrupt the involuntary perceptual representation of trauma-related memories Journal Article In: Behaviour Research and Therapy, vol. 165, pp. 1–10, 2023. @article{Xu2023c, Bilateral eye movement (EM) is a critical component in eye movement desensitization and reprocessing (EMDR), an effective treatment for post-traumatic stress disorder. However, the role of bilateral EM in alleviating trauma-related symptoms is unclear. Here we hypothesize that bilateral EM selectively disrupts the perceptual representation of traumatic memories. We used the trauma film paradigm as an analog for trauma experience. Nonclinical participants viewed trauma films followed by a bilateral EM intervention or a static Fixation period as a control. Perceptual and semantic memories for the film were assessed with different measures. Results showed a significant decrease in perceptual memory recognition shortly after the EM intervention and subsequently in the frequency and vividness of film-related memory intrusions across one week, relative to the Fixation condition. The EM intervention did not affect the explicit recognition of semantic memories, suggesting a dissociation between perceptual and semantic memory disruption. Furthermore, the EM intervention effectively reduced psychophysiological affective responses, including the skin conductance response and pupil size, to film scenes and subjective affective ratings of film-related intrusions. Together, bilateral EMs effectively reduce the perceptual representation and affective response of trauma-related memories. Further theoretical developments are needed to elucidate the mechanism of bilateral EMs in trauma treatment. |
Zhihao Yan; Zeyang Yang; Mark D. Griffiths “Danmu” preference, problematic online video watching, loneliness and personality: An eye-tracking study and survey study Journal Article In: BMC Psychiatry, vol. 23, no. 1, pp. 1–13, 2023. @article{Yan2023b, ‘Danmu' (i.e., comments that scroll across online videos), has become popular on several Asian online video platforms. Two studies were conducted to investigate the relationships between Danmu preference, problematic online video watching, loneliness and personality. Study 1 collected self-report data on the study variables from 316 participants. Study 2 collected eye-tracking data of Danmu fixation (duration, count, and the percentages) from 87 participants who watched videos. Results show that fixation on Danmu was significantly correlated with problematic online video watching, loneliness, and neuroticism. Self-reported Danmu preference was positively associated with extraversion, openness, problematic online video watching, and loneliness. The studies indicate the potential negative effects of Danmu preference (e.g., problematic watching and loneliness) during online video watching. The study is one of the first empirical investigations of Danmu and problematic online video watching using eye-tracking software. Online video platforms could consider adding more responsible use messaging relating to Danmu in videos. Such messages may help users to develop healthier online video watching habits. |
Chaoqing Yang; Linlin He; Yucheng Liu; Ziyang Lin; Lizhu Luo; Shan Gao Anti-saccades reveal impaired attention control over negative social evaluation in individuals with depressive symptoms Journal Article In: Journal of Psychiatric Research, vol. 165, pp. 64–69, 2023. @article{Yang2023, Depressed individuals are excessively sensitive to negative information but blunt to positive information, which has been considered as vulnerability to depression. Here, we focused on inhibitory control over attentional bias on social evaluation in individuals with depression. We engaged individuals with and without depressive symptoms (categorized by Beck Depression Inventory-II) in a novel attention control task using positive and negative evaluative adjectives as self-referential feedback given by social others. Participants were instructed to look at sudden onset feedback targets (pro-saccade) or the mirror location of the targets (anti-saccade) when correct saccade latencies and saccade errors were collected. The two indices showed that while both groups displayed longer latencies and more errors for anti-saccade relative to pro-saccade responses depressed individuals spent more time reacting correctly and made more errors than non-depressed individuals in the anti-saccade trials and such group differences were not observed in the pro-saccade trials. Although group differences in correct anti-saccade latencies were found for both positive and negative stimuli, depressed individuals spent more time making correct anti-saccade responses to negative social feedback than to positive ones whereas non-depressed individuals featured longer correct anti-saccade latencies for positive relative to negative evaluations. Our results suggest that depressed individuals feature an impaired ability in attention control for self-referential evaluations, notably those of negative valence, shedding new light on depression-distorted self-schema and corresponding social dysfunctions. |
Ruyi Yang; Peng Zhao; Liyang Wang; Chenli Feng; Chen Peng; Zhexuan Wang; Yingying Zhang; Minqian Shen; Kaiwen Shi; Shijun Weng; Chunqiong Dong; Fu Zeng; Tianyun Zhang; Xingdong Chen; Shuiyuan Wang; Yiheng Wang; Yuanyuan Luo; Qingyuan Chen; Yuqing Chen; Chengyong Jiang; Shanshan Jia; Zhaofei Yu; Jian Liu; Fei Wang; Su Jiang; Wendong Xu; Liang Li; Gang Wang; Xiaofen Mo; Gengfeng Zheng; Aihua Chen; Xingtao Zhou; Chunhui Jiang; Yuanzhi Yuan; Biao Yan; Jiayi Zhang Assessment of visual function in blind mice and monkeys with subretinally implanted nanowire arrays as artificial photoreceptors Journal Article In: Nature Biomedical Engineering, pp. 1–37, 2023. @article{Yang2023a, Retinal prostheses could restore image-forming vision in conditions of photoreceptor degeneration. However, contrast sensitivity and visual acuity are often insufficient. Here we report the performance, in mice and monkeys with induced photoreceptor degeneration, of subretinally implanted gold-nanoparticle-coated titania nanowire arrays providing a spatial resolution of 77.5 μm and a temporal resolution of 3.92 Hz in ex vivo retinas (as determined by patch-clamp recording of retinal ganglion cells). In blind mice, the arrays allowed for the detection of drifting gratings and flashing objects at light-intensity thresholds of 15.70–18.09 μW mm–2, and offered visual acuities of 0.3–0.4 cycles per degree, as determined by recordings of visually evoked potentials and optomotor-response tests. In monkeys, the arrays were stable for 54 weeks, allowed for the detection of a 10-μW mm–2 beam of light (0.5° in beam angle) in visually guided saccade experiments, and induced plastic changes in the primary visual cortex, as indicated by long-term in vivo calcium imaging. Nanomaterials as artificial photoreceptors may ameliorate visual deficits in patients with photoreceptor degeneration. |
Tianqi Yang; Yaning Guo; Xianyang Wang; Shengjun Wu; Xiuchao Wang; Hui Wang; Xufeng Liu The influence of representational gravity on spatial orientation: An eye movement study Journal Article In: Current Psychology, pp. 1–9, 2023. @article{Yang2023b, Spatial orientation is a fundamental subject in aviation psychology. The influence of representational gravity can lead to systematic errors during uniform linear motion. However, it remains unclear whether representational gravity during motion can affect spatial orientation. In this study, college students from Xi'an, China were recruited to participate in an experiment based on the Spatial Visualization Dynamic Test. We compared the accuracy of spatial orientation estimation and eye movement indices when the main direction of spatial orientation was in the lower right versus when it was in the upper right. The results revealed that individuals were prone to overestimate the adjustment angle when the main direction of spatial orientation was in the lower right, and underestimate the adjustment angle when the main direction of spatial orientation was in the upper right; the average pupil size was significantly larger when the main direction of spatial orientation was in the lower right than that when the main direction of spatial orientation was in the upper right. In conclusion, spatial orientation in motion was influenced by representational gravity, and when representational gravity aligned with the main direction of spatial orientation, it led to increased cognitive resource consumption. |
Tianqi Yang; Yang He; Lin Wu; Hui Wang; Xiuchao Wang; Yahong Li; Yaning Guo; Shengjun Wu; Xufeng Liu The effects of object size on spatial orientation: An eye movement study Journal Article In: Frontiers in Neuroscience, vol. 17, pp. 1–8, 2023. @article{Yang2023c, Introduction: The processing of visual information in the human brain is divided into two streams, namely, the dorsal and ventral streams, object identification is related to the ventral stream and motion processing is related to the dorsal stream. Object identification is interconnected with motion processing, object size was found to affect the information processing of motion characteristics in uniform linear motion. However, whether the object size affects the spatial orientation is still unknown. Methods: Thirty-eight college students were recruited to participate in an experiment based on the spatial visualization dynamic test. Eyelink 1,000 Plus was used to collect eye movement data. The final direction difference (the difference between the final moving direction of the target and the final direction of the moving target pointing to the destination point), rotation angle (the rotation angle of the knob from the start of the target movement to the moment of key pressing) and eye movement indices under conditions of different object sizes and motion velocities were compared. Results: The final direction difference and rotation angle under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point were significantly smaller than those under the other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point). The average pupil size under the condition of a 2.29°-diameter moving target and a 0.76°-diameter destination point was significantly larger than the average pupil size under other conditions (a 0.76°-diameter moving target and a 0.76°-diameter destination point; a 0.76°-diameter moving target and a 2.29°-diameter destination point). Discussion: A relatively large moving target can resist the landmark attraction effect in spatial orientation, and the influence of object size on spatial orientation may originate from differences in cognitive resource consumption. The present study enriches the interaction theory of the processing of object characteristics and motion characteristics and provides new ideas for the application of eye movement technology in the examination of spatial orientation ability. |
Xiaomeng Yang; Fuxing Wang; Richard E. Mayer; Xiangen Hu; Chuanhua Gu Ocular foundations of the spatial contiguity principle: Designing multimedia materials for parafoveal vision Journal Article In: Journal of Educational Psychology, vol. 115, no. 8, pp. 1125–1140, 2023. @article{Yang2023d, The spatial contiguity principle is that people learn and perform better when corresponding printed text and graphics are placed near rather than far from each other on the screen or page. This is a well-established design principle in multimedia learning. However, there is insufficient research to establish the appropriate distance between text and graphics that is conducive for integrative processing. The current study examines a new objective indicator of spatial contiguity based on the characteristics of human visual processing, and hypothesizes that corresponding text and graphic information presented within parafoveal vision promotes integrative processing better than information in peripheral vision. Experiments 1 and 2 asked participants to judge the similarities of two text–picture cards and found that presenting the two cards within parafoveal vision (rather than peripheral vision) led to faster comparison (in both Experiments) and higher scores (only in Experiment 2) for a simple version of the comparison task, but did not lower cognitive load. Experiment 3 found that students who viewed an onscreen multimedia lesson that presented corresponding text–picture information in parafoveal vision (rather than peripheral vision) scored higher on retention and application tests and experienced lower cognitive load measured by a secondary task. Across all three experiments, eye-tracking results showed presenting corresponding text–picture information in parafoveal vision yielded more integrative saccades and longer fixation time on text, indicating that spatial contiguity encourages integrative processing. This study replicates and extends the spatial contiguity effect, and offers a new quantifiable indicator of spatial continuity for the future research. |
Xiaozhi Yang; Ian Krajbich A dynamic computational model of gaze and choice in multi-attribute decisions Journal Article In: Psychological Review, vol. 130, no. 1, pp. 52–70, 2023. @article{Yang2023e, When making decisions, how people allocate their attention influences their choices. One empirical finding is that people are more likely to choose the option that they have looked at more. This relation has been formalized with the attentional drift-diffusion model (aDDM; Krajbich et al., 2010). However, options often have multiple attributes, and attention is also thought to govern the relative weighting of those attributes (Roe et al., 2001). Little is known about how these two distinct features of the choice process interact; we still lack a model (and tests of that model) that incorporate both option- and attribute-wise attention. Here, we propose a multi-attribute attentional drift-diffusion model (maaDDM) to account for attentional discount factors on both options and attributes. We then use five eye-tracking datasets (two-alternative, two-attribute preferential tasks) from different choice domains to test the model. We find very stable option-level and attribute-level attentional discount factors across datasets, though nonfixated options are consistently discounted more than nonfixated attributes. Additionally, we find that people generally discount the nonfixated attribute of the nonfixated option in a multiplicative way, and so that feature is consistently discounted the most. Finally, we also find that gaze allocation reflects attribute weights, with more gaze to higher-weighted attributes. In summary, our work uncovers an intricate interplay between attribute weights, gaze processes, and preferential choice. |
Mengna Yao; Bincheng Wen; Mingpo Yang; Jiebin Guo; Haozhou Jiang; Chao Feng; Yilei Cao; Huiguang He; Le Chang High-dimensional topographic organization of visual features in the primate temporal lobe Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–23, 2023. @article{Yao2023a, The inferotemporal cortex supports our supreme object recognition ability. Numerous studies have been conducted to elucidate the functional organization of this brain area, but there are still important questions that remain unanswered, including how this organization differs between humans and non-human primates. Here, we use deep neural networks trained on object categorization to construct a 25-dimensional space of visual features, and systematically measure the spatial organization of feature preference in both male monkey brains and human brains using fMRI. These feature maps allow us to predict the selectivity of a previously unknown region in monkey brains, which is corroborated by additional fMRI and electrophysiology experiments. These maps also enable quantitative analyses of the topographic organization of the temporal lobe, demonstrating the existence of a pair of orthogonal gradients that differ in spatial scale and revealing significant differences in the functional organization of high-level visual areas between monkey and human brains. |
Panpan Yao; David Hall; Hagit Borer; Linnaea Stockall Dutch–Mandarin learners' online use of syntactic cues to anticipate mass vs. count interpretations Journal Article In: Second Language Research, pp. 1–38, 2023. @article{Yao2023b, It remains unclear whether late second language learners (L2ers) can acquire sufficient knowledge about unique-to-L2 constructions through implicit learning to build anticipations during real-time processing. To tackle this question, we conducted a visual world paradigm experiment to investigate high-proficiency late first-language Dutch second-language Mandarin Chinese learners' online processing of syntactic cues to count vs. mass interpretations in Chinese which are unique-to-L2 and never explicitly taught. The results showed that late Dutch–Mandarin learners were sensitive to a mass-biased syntactic cue in real-time processing, and exhibited some native-like anticipatory behaviour. These findings indicate that late L2ers can acquire unique-to-L2 constructions through implicit learning, and can automatically use this knowledge to make predictions. |
Yao Yao; Katrina Connell; Stephen Politzer-Ahles Hearing emotion in two languages: A pupillometry study of Cantonese–Mandarin bilinguals' perception of affective cognates in L1 and L2 Journal Article In: Bilingualism: Language and Cognition, vol. 26, no. 4, pp. 795–808, 2023. @article{Yao2023d, Differential affective processing has been widely documented for bilinguals: L1 affective words elicit higher levels of arousal and stronger emotionality ratings than L2 affective words (Pavlenko, 2012). In this study, we focus on two closely related Chinese languages, Mandarin and Cantonese, whose affective lexicons are highly overlapping, with shared lexical items that only differ in pronunciation across languages. We recorded L1 Cantonese – L2 Mandarin bilinguals' pupil responses to auditory tokens of Cantonese and Mandarin affective words. Our results showed that Cantonese–Mandarin bilinguals had stronger pupil responses when the affective words were pronounced in Cantonese (L1) than when the same words were pronounced in Mandarin (L2). The effect was most evident in taboo words and among bilinguals with lower L2 proficiency. We discuss the theoretical implications of the findings in the frameworks of exemplar theory and models of the bilingual lexicon. |
Jacob L. Yates; Shanna H. Coop; Gabriel H. Sarch; Ruei Jr Wu; Daniel A. Butts; Michele Rucci; Jude F. Mitchell Detailed characterization of neural selectivity in free viewing primates Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–11, 2023. @article{Yates2023, Fixation constraints in visual tasks are ubiquitous in visual and cognitive neuroscience. Despite its widespread use, fixation requires trained subjects, is limited by the accuracy of fixational eye movements, and ignores the role of eye movements in shaping visual input. To overcome these limitations, we developed a suite of hardware and software tools to study vision during natural behavior in untrained subjects. We measured visual receptive fields and tuning properties from multiple cortical areas of marmoset monkeys who freely viewed full-field noise stimuli. The resulting receptive fields and tuning curves from primary visual cortex (V1) and area MT match reported selectivity from the literature which was measured using conventional approaches. We then combined free viewing with high-resolution eye tracking to make the first detailed 2D spatiotemporal measurements of foveal receptive fields in V1. These findings demonstrate the power of free viewing to characterize neural responses in untrained animals while simultaneously studying the dynamics of natural behavior. |
Yang Yiling; Johanna Klon-Lipok; Wolf Singer Joint encoding of stimulus and decision in monkey primary visual cortex Journal Article In: Cerebral Cortex, pp. 1–6, 2023. @article{Yiling2023, We investigated whether neurons in monkey primary visual cortex (V1) exhibit mixed selectivity for sensory input and behavioral choice. Parallel multisite spiking activity was recorded from area V1 of awake monkeys performing a delayed match-to-sample task. The monkeys had to make a forced choice decision of whether the test stimulus matched the preceding sample stimulus. The population responses evoked by the test stimulus contained information about both the identity of the stimulus and with some delay but before the onset of the motor response the forthcoming choice. The results of subspace identification analysis indicate that stimulus-specific and decision-related information coexists in separate subspaces of the high-dimensional population activity, and latency considerations suggest that the decision-related information is conveyed by top-down projections. |
Yang Yiling; Katharine Shapcott; Alina Peter; Johanna Klon-Lipok; Huang Xuhui; Andreea Lazar; Wolf Singer Robust encoding of natural stimuli by neuronal response sequences in monkey visual cortex Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Yiling2023a, Parallel multisite recordings in the visual cortex of trained monkeys revealed that the responses of spatially distributed neurons to natural scenes are ordered in sequences. The rank order of these sequences is stimulus-specific and maintained even if the absolute timing of the responses is modified by manipulating stimulus parameters. The stimulus specificity of these sequences was highest when they were evoked by natural stimuli and deteriorated for stimulus versions in which certain statistical regularities were removed. This suggests that the response sequences result from a matching operation between sensory evidence and priors stored in the cortical network. Decoders trained on sequence order performed as well as decoders trained on rate vectors but the former could decode stimulus identity from considerably shorter response intervals than the latter. A simulated recurrent network reproduced similarly structured stimulus-specific response sequences, particularly once it was familiarized with the stimuli through non-supervised Hebbian learning. We propose that recurrent processing transforms signals from stationary visual scenes into sequential responses whose rank order is the result of a Bayesian matching operation. If this temporal code were used by the visual system it would allow for ultrafast processing of visual scenes. |
Qiuchen Yu; Jiangfeng Gou; Yan Li; Zhongling Pi; Jiumin Yang Introducing support for learner control: Temporal and organizational cues in instructional videos Journal Article In: British Journal of Educational Technology, pp. 1–24, 2023. @article{Yu2023a, Instructional videos risk overloading learners' limited working memory resources due to the transient information effect. Learner control is one way to mitigate this concern, but has shown almost zero overall effect and considerable heterogeneity. Consequently, it is essential to identify when learner control is most beneficial. The present study examined the influence of cues on learners' behaviour, cognitive process, metacognition and learning performance in an interactive learning environment. Employing a 2 (temporal cues: without vs. with) × 2 (organizational cues: without vs. with) between-subject design, 117 participants were randomly assigned to one of four conditions: no cues, temporal cues, organizational cues and temporal cues + organizational cues. Among these, temporal cues (ie, progress bar) serve as time-related signals designed to regulate pacing, and organizational cues (ie, table of contents) provide a structural framework for the content. Significant cueing effects were observed for both cue types at germane cognitive load and transfer. Notably, our results indicate that organizational cues effectively guide learners' attention towards the underlying structure, thus promoting cognitive processing. These unique benefits are evident in improved topic recall, retention and monitoring accuracy. Importantly, combined temporal cues and organizational cues were seen to not only allow learners to exhibit more engagement behaviours (ie, skimming) but also assist learners in accurately judging their learning. These findings strongly support the recommendation to use cues to enhance the effectiveness of learner control. Practitioner notes What is already known about this topic Instructional videos may overload limited working memory resources due to the transient information effect. The overall effect of including learner control within educational technology was almost zero (g = 0.05) but showed higher heterogeneity. It is unclear whether embedding various cues in an instructional video improves the effectiveness of learner control. What this paper adds Both temporal and organizational cues aided in increasing learners' germane cognitive load and enhancing their transfer. Organizational cues helped learners understand the underlying structure, thus facilitating deeper cognitive processing, improved metacognition and ultimately boosted learning performance. Combined temporal and organizational cues lead to engagement behaviours and accurate self-monitoring. Implications for practice and/or policy Providing instructional support is important in assisting learners with the complexities of learner-controlled instruction. Embedding cues help learners process the content deeply by giving learners control over the instructional video. |
Vera A. Voigtlaender; Florian Sandhaeger; David J. Hawellek; Steffen R. Hage; Markus Siegel Neural representations of the content and production of human vocalization Journal Article In: Proceedings of the National Academy of Sciences, vol. 120, no. 23, pp. 1–9, 2023. @article{Voigtlaender2023, Speech, as the spoken form of language, is fundamental for human communication. The phenomenon of covert inner speech implies functional independence of speech content and motor production. However, it remains unclear how a flexible mapping between speech content and production is achieved on the neural level. To address this, we recorded magnetoencephalography in humans performing a rule-based vocalization task. On each trial, vocalization content (one of two vowels) and production form (overt or covert) were instructed independently. Using multivariate pattern analysis, we found robust neural information about vocalization content and produc- tion, mostly originating from speech areas of the left hemisphere. Production signals dynamically transformed upon presentation of the content cue, whereas content signals remained largely stable throughout the trial. In sum, our results show dissociable neural representations of vocalization content and production in the human brain and provide insights into the neural dynamics underlying human vocalization. |
Christoph J. Völter; Ana Tomašić; Laura Nipperdey; Ludwig Huber Dogs' expectations about occlusion events: From expectancy violation to exploration Journal Article In: Proceedings of the Royal Society B: Biological Sciences, vol. 290, no. 2003, pp. 1–12, 2023. @article{Voelter2023, Previous research on human infants has shown that violations of basic physical regularities can stimulate exploration, which may represent a type of hypothesis testing aimed at acquiring knowledge about new causal relationships. In this study, we examined whether a similar connection between expectancy violation and exploration exists in nonhuman animals. Specifically, we investigated how dogs react to expectancy violations in the context of occlusion events. Throughout three experiments, dogs exhibited longer looking times at expectancy-inconsistent events than at consistent ones. This finding was further supported by pupil size analyses in the first two eye-tracking experiments. Our results suggest that dogs expect objects to reappear when they are not obstructed by a screen and consider the size of the occluding screen in relation to the occluded object. In Experiment 3, expectancy violations increased the dogs' exploration of the target object, similar to the findings with human infants. We conclude that expectancy violations can provide learning opportunities for nonhuman animals as well. |
Lara Koch; Norbert Kathmann; Benedikt Reuter Lack of speeded disengagement from facial expressions of disgust in remitted major depressive disorder: Evidence from an eye-movement study Journal Article In: Behaviour Research and Therapy, vol. 160, pp. 1–11, 2023. @article{Koch2023a, Acute major depression is characterized by specific abnormalities in the way emotional material is attended to. In late stages of stimulus processing, clinically depressed and dysphoric individuals show difficulties to disengage attention from emotionally negative material. It is unclear, however, whether aberrant disengagement is a transitory attentional phenomenon tied to depressive symptoms, or whether it constitutes a more stable disposition that outlast the symptomatic episode. To address this issue, the current study examined 39 currently euthymic individuals previously affected by major depression (RMD) and 40 healthy control participants reporting no lifetime psychopathology (ND). We used a gaze-contingent eye tracking paradigm designed to separately assess the attentional components of engagement and disengagement when viewing facial expressions of sadness, disgust and happiness. Never-depressed healthy participants, but not remitted euthymic individuals, showed speeded disengagement from facial expressions of disgust. We propose that the lack of this distinct acceleration in previously depressed but fully remitted individuals might reflect an attentional disposition that carries over to euthymic phases of the disease. On the other hand, a tendency to disengage quickly from areas in the visual field that convey social disdain could potentially act as a protective, possibly mood-stabilizing bias in resilient individuals. |
Ria Vormbrock; Maximilian Bruchmann; Lucas Menne; Thomas Straube; Sebastian Schindler Testing stimulus exposure time as the critical factor of increased EPN and LPP amplitudes for fearful faces during perceptual distraction tasks Journal Article In: Cortex, vol. 160, pp. 9–23, 2023. @article{Vormbrock2023, Fearful facial expressions are prioritized across different information processing stages, as evident in early, intermediate, and late components of event-related brain potentials (ERPs). Recent studies showed that, in contrast to early N170 modulations, mid-latency (Early Posterior Negativity, EPN) and late (Late Positive Potential, LPP) emotional modula- tions depend on the attended perceptual feature. Nevertheless, several studies reported significant differences between emotional and neutral faces for the EPN or LPP components during distraction tasks. One cause for these conflicting findings might be that when faces are presented sufficiently long, participants attend to task-irrelevant features of the faces. In this registered report, we tested whether the presentation duration of faces is the critical factor for differences between reported emotional modulations during perceptual distraction tasks. To this end, 48 participants were required to discriminate the orientation of lines overlaid onto fearful or neutral faces, while face presentation varied (100 msec, 300 msec, 1,000 msec, 2,000 msec). While participants did not need to pay attention to the faces, we observed main effects of emotion for the EPN and LPP, but no interaction between emotion and presentation duration. Of note, unregistered exploratory tests per presentation duration showed no significant EPN and LPP emotion differences during short durations (100 and 300 msec) but significant differences with longer durations. While the presentation duration seems not to be a critical factor for EPN and LPP emotion effects, future studies are needed to investigate the role of threshold effects and the applied analytic designs to explain conflicting findings in the literature. |
Dimitris Voudouris; Immo Schuetz; Tabea Schinke; Katja Fiehler Pupil dilation scales with movement distance of real but not of imagined reaching movements Journal Article In: Journal of Neurophysiology, vol. 130, no. 1, pp. 104–116, 2023. @article{Voudouris2023, Pupillary responses have been reliably identified for cognitive and motor tasks, but less is known about their relation to mentally simulated movements (known as motor imagery). Previous work found pupil dilations during the execution of simple finger movements, where peak pupillary dilation scaled with the complexity of the finger movement and force required. Recently, pupillary dilations were reported during imagery of grasping and piano playing. Here, we examined whether pupillary responses are sensitive to the dynamics of the underlying motor task for both executed and imagined reach movements. Participants reached or imagined reaching to one of three targets placed at different distances from a start position. Both executed and imagined movement times scaled with target distance, and they were highly correlated, confirming previous work and suggesting that participants did imagine the respective movement. Increased pupillary dilation was evident during motor execution compared with rest, with stronger dilations for larger movements. Pupil dilations also occurred during motor imagery, however, they were generally weaker than those during motor execution and they were not influenced by imagined movement distance. Instead, dilations during motor imagery resembled pupil responses obtained during a nonmotor imagery task (imagining a previously viewed painting). Our results demonstrate that pupillary responses can reliably capture the dynamics of an executed goal-directed reaching movement, but suggest that pupillary responses during imagined reaching movements reflect general cognitive processes, rather than motor-specific components related to the simulated dynamics of the sensorimotor system.NEW & NOTEWORTHY Pupil size is influenced by the performance of cognitive and motor tasks. Here, we demonstrate that pupil size increases not only during execution but also during mental simulation of goal-directed reaching movements. However, pupil dilations scale with movement amplitude of executed but not of imagined movement, whereas they are similar during motor imagery and a nonmotor imagery task. |
Jelena Vranjes; Bart Defrancq To repair or not to repair? Repairs and risk taking in video remote interpreting Journal Article In: Perspectives: Studies in Translation Theory and Practice, pp. 1–22, 2023. @article{Vranjes2023, The importance of video remote interpreting (VRI) for providing interpreting services has drastically increased over the last decade. Empirical research has shown, however, that interpreting through video link may have a significant impact on the interaction and the interpreting performance in dialogue interpreting contexts. The present study contributes to this growing field of research by focusing on interpreters' repair initiations in the context of VRI. Although repairs are an important mechanism for addressing problems in communication, very little research has been devoted to the study of interpreter-initiated repair in dialogue settings. Based on a corpus of video-recorded interpreted interactions (Dutch-Russian), where the interpreter is either present onsite or connected through video link, we analyse interpreters' repair initiations and related risk taking behaviour. More specifically, we examine how interpreters manage a specific type of repair initiations in video remote interpreting, namely postponed repairs. The analysis reveals differences in repair patterns between video remote and onsite interpreting and we propose that these differences result from differential risk management in the two settings. |
A. C. L. Vrijling; M. J. Boer; R. J. Renken; J. B. C. Marsman; A. Grillini; C. E. Petrillo; J. Heutink; N. M. Jansonius; F. W. Cornelissen Stimulus contrast, pursuit mode, and age strongly influence tracking performance on a continuous visual tracking task Journal Article In: Vision Research, vol. 205, pp. 1–11, 2023. @article{Vrijling2023, Human observers tend to naturally track moving stimuli. This tendency may be exploited towards an intuitive means of screening visual function as an impairment induced reduction in stimulus visibility will decrease tracking performance. Yet, to be able to detect subtle impairments, stimulus contrast is critical. If too high, the decrease in performance may remain undetected. Therefore, for this approach to become reliable and sensitive, we need a detailed understanding of how age, stimulus contrast, and the type of stimulus movement affect continuous tracking performance. To do so, we evaluated how well twenty younger and twenty older participants tracked a semi-randomly moving stimulus (Goldmann size III, 0.43 degrees of visual angle), presented at five contrast levels (5%-10%-20%-40%-80%). The stimulus could move smoothly only (smooth pursuit mode) or in alternation with displacements (saccadic pursuit mode). Additionally, we assessed static foveal and peripheral contrast thresholds. For all participants, tracking performance improved with increasing contrast in both pursuit modes. To reach threshold performance levels, older participants required about twice as much contrast (20% vs. 10% and 40% vs. 20% in smooth and saccadic modes respectively). Saccadic pursuit detection thresholds correlated significantly with static peripheral contrast thresholds (rho = 0.64). Smooth pursuit detection thresholds were uncorrelated with static foveal contrast thresholds (rho = 0.29). We conclude that continuous visual stimulus tracking is strongly affected by stimulus contrast, pursuit mode, and age. This provides essential insights that can be applied towards new and intuitive approaches of screening visual function. |
Isabella C. Wagner; Luise P. Graichen; Boryana Todorova; Andre Lüttig; David B. Omer; Matthias Stangl; Claus Lamm Entorhinal grid-like codes and time-locked network dynamics track others navigating through space Journal Article In: Nature Communications, vol. 14, no. 1, pp. 1–18, 2023. @article{Wagner2023a, Navigating through crowded, dynamically changing environments requires the ability to keep track of other individuals. Grid cells in the entorhinal cortex are a central component of self-related navigation but whether they also track others' movement is unclear. Here, we propose that entorhinal grid-like codes make an essential contribution to socio-spatial navigation. Sixty human participants underwent functional magnetic resonance imaging (fMRI) while observing and re-tracing different paths of a demonstrator that navigated a virtual reality environment. Results revealed that grid-like codes in the entorhinal cortex tracked the other individual navigating through space. The activity of grid-like codes was time-locked to increases in co-activation and entorhinal-cortical connectivity that included the striatum, the hippocampus, parahippocampal and right posterior parietal cortices. Surprisingly, the grid-related effects during observation were stronger the worse participants performed when subsequently re-tracing the demonstrator's paths. Our findings suggests that network dynamics time-locked to entorhinal grid-cell-related activity might serve to distribute information about the location of others throughout the brain. |
Nicholas Wagner; Emily Perkins; Yuheiry Rodriguez; Cora Ordway; Michaela Flum; Lucia Hernandez-Pena; Polina Perelstein; Kathy Sem; Yael Paz; Rista Plate; Ayomide Popoola; Sarah Lynch; Kristina Astone; Ethan Goldstein; Wanjikũ F. M. Njoroge; Adriane Raine; Donna Pincus; Koraly Pérez-Edgar; Rebecca Waller In: BMJ Open, vol. 13, no. 10, pp. 1–13, 2023. @article{Wagner2023b, Introduction: Children with callous-unemotional (CU) traits are at high lifetime risk of antisocial behaviour. Low affiliation (ie, social bonding difficulties) and fearlessness (ie, low threat sensitivity) are proposed risk factors for CU traits. Parenting practices (eg, harshness and low warmth) also predict risk for CU traits. However, few studies in early childhood have identified attentional or physiological markers of low affiliation and fearlessness. Moreover, no studies have tested whether parenting practices are underpinned by low affiliation or fearlessness shared by parents, which could further shape parent-child interactions and exacerbate risk for CU traits. Addressing these questions will inform knowledge of how CU traits develop and isolate novel parent and child targets for future specialised treatments for CU traits. Methods and analysis: The Promoting Empathy and Affiliation in Relationships (PEAR) study aims to establish risk factors for CU traits in children aged 3-6 years. The PEAR study will recruit 500 parent-child dyads from two metropolitan areas of the USA. Parents and children will complete questionnaires, computer tasks and observational assessments, alongside collection of eye-tracking and physiological data, when children are aged 3-4 (time 1) and 5-6 (time 2) years. The moderating roles of child sex, race and ethnicity, family and neighbourhood disadvantage, and parental psychopathology will also be assessed. Study aims will be addressed using structural equation modelling, which will allow for flexible characterisation of low affiliation, fearlessness and parenting practices as risk factors for CU traits across multiple domains. Ethics and dissemination: Ethical approval was granted by Boston University (#6158E) and the University of Pennsylvania (#850638). Results will be disseminated through conferences and open-access publications. All study and task materials will be made freely available on lab websites and through the Open Science Framework (OSF). |
Josefine Waldthaler; Alexander Sperlich; Aylin König; Charlotte Stüssel; Frank Bremmer; Lars Timmermann; David Pedrosa In: NeuroImage: Clinical, vol. 37, pp. 1–11, 2023. @article{Waldthaler2023, While deep brain stimulation (DBS) in the subthalamic nucleus (STN) improves motor functions in Parkinson's disease (PD), it may also increase impulsivity by interfering with the inhibition of reflexive responses. The aim of this study was to investigate if varying the pulse frequency of STN-DBS has a modulating effect on response inhibition and its neural correlates. For this purpose, 14 persons with PD repeated an antisaccade task in three stimulation settings (DBS off, high-frequency DBS (130 Hz), mid-frequency DBS (60 Hz)) in a randomized order, while eye movements and brain activity via high-density EEG were recorded. On a behavioral level, 130 Hz DBS stimulation had no effect on response inhibition measured as antisaccade error rate, while 60 Hz DBS induced a slight but significant reduction of directional errors compared with the DBS-off state and 130 Hz DBS. Further, stimulation with both frequencies decreased the onset latency of correct antisaccades, while increasing the latency of directional errors. Time-frequency domain analysis of the EEG data revealed that 60 Hz DBS was associated with an increase in preparatory theta power over a midfrontal region of interest compared with the off-DBS state which is generally regarded as a marker of increased cognitive control. While no significant differences in brain activity over mid- and lateral prefrontal regions of interest emerged between the 60 Hz and 130 Hz conditions, both stimulation frequencies were associated with a stronger midfrontal beta desynchronization during the mental preparation for correct antisaccades compared with DBS off-state which is discussed in the context of potentially enhanced proactive recruitment of the oculomotor network. Our preliminary findings suggest that mid-frequency STN-DBS may provide beneficial effects on response inhibition, while both 130 Hz- and 60 Hz STN-DBS may promote voluntary actions at the expense of slower reflexive responses. |
Josefine Waldthaler; Alexander Sperlich; Charlotte Stüssel; Kenan Steidel; Lars Timmermann; David J. Pedrosa Stimulation of non-motor subthalamic nucleus impairs selective response inhibition via prefrontal connectivity Journal Article In: Brain Communications, vol. 5, no. 2, pp. 1–13, 2023. @article{Waldthaler2023a, Given the inconsistent results in the past, there is an ongoing debate whether and how deep brain stimulation in the subthalamic nucleus modifies cognitive control processes like response inhibition in persons with Parkinson's disease. In this study, we examined how the location of the stimulation volume within the subthalamic nucleus affects the performance in an antisaccade task but also how its structural connectivity is related to response inhibition. Antisaccade error rates and latencies were collected in 14 participants on and off deep brain stimulation in a randomized order. Stimulation volumes were computed based on patient-specific lead localizations using preoperative MRI and postoperative CT scans. Structural connectivity of the stimulation volumes with pre-defined cortical oculomotor control regions as well as whole-brain connectivity was estimated using a normative connectome. We showed that the detrimental effect of deep brain stimulation on response inhibition, measured as antisaccade error rate, depended upon the magnitude of the intersection of volumes of activated tissue with the non-motor subregion of the subthalamic nucleus and on its structural connectivity with regions of the prefrontal oculomotor network including bilateral frontal eye fields and right anterior cingulate cortex. Our results corroborate previous recommendations for avoidance of stimulation in the ventromedial non-motor subregion of the subthalamic nucleus which connects to the prefrontal cortex to prevent stimulation-induced impulsivity. Furthermore, antisaccades were initiated faster with deep brain stimulation when the stimulation volume was connected to fibres passing the subthalamic nucleus laterally and projecting onto the prefrontal cortex, indicating that improvement of voluntary saccade generation with deep brain stimulation may be an off-target effect driven by stimulation of corticotectal fibres directly projecting from the frontal and supplementary eye fields onto brainstem gaze control areas. Taken together, these findings could help implement individualized circuit-based deep brain stimulation strategies that avoid impulsive side effects while improving voluntary oculomotor control. |
Josefine Waldthaler; Lena Stock; Charlotte Krüger-Zechlin; Zain Deeb; Lars Timmermann Cluster analysis reveals distinct patterns of saccade impairment and their relation to cognitive profiles in Parkinson's disease Journal Article In: Journal of Neuropsychology, vol. 17, no. 2, pp. 251–263, 2023. @article{Waldthaler2023b, Saccade performance has been reported to be altered in Parkinson's disease (PD), however, with a large variability between studies as both motor and cognitive impairment interfere with oculomotor control. The aim of this study was to identify different patterns in saccade alterations in PD using a data-driven approach and to explore their relationship with cognitive phenotypes. Sixty-one participants with PD and 25 controls performed eye-tracking (horizontal and vertical prosaccades, antisaccades) and neuropsychological testing. Hierarchical cluster analysis was applied to the eye-tracking data to subsequently compare the clusters based on demographical, clinical and cognitive characteristics. The three identified clusters of saccade alterations differed in cognitive profiles from healthy controls, but not in PD-related motor symptoms or demographics. The rate of directive errors in the antisaccade task was increased in clusters 1 and 2. Further, cluster 1 was defined by a general disinhibition of reflexive saccades and executive dysfunction in the neuropsychological evaluation. In cluster 2, prolonged saccade latencies and hypometria were accompanied by multidomain cognitive impairment. The cluster 3 showed increased antisaccade latency and vertical hypometria despite lack of evidence for cognitive impairment. Our results suggest that there may be at least two opposing patterns of saccade alterations associated with cognitive impairment in PD, which may explain some of the contradictory results of previous studies. |
Carla A. Wall; Frederick Shic; Sreeja Varanasi; Jane E. Roberts Distinct social attention profiles in preschoolers with autism contrasted to fragile X syndrome Journal Article In: Autism Research, vol. 16, no. 2, pp. 340–354, 2023. @article{Wall2023, Social attention is a critical skill for learning and development. Social attention difficulties are present in both non-syndromic autism spectrum disorder (nsASD) and fragile X syndrome (FXS), and our understanding of these difficulties is complicated by heterogeneity in both disorders, including co-occurring diagnoses like intellectual disability and social anxiety. Existing research largely utilizes a single index of social attention and rarely includes children with intellectual impairment or uses a cross-syndrome approach. This study investigated whether multi-trait social attention profiles including naturalistic initial eye contact, facial attention, and social scene attention differ in preschool children with nsASD and FXS matched on developmental ability (DQ) and contrasted to neurotypical (NT) controls. The relationship between DQ, ASD severity, and social anxiety and social attention profiles was also examined. Initial eye contact related to social scene attention, implicating that naturalistic social attention is consistent with responses during experimental conditions. Reduced eye contact and lower social scene attention characterized nsASD and FXS. Children with nsASD displayed less facial attention than FXS and NT children, who did not differ. Lower DQ and elevated ASD severity associated with decreased eye contact in nsASD and FXS, and lower DQ was associated with lower social scene attention in FXS. Sex, social anxiety, and age were not associated with social attention. These findings suggest social attention profiles of children with nsASD are highly similar to, yet distinct from, children with FXS. Children with nsASD may present with a global social attention deficit whereas FXS profiles may reflect context-dependent social avoidance. |
Yingjia Wan; Yipu Wei; Baorui Xu; Liqi Zhu; Michael K. Tanenhaus Musical coordination affects children's perspective-taking, but musical synchrony does not Journal Article In: Developmental Science, vol. 26, no. 5, pp. 1–13, 2023. @article{Wan2023a, Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self-other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that would otherwise have occurred. We found no evidence for online perspective-taking in 4- to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. A video abstract of this article can be viewed at https://youtu.be/TM9h_GpFlsA. Research Highlights: This study is the first to show that rhythmic coordination, a form of non-linguistic interaction, can affect children's performance in a subsequent linguistic task. Eye-movement data revealed that children's perspective-taking in language processing was facilitated by prior asynchronous and antiphase synchronous musical interactions, but not by synchronous coordination. The results challenge the common “similar is better” view, suggesting that maintaining self-other distinction may benefit social interactions that involve representing individual differences. |
Yingjia Wan; Yipu Wei; Baorui Xu; Liqi Zhu; Michael K. Tanenhaus Musical coordination affects children's perspective-taking, but musical synchrony does not Journal Article In: Developmental Science, pp. 1–13, 2023. @article{Wan2023, Perspective-taking, which is important for communication and social activities, can be cultivated through joint actions, including musical activities in children. We examined how rhythmic activities requiring coordination affect perspective-taking in a referential communication task with 100 Chinese 4- to 6-year-old children. In Study 1, 5- to 6-year-old children played an instrument with a virtual partner in one of three coordination conditions: synchrony, asynchrony, and antiphase synchrony. Eye movements were then monitored with the partner giving instructions to identify a shape referent which included a pre-nominal scalar adjective (e.g., big cubic block). When the target contrast (a small cubic block) was in the shared ground and a competitor contrast was occluded for the partner, participants who used perspective differences could, in principle, identify the intended referent before the shape was named. We hypothesized that asynchronous and antiphase synchronous musical activities, which require self- other distinction, might have stronger effects on perspective-taking than synchronous activity. Children in the asynchrony and antiphase synchrony conditions, but not the synchrony condition, showed anticipatory looks at the target, demonstrating real-time use of the partner's perspective. Study 2 was conducted to determine if asynchrony and antiphase asynchrony resulted in perspective-taking that otherwise would not have been observed, or if synchronous coordination inhibited perspective-taking that wouldotherwise have occurred. We found no evidence for online perspective-taking in 4-to 6-year-old children without music manipulation. Therefore, playing instruments asynchronously or in alternation, but not synchronously, increases perspective-taking in children of this age, likely by training self-other distinction and control. |
Ailian Wang; Jing Pan; Caihong Jiang; Jia Jin Create the best first glance: The cross-cultural effect of image background on purchase intention Journal Article In: Decision Support Systems, vol. 170, pp. 1–12, 2023. @article{Wang2023a, As globalization drives more firms toward cross-border e-commerce (CBEC), a well-designed decision support system becomes crucial to gain a competitive edge in the international market. Product images, a vital aspect of the system interface, play a significant role in shaping users' first impressions, facilitating seller-buyer information interaction, and ultimately enhancing users' decisions making in the system. Across a series of studies, this research investigates the effect of cultural differences (thinking style: holistic vs. analytic) on image background and reveals the underlying mechanism. Results show that online consumers from cultures characterized by holistic thinking style (Chinese sample) are more prone to purchase products presented with contextual backgrounds than those with white backgrounds, while this effect is absent for online consumers from cultures that tend to think in an analytic way (American sample). This effect is also observed when the thinking style is primed within the culture in separate samples from the United States and China. Study 3 employs eye-tracking technology and shows that holistic thinking, compared to analytic thinking, results in an asymmetry in cognitive effort to purchase the same products framed with contextual and white background images. Specifically, contextual (vs. white) background information greatly assists holistic thinking consumers in understanding the product, enabling them to spend less cognitive effort on product information processing. Instead, the cognitive effort that analytic thinking consumers spare in the product information is not affected by the background. Finally, we discuss theoretical contributions and practical insights for CBEC retailers and system designers that the findings indicate. |
Chao Wang; Mitchell Reid Pond LaPointe; Shree Venkateshan; Guang Zhao; Weidong Tao; Hong-Jin Sun; Bruce Milliken Item-specific control of attention capture: An eye movement study Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 1, pp. 117–132, 2023. @article{Wang2023o, Measures of attentional capture are sensitive to attentional control settings. Recent research suggests that such control settings can be linked associatively to specific items. Rapid item-specific retrieval of these control settings can then modulate measures of attentional capture. However, the processes that produce this item-specific control of attentional capture are unclear. The current study addressed this issue by examining eye-movement patterns associated with the item-specific proportion congruency effect (ISPC). Participants searched for a shape singleton target in search displays that also contained a colour singleton—the colour singleton was either the same item as the shape singleton (congruent trials) or a different item (incongruent trials). The relative proportions of congruent and incongruent trials were manipulated separately for two distinct item types that were randomly intermixed. Response times (RTs) were faster on congruent than incongruent trials, and this congruency effect was larger for high-proportion congruent (HPC) than low-proportion congruent (LPC) items. Eye movement data revealed a higher proportion of saccades towards the distractor and longer dwell times on the distractor in the HPC condition. These results suggest that item-specific associative learning can influence the strength of representation of the task goal (e.g., find the odd shape), a form of selection history effect in visual search. |
Chin-An Wang; Neil G. Muggleton; Yi-Hsuan Chang; Cesar Barquero; Ying-Chun Kuo Time-on-task effects on human pupillary and saccadic metrics after theta burst transcranial magnetic stimulation over the frontal eye field Journal Article In: IBRO Neuroscience Reports, vol. 15, pp. 364–375, 2023. @article{Wang2023c, Pupil size undergoes constant changes primarily influenced by ambient luminance. These changes are referred to as the pupillary light reflex (PLR), where the pupil transiently constricts in response to light. PLR kinematics provides valuable insights into autonomic nervous system function and have significant clinical applications. Recent research indicates that attention plays a role in modulating the PLR, and the circuit involving the frontal eye field (FEF) and superior colliculus is causally involved in controlling this pupillary modulation. However, there is limited research exploring the role of the human FEF in these pupillary responses, and its impact on PLR metrics remains unexplored. Additionally, although the protocol of continuous theta-burst stimulation (cTBS) is well-established, the period of disruption after cTBS is yet to be examined in pupillary responses. Our study aimed to investigate the effects of FEF cTBS on pupillary and saccadic metrics in relation to time spent performing a task (referred to as time-on-task). We presented a bright stimulus to induce the PLR in visual- and memory-delay saccade tasks following cTBS over the right FEF or vertex. FEF cTBS, compared to vertex cTBS, resulted in decreased baseline pupil size, peak constriction velocities, and amplitude. Furthermore, the time-on-task effects on baseline pupil size, peak amplitude, and peak time differed between the two stimulation conditions. In contrast, the time-on-task effects on saccadic metrics were less pronounced between the two conditions. In summary, our study provides the first evidence that FEF cTBS affects human PLR metrics and that these effects are modulated by time-on-task. |
Haozhe Zac Wang; Yan Tat Wong A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision Journal Article In: Journal of Neural Engineering, vol. 20, no. 4, pp. 1–18, 2023. @article{Wang2023d, Objective. We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm. Approach. Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task. Main results. Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task. Significance. The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses. |
Jiahui Wang Mind wandering in videos that integrate instructor's visuals: An eye tracking study Journal Article In: Innovations in Education and Teaching International, pp. 1–16, 2023. @article{Wang2023e, With an increasing number of videos integrating instructor's visuals on screen, we know little about the impacts of this design on mind wandering. The study aims to investigate a) how instructor visibility impacts mind wandering; b) the relationship between mind wandering and retention performance; c) how visual behaviour during video-watching influences mind wandering. Each participant watched a video with or without instructor visibility, while their visual behaviour was recorded by an eye tracker. Retention performance was measured at the completion of the video. Mind wandering was inferred via global self-report measure and objective eye tracking measure. Both measures of mind wandering indicated the instructor visible video resulted in less mind wandering. Findings suggested mind wandering impaired retention performance. Additionally, visual attention to the instructor was associated with less mind wandering. |
Kangning Wang; Shuang Qiu; Wei Wei; Weibo Yi; Huiguang He; Minpeng Xu; Tzyy Ping Jung; Dong Ming Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems Journal Article In: Journal of Neural Engineering, vol. 20, no. 5, pp. 1–18, 2023. @article{Wang2023g, Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions. Approach. To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days. Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation. Significance. Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications. |
Kangning Wang; Shuang Qiu; Wei Wei; Yukun Zhang; Shengpei Wang; Huiguang He; Minpeng Xu; Tzyy Ping Jung; Dong Ming A multimodal approach to estimating vigilance in SSVEP-based BCI Journal Article In: Expert Systems with Applications, vol. 225, pp. 1–16, 2023. @article{Wang2023h, Brain-computer interface (BCI) is a communication system that allows a direct connection between the human brain and external devices, which is able to provide assistance and improve the quality of life for people with disabilities. Vigilance is an important cognitive state and plays an important role in human–computer interaction. In BCI tasks, the low-vigilance state of the BCI user would lead to the performance degradation. Therefore, it is desirable to develop an efficient method to estimate the vigilance state of BCI users. In this study, we built a 4-target BCI system based on steady-state visual evoked potential (SSVEP) for cursor control. Electroencephalogram (EEG) and electrooculogram (EOG) were recorded simultaneously from 18 subjects during a 90-min continuous cursor-control BCI task. We proposed a multimodal vigilance estimating network, named MVENet, to estimate the vigilance state of BCI users through the multimodal signals. In this architecture, a spatial-temporal convolution module with an attention mechanism was adopted to explore the temporal-spatial information of the EEG features, and a long short-term memory module was utilized to learn the temporal dependencies of EOG features. Moreover, a fusion mechanism was built to fuse the EEG representations and EOG representations effectively. Experimental results showed that the proposed network achieved a better performance than the compared methods. These results demonstrate the feasibility and effectiveness of our methods for estimating the vigilance state of BCI users. |
Audrey Mazancieux; Franck Mauconduit; Alexis Amadon; Jan Willem de Gee; Tobias H. Donner; Florent Meyniel Brainstem fMRI signaling of surprise across different types of deviant stimuli Journal Article In: Cell Reports, vol. 42, no. 11, pp. 1–15, 2023. @article{Mazancieux2023, Detection of deviant stimuli is crucial to orient and adapt our behavior. Previous work shows that deviant stimuli elicit phasic activation of the locus coeruleus (LC), which releases noradrenaline and controls central arousal. However, it is unclear whether the detection of behaviorally relevant deviant stimuli selectively triggers LC responses or other neuromodulatory systems (dopamine, serotonin, and acetylcholine). We combine human functional MRI (fMRI) recordings optimized for brainstem imaging with pupillometry to perform a mapping of deviant-related responses in subcortical structures. Participants have to detect deviant items in a “local-global” paradigm that distinguishes between deviance based on the stimulus probability and the sequence structure. fMRI responses to deviant stimuli are distributed in many cortical areas. Both types of deviance elicit responses in the pupil, LC, and other neuromodulatory systems. Our results reveal that the detection of task-relevant deviant items recruits the same multiple subcortical systems across computationally different types of deviance. |
Siobhan M. McAteer; Emma Ablott; Anthony McGregor; Daniel T. Smith Dynamic resource allocation in spatial working memory during full and partial report tasks Journal Article In: Journal of Vision, vol. 23, no. 2, pp. 1–14, 2023. @article{McAteer2023a, Serial position effects are well-documented in working memory literature. Studies of spatial short-term memory that rely on binary response; full report tasks tend to report stronger primacy than recency effects. In contrast, studies that utilize a continuous response, partial report task report stronger recency than primacy effects (Gorgoraptis, Catalao, Bays, & Husain, 2011; Zokaei, Gorgoraptis, Bahrami, Bays, & Husain, 2011). The current study explored the idea that probing spatial working memory using full and partial continuous response tasks would produce different distributions of visuospatial working memory resources across spatial sequences and, therefore, explain the conflicting results in the literature. Experiment 1 demonstrated that primacy effects were observed when memory was probed with a full report task. Experiment 2 confirmed this finding while controlling eye movements. Critically, Experiment 3 demonstrated that switching from a full to a partial report task abolished the primacy effect and produced a recency effect, consistent with the idea that the distribution of resources in visuospatial working memory depends on the type of recall required. It is argued that the primacy effect in the whole report task arose from the accumulation of noise caused by the execution of multiple spatially directed actions during recall, whereas the recency effect in the partial report task reflects the redistribution of preallocated resources when an anticipated item is not presented. These data show that it is possible to reconcile apparently contradictory findings within the resource theory of spatial working memory and the importance of considering how memory is probed when interpreting behavioral data through the lens of resource theories of spatial working memory |
Siobhan M. McAteer; Anthony McGregor; Daniel T. Smith Oculomotor rehearsal in visuospatial working memory Journal Article In: Attention, Perception, and Psychophysics, vol. 85, pp. 261–275, 2023. @article{McAteer2023, The neural and cognitive mechanisms of spatial working memory are tightly coupled with the systems that control eye movements, but the precise nature of this coupling is not well understood. It has been argued that the oculomotor system is selectively involved in rehearsal of spatial but not visual material in visuospatial working memory. However, few studies have directly compared the effect of saccadic interference on visual and spatial memory, and there is little consensus on how the underlying working memory representation is affected by saccadic interference. In this study we aimed to examine how working memory for visual and spatial features is affected by overt and covert attentional interference across two experiments. Participants were shown a memory array, then asked to either maintain fixation or to overtly or covertly shift attention in a detection task during the delay period. Using the continuous report task we directly examined the precision of visual and spatial working memory representations and fit psychophysical functions to investigate the sources of recall error associated with different types of interference. These data were interpreted in terms of embodied theories of attention and memory and provide new insights into the nature of the interactions between cognitive and motor systems. |
Vincent B. McGinty; Shira M. Lupkin Behavioral read-out from population value signals in primate orbitofrontal cortex Journal Article In: Nature Neuroscience, vol. 26, no. 12, pp. 2203–2212, 2023. @article{McGinty2023, The primate orbitofrontal cortex (OFC) has long been recognized for its role in value-based decisions; however, the exact mechanism linking value representations in the OFC to decision outcomes has remained elusive. Here, to address this question, we show, in non-human primates, that trial-wise variability in choices can be explained by variability in value signals decoded from many simultaneously recorded OFC neurons. Mechanistically, this relationship is consistent with the projection of activity within a low-dimensional value-encoding subspace onto a potentially higher-dimensional, behaviorally potent output subspace. Identifying this neural–behavioral link answers longstanding questions about the role of the OFC in economic decision-making and suggests population-level read-out mechanisms for the OFC similar to those recently identified in sensory and motor cortex. |
Jacie R. McHaney; William L. Schuerman; Matthew K. Leonard; Bharath Chandrasekaran Transcutaneous auricular vagus nerve stimulation modulates performance but not pupil size during nonnative speech category learning Journal Article In: Journal of Speech, Language, and Hearing Research, vol. 66, no. 10, pp. 3825–3843, 2023. @article{McHaney2023, Purpose: Subthreshold transcutaneous auricular vagus nerve stimulation (taVNS) synchronized with behavioral training can selectively enhance nonnative speech category learning in adults. Prior work has demonstrated that behavioral performance increases when taVNS is paired with easier-to-learn Mandarin tone categories in native English listeners, relative to when taVNS is paired with harder-to-learn Mandarin tone categories or without taVNS. Mechanistically, this temporally precise plasticity has been attributed to noradrenergic modulation. However, prior work did not specifically utilize methodologies that indexed nor-adrenergic modulation and, therefore, was unable to explicitly test this hypothesis. Our goal for this study was to use pupillometry to gain mechanistic insights into taVNS behavioral effects. Method: Thirty-eight participants learned to categorize Mandarin tones while pupil-lometry was recorded. In a double-blinded design, participants were divided into two taVNS groups that, as in the prior study, differed according to whether taVNS was paired with easier-to-learn tones or harder-to-learn tones. Learning performance and pupillary responses were measured using linear mixed-effects models. Results: We found that taVNS did not have any tone-specific or group behav-ioral or pupillary effects. However, in an exploratory analysis, we observed that taVNS did lead to faster rates of learning on trials paired with stimulation, particularly for those who were stimulated at lower amplitudes. Conclusions: Our results suggest that pupillary responses may not be a reliable marker of locus coeruleus–norepinephrine system activity in humans. However, future research should systematically examine the effects of stimulation amplitude on both behavior and pupillary responses. |
Drew J. McLaughlin; Jackson S. Colvett; Julie M. Bugg; Kristin J. Van Engen Sequence effects and speech processing: Cognitive load for speaker-switching within and across accents Journal Article In: Psychonomic Bulletin & Review, pp. 1–11, 2023. @article{McLaughlin2023, Prior work in speech processing indicates that listening tasks with multiple speakers (as opposed to a single speaker) result in slower and less accurate processing. Notably, the trial-to-trial cognitive demands of switching between speakers or switching between accents have yet to be examined. We used pupillometry, a physiological index of cognitive load, to examine the demands of processing first (L1) and second (L2) language-accented speech when listening to sentences produced by the same speaker consecutively (no switch), a novel speaker of the same accent (within-accent switch), and a novel speaker with a different accent (across-accent switch). Inspired by research on sequential adjustments in cognitive control, we aimed to identify the cognitive demands of accommodating a novel speaker and accent by examining the trial-to-trial changes in pupil dilation during speech processing. Our results indicate that switching between speakers was more cognitively demanding than listening to the same speaker consecutively. Additionally, switching to a novel speaker with a different accent was more cognitively demanding than switching between speakers of the same accent. However, there was an asymmetry for across-accent switches, such that switching from an L1 to an L2 accent was more demanding than vice versa. Findings from the present study align with work examining multi-talker processing costs, and provide novel evidence that listeners dynamically adjust cognitive processing to accommodate speaker and accent variability. We discuss these novel findings in the context of an active control model and auditory streaming framework of speech processing. |
Drew J. McLaughlin; Maggie E. Zink; Lauren Gaunt; Jamie Reilly; Mitchell S. Sommers; Kristin J. Van Engen; Jonathan E. Peelle Give me a break! Unavoidable fatigue effects in cognitive pupillometry Journal Article In: Psychophysiology, vol. 60, no. 7, pp. 1–20, 2023. @article{McLaughlin2023a, Pupillometry has a rich history in the study of perception and cognition. One perennial challenge is that the magnitude of the task-evoked pupil response diminishes over the course of an experiment, a phenomenon we refer to as a fatigue effect. Reducing fatigue effects may improve sensitivity to task effects and reduce the likelihood of confounds due to systematic physiological changes over time. In this paper, we investigated the degree to which fatigue effects could be ameliorated by experimenter intervention. In Experiment 1, we assigned participants to one of three groups—no breaks, kinetic breaks (playing with toys, but no social interaction), or chatting with a research assistant—and compared the pupil response across conditions. In Experiment 2, we additionally tested the effect of researcher observation. Only breaks including social interaction significantly reduced the fatigue of the pupil response across trials. However, in all conditions we found robust evidence for fatigue effects: that is, regardless of protocol, the task-evoked pupil response was substantially diminished (at least 60%) over the duration of the experiment. We account for the variance of fatigue effects in our pupillometry data using multiple common statistical modeling approaches (e.g., linear mixed-effects models of peak, mean, and baseline pupil diameters, as well as growth curve models of time-course data). We conclude that pupil attenuation is a predictable phenomenon that should be accommodated in our experimental designs and statistical models. |
Mary E. McNamara; Kean J. Hsu; Bryan A. McSpadden; Semeon Risom; Jason Shumake; Christopher G. Beevers Beyond face value: Assessing the factor structure of an eye-tracking based attention bias task Journal Article In: Cognitive Therapy and Research, vol. 47, no. 5, pp. 772–787, 2023. @article{McNamara2023, Background: Behavioral measurement of attention bias for emotional stimuli has traditionally ignored whether trial-level task data have a strong enough general factor to justify a unidimensional measurement model. This is surprising, as unidimensionality across trials is an important assumption for computing bias scores. Methods: In the present study, we assess the psychometric properties of a free-viewing, eye-tracking task measuring attention for emotional stimuli. Undergraduate students (N = 130) viewed two counterbalanced blocks of 4 × 4 matrices of sad/neutral and happy/neutral facial expressions for 10 seconds each across 60 trials. We applied a bifactor measurement model across ten attention bias metrics (e.g., total dwell time for neutral and emotional stimuli, ratio of emotional to total dwell time, difference in dwell time for emotional and neutral stimuli, a variable indicating whether dwell time on emotional stimuli exceeded dwell time on neutral stimuli) to assess whether trial-level data load on to a single, general factor. Unidimensionality was evaluated using omega hierarchical, explained common variance, and percentage of uncontaminated correlations. Results: Total dwell time had excellent internal consistency for sad (ɑ =.95, ɷ =.96) and neutral stimuli (ɑ =.95, ɷ =.95), and met criteria for unidimensionality, suggesting the trial-level data within each task reflect a single underlying construct. However, the remaining bias metrics fell short of the unidimensionality thresholds, suggesting not all metrics are good candidates for creating bias scores. Conclusion: Total dwell time by valence had the best psychometrics in terms of internal consistency and unidimensionality. This study demonstrates the importance of assessing whether trial-level data load onto a general factor, as not all metrics are equivalent, even when derived from the same task data. |
Mishika Mehrotra; Sebastian P. Dys; Tina Malti Children's sympathy moderates the link between their attentional orientation and ethical guilt Journal Article In: British Journal of Developmental Psychology, vol. 41, no. 3, pp. 276–290, 2023. @article{Mehrotra2023, This study examined how children's attentional orientation towards environmental cues, dispositional sympathy and inhibitory control were associated with their ethical guilt. Participants were 4- and 6-year-old children (N = 211; 55% male) from ethnically diverse backgrounds. To assess ethical guilt, children were presented with two vignettes depicting ethical violations and reported how they would feel and why, if they had committed those transgressions. Using eye tracking, we calculated attentional orientation as the percentage of time children attended to other-oriented (i.e., victim) minus self-serving (i.e., object gained by transgressing) cues during these vignettes. Children also reported on their sympathy and completed an observational measure of inhibitory control. Although main effects were not significant, sympathy moderated the link between attentional orientation and ethical guilt: attentional orientation was positively associated with ethical guilt for children with low levels of sympathy but had no effect among those high in sympathy. These findings suggest that practices centred on prompting children to attend to other-oriented cues – and away from self-serving ones – may be effective particularly for children who are generally less sympathetic. |
Hiu Mei Chow; Miriam Spering Eye movements during optic flow perception Journal Article In: Vision Research, vol. 204, pp. 1–11, 2023. @article{MeiChow2023, Optic flow is an important visual cue for human perception and locomotion and naturally triggers eye movements. Here we investigate whether the perception of optic flow direction is limited or enhanced by eye movements. In Exp. 1, 23 human observers localized the focus of expansion (FOE) of an optic flow pattern; in Exp. 2, 18 observers had to detect brief visual changes at the FOE. Both tasks were completed during free viewing and fixation conditions while eye movements were recorded. Task difficulty was varied by manipulating the coherence of radial motion from the FOE (4 %-90 %). During free viewing, observers tracked the optic flow pattern with a combination of saccades and smooth eye movements. During fixation, observers nevertheless made small-scale eye movements. Despite differences in spatial scale, eye movements during free viewing and fixation were similarly directed toward the FOE (saccades) and away from the FOE (smooth tracking). Whereas FOE localization sensitivity was not affected by eye movement instructions (Exp. 1), observers' sensitivity to detect brief changes at the FOE was 27 % higher (p <.001) during free-viewing compared to fixation (Exp. 2). This performance benefit was linked to reduced saccade endpoint errors, indicating the direct beneficial impact of foveating eye movements on performance in a fine-grain perceptual task, but not during coarse perceptual localization. |
Natalia Melnik; Stefan Pollmann Efficient versus inefficient visual search as training for saccadic re-referencing to an extrafoveal location Journal Article In: Journal of Vision, vol. 23, no. 10, pp. 1–13, 2023. @article{Melnik2023, Central vision loss is one of the leading causes of visual impairment in the elderly and its frequency is increasing. Without formal training, patients adopt an unaffected region of the retina as a new fixation location, a preferred retinal locus (PRL). However, learning to use the PRL as a reference location for saccades, that is, saccadic re-referencing, is protracted and time-consuming. Recent studies showed that training with visual search tasks can expedite this process. However, visual search can be driven by salient external features - leading to efficient search, or by internal goals, usually leading to inefficient, attention-demanding search. We compared saccadic re-referencing training in the presence of a simulated central scotoma with either an efficient or an inefficient visual search task. Participants had to respond by fixating the target with an experimenter-defined retinal location in the lower visual field. We observed that comparable relative training gains were obtained in both tasks for a number of behavioral parameters, with higher training gains for the trained task, compared to the untrained task. The transfer to the untrained task was only observed for some parameters. Our findings thus confirm and extend previous research showing comparable efficiency for exogenously and endogenously driven visual search tasks for saccadic re-referencing training. Our results also show that transfer of training gains to related tasks may be limited and needs to be tested for saccadic re-referencing-training paradigms to assess its suitability as a training tool for patients. |
Melisa Menceloglu; Ken Nakayama; Joo-Hyun Song Radial bias alters high-level motion perception Journal Article In: Vision Research, vol. 209, pp. 1–8, 2023. @article{Menceloglu2023, The visual system involves various orientation and visual field anisotropies, one of which is a preference for radial orientations and motion directions. By radial, we mean those directions coursing symmetrically outward from the fovea into the periphery. This bias stems from anatomical and physiological substrates in the early visual system. We recently reported that this low-level visual anisotropy can alter perceived object orientation. Here, we report that radial bias can also alter another higher-level system, the perceived direction of apparent motion. We presented a bistable apparent motion quartet in the center of the screen while participants fixated on various locations around the quartet. Participants (N = 22) were strongly biased to see the motion direction that was radial with respect to their fixation, controlling for any biases with center fixation. This was observed using a vertical-horizontal quartet as well as an oblique quartet (45° rotated quartet). The latter allowed us to rule out the contribution of the hemisphere effect where motion across the midline is perceived less often. These results extend our earlier findings on perceived object orientation, showing that low-level structural aspects of the visual system alter yet another higher-level visual process, that of apparent motion perception. |
Arthur Pabst; Zoé Bollen; Nicolas Masson; Pauline Billaux; Philippe Timary; Pierre Maurage An eye-tracking study of biased attentional processing of emotional faces in severe alcohol use disorder Journal Article In: Journal of Affective Disorders, vol. 323, pp. 778–787, 2023. @article{Pabst2023, Background: Social cognition impairments in severe alcohol use disorder (SAUD) are increasingly established. However, fundamental aspects of social cognition, and notably the attentional processing of socio-affective information, remain unexplored, limiting our understanding of underlying mechanisms. Here, we determined whether patients with SAUD show attentional biases to specific socio-affective cues, namely emotional faces. Method: In a modified dot-probe paradigm, 30 patients with SAUD and 30 demographically matched healthy controls (HC) were presented with pairs of neutral-emotional (angry, disgusted, happy, sad) faces while having their eye movements recorded. Indices of early/automatic (first fixations, latency to first fixations) and later/controlled (number of fixations, dwell-time) processes were computed. Results: Patients with SAUD did not differ from HC in their attention to angry/disgusted/sad vs. neutral faces. However, patients with SAUD fixated/dwelled less on happy vs. neutral faces in the first block of stimuli than HC, who presented an attentional bias to happy faces. Limitations: Sample-size was determined to detect medium-to-large effects and subtler ones may have been missed. Further, our cross-sectional design provides no explanation as to whether the evidenced biases precede or are a consequence of SAUD. Conclusions: These results extend the social cognition literature in SAUD to the attentional domain, by evidencing the absence of a controlled attentional bias toward positive social cues in SAUD. This may reflect reduced sensitivity to social reward and could contribute to higher order social cognition difficulties and social dysfunction. |
Sabina Poudel; Jianzhong Jin; Hamed Rahimi-Nasrabadi; Stephen Dellostritto; Mitchell W. Dul; Suresh Viswanathan; Jose-Manuel Alonso Contrast sensitivity of ON and OFF human retinal pathways in myopia Journal Article In: The Journal of Neuroscience, vol. 44, no. 3, pp. 1–16, 2023. @article{Poudel2023, The human visual cortex processes light and dark stimuli with ON and OFF pathways that are differently modulated by luminance contrast. We have previously demonstrated that ON cortical pathways have higher contrast sensitivity than OFF cortical pathways and the difference increases with luminance range (defined as the maximum minus minimum luminance in the scene). Here, we demonstrate that these ON-OFF cortical differences are already present in the human retina and that retinal responses measured with electroretinography are more affected by reductions in luminance range than cortical responses measured with electroencephalography. Moreover, we show that ON-OFF pathway differences measured with electroretinography become more pronounced in myopia, a visual disorder that elongates the eye and blurs vision at far distance. We find that, as the eye axial length increases across subjects, ON retinal pathways become less responsive, slower in response latency, less sensitive, and less effective and slower at driving pupil constriction. Based on these results, we conclude that myopia is associated with a deficit in ON pathway function that decreases the ability of the retina to process low contrast and regulate retinal illuminance in bright environments. Significance Statement Contrast sensitivity is an important visual function that allows discriminating faint visual targets slightly lighter or darker than the background. We have previously demonstrated that ON and OFF cortical pathways signaling light and dark stimuli have different contrast sensitivity and the difference increases with luminance range. Here, we demonstrate that these ON-OFF sensitivity differences are inherited from the retina and are affected by myopia (nearsightedness), a visual disorder that blurs vision at far distances and is becoming a world epidemic. We show that myopia is associated with a retinal deficit that makes ON pathways less effective at signaling contrast and regulating retinal illuminance. These results could have clinical implications and may lead to novel approaches for myopia control. |
Sophia Antonia Press; Stefanie C. Biehl; Gregor Domes; Jennifer Svaldi; Sophia Antonia Press; Stefanie C. Biehl; Gregor Domes; Jennifer Svaldi; Sophia Antonia Press Increased insula and amygdala activity during selective attention for negatively valenced body parts in binge eating disorder Journal Article In: Journal of Psychopathology and Clinical Science, vol. 132, no. 1, pp. 63–77, 2023. @article{Press2023, Previous studies indicate that participants with eating disorders show an attentional bias for the negatively valenced body parts of their own body. However, the neural basis underlying these processes has not been investigated. We conducted a preregistered combined functional MRI (fMRI)/eye tracking study and presented 35 women with binge eating disorder (BED) and 24 weight-matched control subjects (CG) with body part images of their own body and a weight-matched unknown body. After the fMRI examination, participants rated the attractiveness of the presented body parts. As expected, women with BED responded with significantly higher insula and amygdala activity when viewing the negatively valenced body parts of their own body (compared to all other combinations). However, individuals with BED did not deviate from the CG in the processing of these stimuli in the ventromedial prefrontal cortex, the extrastriate body area or the fusiform body area. Our results indicate that the negative valued body parts carry a particularly strong emotional valence in individuals with BED. These results further emphasize the relevance of processing bias for negatively valenced body parts in the pathology of BED. |
Eva Puimege; Maribel Montero Perez; Elke Peters The effects of typographic enhancement on L2 collocation processing and learning from reading: An eye-tracking study Journal Article In: Applied Linguistics, pp. 1–24, 2023. @article{Puimege2023, This study examined the effects of TE on online processing of collocations during reading and on L2 collocation knowledge. The eye-tracking results indi- cate that the initial attention-enhancing effect of TE did not carry over to later, unenhanced exposures. Results of post-experiment interviews suggested that learners' primary focus was on meaning comprehension and that TE did not induce conscious attention to the form of the target collocations. One week after the treatment, participants could recognize the correct form of target col- locations, but they could not productively recall most of them. We conclude that a single enhanced exposure does not necessarily affect learners' memory of collocations, or their processing of those collocations in later exposures. The development of L2 collocation knowledge may require a large amount of expo- sure in purely incidental contexts. |
Eva Puimège; Maribel Montero Perez; Elke Peters Promoting L2 acquisition of multiword units through textually enhanced audiovisual input: An eye-tracking study Journal Article In: Second Language Research, vol. 39, no. 2, pp. 471–492, 2023. @article{Puimege2023a, This study examines the effect of textual enhancement on learners' attention to and learning of multiword units from captioned audiovisual input. We adopted a within-participants design in which 28 learners of English as a foreign language (EFL) watched a captioned video containing enhanced (underlined) and unenhanced multiword units. Using eye-tracking, we measured learners' online processing of the multiword units as they appeared in the captions. Form recall pre- and posttests measured learners' acquisition of the target items. The results of mixed effects models indicate that enhanced items received greater visual attention, with longer reading times, less single word skipping and more rereading. Further, a positive relationship was found between amount of visual attention and learning odds: items fixated longer, particularly during the first pass, were more likely to be recalled in an immediate posttest. Our findings provide empirical support for the positive effect of visual attention on form recall of multiword units encountered in captioned television. The results also suggest that item difficulty and amount of attention were more important than textual enhancement in predicting learning gains. |
Zoe A. Purcell; Andrew J. Roberts; Simon J. Handley; Stephanie Howarth Eye movements, pupil dilation, and conflict detection in reasoning: Exploring the evidence for intuitive logic Journal Article In: Cognitive Science, vol. 47, no. 6, pp. 1–18, 2023. @article{Purcell2023, A controversial claim in recent dual process accounts of reasoning is that intuitive processes not only lead to bias but are also sensitive to the logical status of an argument. The intuitive logic hypothesis draws upon evidence that reasoners take longer and are less confident on belief–logic conflict problems, irrespective of whether they give the correct logical response. In this paper, we examine conflict detection under conditions in which participants are asked to either judge the logical validity or believability of a presented conclusion, accompanied by measures of eye movement and pupil dilation. The findings show an effect of conflict, under both types of instruction, on accuracy, latency, gaze shifts, and pupil dilation. Importantly, these effects extend to conflict trials in which participants give a belief-based response (incorrectly under logic instructions or correctly under belief instructions) demonstrating both behavioral and physiological evidence in support of the logical intuition hypothesis. |
Zoe A. Purcell; Colin A. Wastell; Naomi Sweller Eye movements reveal that low confidence precedes deliberation Journal Article In: Quarterly Journal of Experimental Psychology, vol. 76, no. 7, pp. 1539 –1546, 2023. @article{Purcell2023a, Contemporary dual-process models of reasoning maintain that there are two types of thinking –intuitive and deliberative –and that low confidence often leads to deliberation. Previous studies examining the confidence -deliberation relationship have been limited by (1) issues of endogeneity and between-subject comparisons, which we address in this study through debias training and (2) measures of confidence that are taken relatively late in the reasoning process, which we address by measuring confidence via real-time eye-tracking. Self-reported and eye-tracked confidence were both negatively related to deliberative thinking. This finding provides new evidence of the timecourse of the confidence -deliberation relationship and reveals that lowered confidence precedes deliberation. |
Vesa Putkinen; Sanaz Nazari-Farsani; Tomi Karjalainen; Severi Santavirta; Matthew Hudson; Kerttu Seppälä; Lihua Sun; Henry K. Karlsson; Jussi Hirvonen; Lauri Nummenmaa Pattern recognition reveals sex-dependent neural substrates of sexual perception Journal Article In: Human Brain Mapping, vol. 44, no. 6, pp. 2543–2556, 2023. @article{Putkinen2023, Sex differences in brain activity evoked by sexual stimuli remain elusive despite robust evidence for stronger enjoyment of and interest toward sexual stimuli in men than in women. To test whether visual sexual stimuli evoke different brain activity patterns in men and women, we measured hemodynamic brain activity induced by visual sexual stimuli in two experiments with 91 subjects (46 males). In one experiment, the subjects viewed sexual and nonsexual film clips, and dynamic annotations for nudity in the clips were used to predict hemodynamic activity. In the second experiment, the subjects viewed sexual and nonsexual pictures in an event-related design. Men showed stronger activation than women in the visual and prefrontal cortices and dorsal attention network in both experiments. Furthermore, using multivariate pattern classification we could accurately predict the sex of the subject on the basis of the brain activity elicited by the sexual stimuli. The classification generalized across the experiments indicating that the sex differences were task-independent. Eye tracking data obtained from an independent sample of subjects (N = 110) showed that men looked longer than women at the chest area of the nude female actors in the film clips. These results indicate that visual sexual stimuli evoke discernible brain activity patterns in men and women which may reflect stronger attentional engagement with sexual stimuli in men. |
Philip T. Putnam; Cheng Chi J. Chu; Nicholas A. Fagan; Olga Dal Monte; Steve W. C. Chang Dissociation of vicarious and experienced rewards by coupling frequency within the same neural pathway Journal Article In: Neuron, vol. 111, no. 16, pp. 2513–2522, 2023. @article{Putnam2023, Vicarious reward, essential to social learning and decision making, is theorized to engage select brain regions similarly to experienced reward to generate a shared experience. However, it is just as important for neural systems to also differentiate vicarious from experienced rewards for social interaction. Here, we investigated the neuronal interaction between the primate anterior cingulate cortex gyrus (ACCg) and the basolateral amygdala (BLA) when social choices made by monkeys led to either vicarious or experienced reward. Coherence between ACCg spikes and BLA local field potential (LFP) selectively increased in gamma frequencies for vicarious reward, whereas it selectively increased in alpha/beta frequencies for experienced reward. These respectively enhanced couplings for vicarious and experienced rewards were uniquely observed following voluntary choices. Moreover, reward outcomes had consistently strong directional influences from ACCg to BLA. Our findings support a mechanism of vicarious reward where social agency is tagged by interareal coordination frequency within the same shared pathway. |
Linze Qian; Xianliang Ge; Zhao Feng; Sujie Wang; Jingjia Yuan; Yunxian Pan; Hongqi Shi; Jie Xu; Yu Sun Brain network reorganization during visual search task revealed by a network analysis of fixation-related potential Journal Article In: IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 31, pp. 1219–1229, 2023. @article{Qian2023, Visual search is ubiquitous in daily life and has attracted substantial research interest over the past decades. Although accumulating evidence has suggested complex neurocognitive processes underlying visual search, the neural communication across the brain regions remains poorly understood. The present work aimed to fill this gap by investigating functional networks of fixation-related potential (FRP) during the visual search task. Multi-frequency electroencephalogram (EEG) networks were constructed from 70 university students (male/female = 35/35) using FRPs time-locked to target and non-target fixation onsets, which were determined by concurrent eye-tracking data. Then graph theoretical analysis (GTA) and a data-driven classification framework were employed to quantitatively reveal the divergent reorganization between target and non-target FRPs. We found distinct network architectures between target and non-target mainly in the delta and theta bands. More importantly, we achieved a classification accuracy of 92.74% for target and non-target discrimination using both global and nodal network features. In line with the results of GTA, we found that the integration corresponding to target and non-target FRPs significantly differed, while the nodal features contributing most to classification performance primarily resided in the occipital and parietal-temporal areas. Interestingly, we revealed that females exhibited significantly higher local efficiency in delta band when focusing on the search task. In summary, these results provide some of the first quantitative insights into the underlying brain interaction patterns during the visual search process. |
Minglang Qiao; Yufan Liu; Mai Xu; Xin Deng; Bing Li; Weiming Hu; Ali Borji Joint learning of audio–visual saliency prediction and sound source localization on multi-face videos Journal Article In: International Journal of Computer Vision, pp. 1–23, 2023. @article{Qiao2023, Visual and audio events simultaneously occur and both attract attention. However, most existing saliency prediction works ignore the influence of audio and only consider vision modality. In this paper, we propose a multi-task learning method for audio–visual saliency prediction and sound source localization on multi-face video by leveraging visual, audio and face information. Specifically, we first introduce a large-scale database of multi-face video in visual-audio condition, containing eye-tracking data and sound source annotations. Using this database, we find that sound influences human attention, and conversely attention offers a cue to determine sound source on multi-face video. Guided by these findings, an audio–visual multi-task network (AVM-Net) is introduced to predict saliency and locate sound source. AVM-Net consists of three branches corresponding to visual, audio and face modalities. The visual branch has a two-stream architecture to capture spatial and temporal information. Face and audio branches encode audio signals and faces, respectively. Finally, a spatio-temporal multi- modal graph is constructed to model the interaction among multiple faces. With joint optimization of these branches, the intrinsic correlation of the tasks ofsaliency prediction and sound source localization is utilized and their performance is boosted by each other. Experiments show that the proposed method outperforms 12 state-of-the-art saliency prediction methods, and achieves competitive results in sound source localization. WABBLE |
Nan Qin; Francesca Crespi; Alice Mado Proverbio; Gilles Pourtois A systematic exploration of attentional load effects on the C1 ERP component Journal Article In: Psychophysiology, pp. 1–30, 2023. @article{Qin2023, The C1 ERP component reflects the earliest visual processing in V1. However, it remains debated whether attentional load can influence it or not. We conducted two EEG experiments to investigate the effect of attentional load on the C1. Task difficulty was manipulated at fixation using an oddball detection task that was either easy (low load) or difficult (high load), while the distractor was presented in the upper visual field (UVF) to score the C1. In Experiment 1, we used a block design and the stimulus onset asynchrony (SOA) between the central stimulus and the peripheral distractor was either short or long. In Experiment 2, task difficulty was manipulated on a trial-by-trial basis using a visual cue, and the peripheral distractor was presented either before or after the central stimulus. The results showed that the C1 was larger in the high compared to the low load condition irrespective of SOA in Experiment 1. In Experiment 2, no significant load modulation of the C1 was observed. However, we found that the contingent negative variation (CNV) was larger in the low compared to the high load condition. Moreover, the C1 was larger when the peripheral distractor was presented after than before the central stimulus. Combined together, these results suggest that different top-down control processes can influence the initial feedforward stage of visual processing in V1 captured by the C1 ERP component. |
Zeguo Qiu; Stefanie I. Becker; Hongfeng Xia; Zachary Hamblin-Frohman; Alan J. Pegna Fixation-related electrical potentials during a free visual search task reveal the timing of visual awareness Journal Article In: iScience, vol. 26, no. 7, pp. 1–17, 2023. @article{Qiu2023, It has been repeatedly claimed that emotional faces readily capture attention, and that they may be processed without awareness. Yet some observations cast doubt on these assertions. Part of the problem may lie in the experimental paradigms employed. Here, we used a free viewing visual search task during electroencephalographic recordings, where participants searched for either fearful or neutral facial expressions among distractor expressions. Fixation-related potentials were computed for fearful and neutral targets and the response compared for stimuli consciously reported or not. We showed that awareness was associated with an electrophysiological negativity starting at around 110 ms, while emotional expressions were distinguished on the N170 and early posterior negativity only when stimuli were consciously reported. These results suggest that during unconstrained visual search, the earliest electrical correlate of awareness may emerge as early as 110 ms, and fixating at an emotional face without reporting it may not produce any unconscious processing. |
Zeguo Qiu; Dihua Wu; Benjamin J. Muehlebach Differential modulation on neural activity related to flankers during face processing: A visual crowding study Journal Article In: Neuroscience Letters, vol. 815, no. September, pp. 137496, 2023. @article{Qiu2023a, In this visual crowding study, we manipulated the perceivability of a central crowded face (a fearful or a neutral face) by varying the similarity between the central face and the surrounding flanker stimuli. We presented participants with pairs of visual clutters and recorded their electroencephalography during an emotion judgement task. In an upright flanker condition where both the central target face and flanker faces were upright faces, participants were less likely to report seeing the target face, and their P300 was weakened, compared to a scrambled flanker condition where scrambled face images were used as flankers. Additionally, at ∼ 120 ms post-stimulus, a posterior negativity was found for the upright compared to scrambled flanker condition, however only for fearful face targets. We concluded that early neural responses seem to be affected by the perceptual characteristics of both target and flanker stimuli whereas later-stage neural activity is associated with post-perceptual evaluation of the stimuli in this visual crowding paradigm. |
Adam W. Qureshi; Rebecca L. Monk; Shelby Quinn; Bethan Gannon; Kayleigh McNally; Derek Heim Catching a smile from individuals and crowds: Evidence for distinct emotional contagion processes Journal Article In: Journal of Personality and Social Psychology, pp. 1–21, 2023. @article{Qureshi2023, Research examining how crowd emotions impact observers usually requires participants to engage in an atypical mental process whereby (static) arrays of individuals are cognitively integrated to represent a crowd. The present work sought to extend our understanding of how crowd emotions may spread to individuals by assessing self-reported emotions, attention and muscle movement in response to emotions of dynamic, virtually modeled crowd stimuli. Self-reported emotions and attention from thirty-six participants were assessed when foreground and background crowd characters exhibited homogeneous (Study 1) or heterogeneous (Study 2) positive, neutral, or negative emotions. Results suggested that affective responses in observers are shaped by crowd emotions even in the absence of direct attention. Thirty-four participants supplied self-report and facial electromyography responses to the same homogeneous (Study 3) or heterogeneous (Study 4) crowd stimuli. Results indicated that positive crowd emotions appeared to exert greater attentional pull and objective responses, while negative crowd emotions also elicited affective responses. Study 5 (n = 67) introduced a control condition (stimuli containing an individual person) to examine if responses are unique to crowds and found that emotional contagion from crowds was more intense than from individuals. These studies present methodological advances in the study of crowd emotional contagion and have implications for our broader understanding ofhow people process, attend, and affectively respond to crowds. Advancing theory by suggesting that emotional contagion from crowds is distinct from that elicited by individuals, findings may have applications for refining crowd management approaches. |
Aida Rahavi; Manuela Malaspina; Andrea Albonico; Jason J. S. Barton “Looking at nothing”: An implicit ocular motor index of face recognition in developmental prosopagnosia Journal Article In: Cognitive Neuropsychology, vol. 40, no. 2, pp. 59–70, 2023. @article{Rahavi2023, Subjects often look towards to previous location of a stimulus related to a task even when that stimulus is no longer visible. In this study we asked whether this effect would be preserved or reduced in subjects with developmental prosopagnosia. Participants learned faces presented in video-clips and then saw a brief montage of four faces, which was replaced by a screen with empty boxes, at which time they indicated whether the learned face had been present in the montage. Control subjects were more likely to look at the blank location where the learned face had appeared, on both hit and miss trials, though the effect was larger on hit trials. Prosopagnosic subjects showed a reduced effect, though still better on hit than on miss trials. We conclude that explicit accuracy and our implicit looking at nothing effect are parallel effects reflecting the strength of the neural activity underlying face recognition. |
Masih Rahmati; Clayton E. Curtis; Kartik K. Sreenivasan Mnemonic representations in human lateral geniculate nucleus Journal Article In: Frontiers in Behavioral Neuroscience, vol. 17, pp. 1–11, 2023. @article{Rahmati2023, There is a growing appreciation for the role of the thalamus in high-level cognition. Motivated by findings that internal cognitive state drives activity in feedback layers of primary visual cortex (V1) that target the lateral geniculate nucleus (LGN), we investigated the role of LGN in working memory (WM). Specifically, we leveraged model-based neuroimaging approaches to test the hypothesis that human LGN encodes information about spatial locations temporarily encoded in WM. First, we localized and derived a detailed topographic organization in LGN that accords well with previous findings in humans and non-human primates. Next, we used models constructed on the spatial preferences of LGN populations in order to reconstruct spatial locations stored in WM as subjects performed modified memory-guided saccade tasks. We found that population LGN activity faithfully encoded the spatial locations held in memory in all subjects. Importantly, our tasks and models allowed us to dissociate the locations of retinal stimulation and the motor metrics of memory-guided saccades from the maintained spatial locations, thus confirming that human LGN represents true WM information. These findings add LGN to the growing list of subcortical regions involved in WM, and suggest a key pathway by which memories may influence incoming processing at the earliest levels of the visual hierarchy. |
Rajani Raman; Anna Bognár; Ghazaleh Ghamkhari Nejad; Nick Taubert; Martin Giese; Rufin Vogels Bodies in motion: Unraveling the distinct roles of motion and shape in dynamic body responses in the temporal cortex Journal Article In: Cell Reports, vol. 42, no. 12, pp. 1–20, 2023. @article{Raman2023, The temporal cortex represents social stimuli, including bodies. We examine and compare the contributions of dynamic and static features to the single-unit responses to moving monkey bodies in and between a patch in the anterior dorsal bank of the superior temporal sulcus (dorsal patch [DP]) and patches in the anterior inferotemporal cortex (ventral patch [VP]), using fMRI guidance in macaques. The response to dynamics varies within both regions, being higher in DP. The dynamic body selectivity of VP neurons correlates with static features derived from convolutional neural networks and motion. DP neurons' dynamic body selectivity is not predicted by static features but is dominated by motion. Whereas these data support the dominance of motion in the newly proposed “dynamic social perception” stream, they challenge the traditional view that distinguishes DP and VP processing in terms of motion versus static features, underscoring the role of inferotemporal neurons in representing body dynamics. |
Isabel Raposo; Sara M. Szczepanski; Kathleen Haaland; Tor Endestad; Anne Kristin Solbakk; Robert T. Knight; Randolph F. Helfrich Periodic attention deficits after frontoparietal lesions provide causal evidence for rhythmic attentional sampling Journal Article In: Current Biology, vol. 33, no. 22, pp. 4893–4904, 2023. @article{Raposo2023, Contemporary models conceptualize spatial attention as a blinking spotlight that sequentially samples visual space. Hence, behavior fluctuates over time, even in states of presumed “sustained” attention. Recent evidence has suggested that rhythmic neural activity in the frontoparietal network constitutes the functional basis of rhythmic attentional sampling. However, causal evidence to support this notion remains absent. Using a lateralized spatial attention task, we addressed this issue in patients with focal lesions in the frontoparietal attention network. Our results revealed that frontoparietal lesions introduce periodic attention deficits, i.e., temporally specific behavioral deficits that are aligned with the underlying neural oscillations. Attention-guided perceptual sensitivity was on par with that of healthy controls during optimal phases but was attenuated during the less excitable sub-cycles. Theta-dependent sampling (3–8 Hz) was causally dependent on the prefrontal cortex, while high-alpha/low-beta sampling (8–14 Hz) emerged from parietal areas. Collectively, our findings reveal that lesion-induced high-amplitude, low-frequency brain activity is not epiphenomenal but has immediate behavioral consequences. More generally, these results provide causal evidence for the hypothesis that the functional architecture of attention is inherently rhythmic. |
Zoe Loh; Elizabeth H. Hall; Deborah Cronin; John M. Henderson Working memory control predicts fixation duration in scene-viewing Journal Article In: Psychological Research, vol. 87, no. 4, pp. 1143–1154, 2023. @article{Loh2023, When viewing scenes, observers differ in how long they linger at each fixation location and how far they move their eyes between fixations. What factors drive these differences in eye-movement behaviors? Previous work suggests individual differences in working memory capacity may influence fixation durations and saccade amplitudes. In the present study, participants (N = 98) performed two scene-viewing tasks, aesthetic judgment and memorization, while viewing 100 photographs of real-world scenes. Working memory capacity, working memory processing ability, and fluid intelligence were assessed with an operation span task, a memory updating task, and Raven's Advanced Progressive Matrices, respectively. Across participants, we found significant effects of task on both fixation durations and saccade amplitudes. At the level of each individual participant, we also found a significant relationship between memory updating task performance and participants' fixation duration distributions. However, we found no effect of fluid intelligence and no effect of working memory capacity on fixation duration or saccade amplitude distributions, inconsistent with previous findings. These results suggest that the ability to flexibly maintain and update working memory is strongly related to fixation duration behavior. |
Beatriz López; Nicola Jean Gregory; Megan Freeth Social attention patterns of autistic and non-autistic adults when viewing real versus reel people Journal Article In: Autism, vol. 27, no. 8, pp. 2372–2383, 2023. @article{Lopez2023, Research consistently shows that autistic adults do not attend to faces as much as non-autistic adults. However, this conclusion is largely based on studies using pre-recorded videos or photographs as stimuli. In studies using real social scenarios, the evidence is not as clear. To explore the extent to which differences in findings relate to differences in the methodologies used across studies, we directly compared social attention of 32 autistic and 33 non-autistic adults when watching exactly the same video. However, half of the participants in each group were told simply to watch the video (Video condition), and the other half were led to believe they were watching a live webcam feed (‘Live' condition). The results yielded no significant group differences in the ‘Live' condition. However, significant group differences were found in the ‘Video' condition. In this condition, non-autistic participants, but not autistic participants, showed a marked social bias towards faces. The findings highlight the importance of studying social attention combining different methods. Specifically, we argue that studies using pre-recorded footage and studies using real people tap into separate components contributing to social attention. One that is an innate, automatic component and one that is modulated by social norms. Lay Abstract: Early research shows that autistic adults do not attend to faces as much as non-autistic adults. However, some recent studies where autistic people are placed in scenarios with real people reveal that they attend to faces as much as non-autistic people. This study compares attention to faces in two situations. In one, autistic and non-autistic adults watched a pre-recorded video. In the other, they watched what they thought were two people in a room in the same building, via a life webcam, when in fact exactly the same video in two situations. We report the results of 32 autistic adults and 33 non-autistic adults. The results showed that autistic adults do not differ in any way from non-autistic adults when they watched what they believed was people interacting in real time. However, when they thought they were watching a video, non-autistic participants showed higher levels of attention to faces than non-autistic participants. We conclude that attention to social stimuli is the result of a combination of two processes. One innate, which seems to be different in autism, and one that is influenced by social norms, which works in the same way in autistic adults without learning disabilities. The results suggest that social attention is not as different in autism as first thought. Specifically, the study contributes to dispel long-standing deficit models regarding social attention in autism as it points to subtle differences in the use of social norms rather than impairments. |
Sara LoTemplio; Jack Silcox; Ryan Murdock; David L. Strayer; Brennan R. Payne In: Psychophysiology, vol. 60, no. 12, pp. 1–21, 2023. @article{LoTemplio2023, Both anxiety and working memory capacity appear to predict increased (more negative) error-related negativity (ERN) amplitudes, despite being inversely related to one another. Until the interactive effects of these variables on the ERN are clarified, there may be challenges posed to our ability to use the ERN as an endophenotype for anxiety, as some have suggested. The compensatory error monitoring hypothesis suggests that high trait-anxiety individuals have larger ERN amplitudes because they must employ extra, compensatory efforts to override the working memory demands of their anxiety. Yet, to our knowledge, no ERN study has employed direct manipulation of working memory demands in conjunction with direct manipulations of induced (state) anxiety. Furthermore, little is known about how these manipulations affect other measures of error processing, such as the error-related pupil dilation response and post-error behavioral adjustments. Therefore, we manipulate working memory load and anxiety in a 2 × 2 within-subjects design to examine the interactive effects of working memory load and anxiety on ERN amplitude, error-related pupil dilation response amplitude, and post-error behavior. There were no effects of our manipulations on ERN amplitude, suggesting a strong interpretation of compensatory error-processing theory. However, our worry manipulation affected post-error behavior, such that worry caused a reduction in post-error accuracy. Additionally, our working memory manipulation affected error-related PDR magnitude and the amplitude of the error-related positivity (Pe), such that increased working memory load decreased the amplitude of these responses. Implications of these results within the context of the compensatory error processing framework are discussed. |
Matthew W. Lowder; Antonio Cardoso; Michael Pittman; Adrian Zhou Effects of syntactic structure on the processing of lexical repetition during sentence reading Journal Article In: Memory & Cognition, vol. 51, no. 5, pp. 1249–1263, 2023. @article{Lowder2023a, Previous research has demonstrated that the ease or difficulty of processing complex semantic expressions depends on sentence structure: Processing difficulty emerges when the constituents that create the complex meaning appear in the same clause, whereas difficulty is reduced when the constituents appear in separate clauses. The goal of the current eye-tracking-while-reading experiments was to determine how changes to sentence structure affect the processing of lexical repetition, as this manipulation enabled us to isolate processes involved in word recognition (repetition priming) from those involved in sentence interpretation (felicity of the repetition). When repetition of the target word was felicitous (Experiment 1), we observed robust effects of repetition priming with some evidence that these effects were weaker when repetition occurred within a clause versus across a clause boundary. In contrast, when repetition of the target word was infelicitous (Experiment 2), readers experienced an immediate repetition cost when repetition occurred within a clause, but this cost was eliminated entirely when repetition occurred across clause boundaries. The results have implications for word recognition during reading, processes of semantic integration, and the role of sentence structure in guiding these linguistic representations. |