To see the other types of publications on this topic, follow the link: Tactile modality.
Journal articles on the topic 'Tactile modality'
Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles
Consult the top 50 journal articles for your research on the topic 'Tactile modality.'
Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.
You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.
Browse journal articles on a wide variety of disciplines and organise your bibliography correctly.
1
Zhang, Tao, Yang Cong, Gan Sun, Jiahua Dong, Yuyang Liu, and Zhengming Ding. "Generative Partial Visual-Tactile Fused Object Clustering." Proceedings of the AAAI Conference on Artificial Intelligence 35, no. 7 (May 18, 2021): 6156–64. http://dx.doi.org/10.1609/aaai.v35i7.16766.
Full textAbstract:
Visual-tactile fused sensing for object clustering has achieved significant progresses recently, since the involvement of tactile modality can effectively improve clustering performance. However, the missing data (i.e., partial data) issues always happen due to occlusion and noises during the data collecting process. This issue is not well solved by most existing partial multi-view clustering methods for the heterogeneous modality challenge. Naively employing these methods would inevitably induce a negative effect and further hurt the performance. To solve the mentioned challenges, we propose a Generative Partial Visual-Tactile Fused (i.e., GPVTF) framework for object clustering. More specifically, we first do partial visual and tactile features extraction from the partial visual and tactile data, respectively, and encode the extracted features in modality-specific feature subspaces. A conditional cross-modal clustering generative adversarial network is then developed to synthesize one modality conditioning on the other modality, which can compensate missing samples and align the visual and tactile modalities naturally by adversarial learning. To the end, two pseudo-label based KL-divergence losses are employed to update the corresponding modality-specific encoders. Extensive comparative experiments on three public visual-tactile datasets prove the effectiveness of our method.
2
Katus, Tobias, and Martin Eimer. "Independent Attention Mechanisms Control the Activation of Tactile and Visual Working Memory Representations." Journal of Cognitive Neuroscience 30, no. 5 (May 2018): 644–55. http://dx.doi.org/10.1162/jocn_a_01239.
Full textAbstract:
Working memory (WM) is limited in capacity, but it is controversial whether these capacity limitations are domain-general or are generated independently within separate modality-specific memory systems. These alternative accounts were tested in bimodal visual/tactile WM tasks. In Experiment 1, participants memorized the locations of simultaneously presented task-relevant visual and tactile stimuli. Visual and tactile WM load was manipulated independently (one, two, or three items per modality), and one modality was unpredictably tested after each trial. To track the activation of visual and tactile WM representations during the retention interval, the visual contralateral delay activity (CDA) and tactile CDA (tCDA) were measured over visual and somatosensory cortex, respectively. CDA and tCDA amplitudes were selectively affected by WM load in the corresponding (tactile or visual) modality. The CDA parametrically increased when visual load increased from one to two and to three items. The tCDA was enhanced when tactile load increased from one to two items and showed no further enhancement for three tactile items. Critically, these load effects were strictly modality-specific, as substantiated by Bayesian statistics. Increasing tactile load did not affect the visual CDA, and increasing visual load did not modulate the tCDA. Task performance at memory test was also unaffected by WM load in the other (untested) modality. This was confirmed in a second behavioral experiment where tactile and visual loads were either two or four items, unimodal baseline conditions were included, and participants performed a color change detection task in the visual modality. These results show that WM capacity is not limited by a domain-general mechanism that operates across sensory modalities. They suggest instead that WM storage is mediated by distributed modality-specific control mechanisms that are activated independently and in parallel during multisensory WM.
3
Daniel, Sharon, Thomas Andrillon, Naotsugu Tsuchiya, and Jeroen J. A. van Boxtel. "Divided attention in the tactile modality." Attention, Perception, & Psychophysics 84, no. 1 (October 19, 2021): 47–63. http://dx.doi.org/10.3758/s13414-021-02352-8.
Full text
4
White, Rebekah C., and Anne M. Aimola Davies. "Anti-Extinction in the Tactile Modality." Perception 42, no. 6 (January 2013): 669–71. http://dx.doi.org/10.1068/p7477.
Full text
5
O’Leary, Colleen A., and Karen M. Bush. "Stimulus Equivalence in the Tactile Modality." Psychological Record 46, no. 3 (July 1996): 509–17. http://dx.doi.org/10.1007/bf03395180.
Full text
6
Katus, Tobias, and Martin Eimer. "Shifts of Spatial Attention in Visual and Tactile Working Memory are Controlled by Independent Modality-Specific Mechanisms." Cerebral Cortex 30, no. 1 (May 9, 2019): 296–310. http://dx.doi.org/10.1093/cercor/bhz088.
Full textAbstract:
Abstract The question whether the attentional control of working memory (WM) is shared across sensory modalities remains controversial. Here, we investigated whether attention shifts in visual and tactile WM are regulated independently. Participants memorized visual and tactile targets in a first memory sample set (S1) before encoding targets in a second sample set (S2). Importantly, visual or tactile S2 targets could appear on the same side as the corresponding S1 targets, or on opposite sides, thus, requiring shifts of spatial attention in visual or tactile WM. The activation of WM representations in modality-specific visual and somatosensory areas was tracked by recording visual and tactile contralateral delay activity (CDA/tCDA). CDA/tCDA components emerged contralateral to the side of visual or tactile S1 targets, and reversed polarity when S2 targets in the same modality appeared on the opposite side. Critically, the visual CDA was unaffected by the presence versus absence of concurrent attention shifts in tactile WM, and the tactile CDA remained insensitive to visual attention shifts. Visual and tactile WM performance was also not modulated by attention shifts in the other modality. These results show that the dynamic control of visual and tactile WM activation processes operates in an independent modality-specific fashion.
7
Hillis, Argye E., Shannon Chang, Jennifer Heidler-Gary, Melissa Newhart, Jonathan T. Kleinman, Cameron Davis, Peter B. Barker, Eric Aldrich, and Lynda Ken. "Neural Correlates of Modality-specific Spatial Extinction." Journal of Cognitive Neuroscience 18, no. 11 (November 2006): 1889–98. http://dx.doi.org/10.1162/jocn.2006.18.11.1889.
Full textAbstract:
Sites of lesions responsible for visual, tactile, and/or motor extinction have not been clearly identified. We sought to determine the frequency of extinction in various modalities immediately after acute ischemic stroke, the rate of co-occurrence of extinction across modalities, and areas of infarct and/or hypoperfusion associated with each modality of extinction. A total of 148 patients with right supratentorial stroke were studied. In Study 1, 88 patients without hemiplegia, hemianesthesia, or visual field cuts were tested within 24 hours of onset for visual, tactile, and motor extinction, and underwent magnetic resonance diffusion and perfusion imaging. Associations between modality of extinction and areas of neural dysfunction (hypoperfusion/infarct) were identified. Of the 88 patients, 19 had only tactile extinction, 8 had only visual extinction, 12 had only motor extinction, 14 had extinction in two or more modalities, and 35 had no extinction. Tactile extinction was associated with neural dysfunction in the inferior parietal lobule; visual extinction was associated with dysfunction in the visual association cortex; and motor extinction was associated with neural dysfunction in the superior temporal gyrus. In Study 2, data from 60 patients who were excluded from Study 1 because of motor deficits were analyzed in the same way to determine whether frontal lesions contributed to visual or tactile extinction. Results again demonstrated that tactile extinction is associated with inferior parietal dysfunction, and visual extinction is associated with dysfunction of the visual association cortex. Potential accounts of the results, based on the “hemisphere rivalry” model of extinction and the limited attentional capacity model, are considered.
8
Nadine Stephan, Denise, and Iring Koch. "Tactile Stimuli Increase Effects of Modality Compatibility in Task Switching." Experimental Psychology 62, no. 4 (September 2015): 276–84. http://dx.doi.org/10.1027/1618-3169/a000291.
Full textAbstract:
Abstract. Modality compatibility refers to the similarity of stimulus modality and modality of response-related sensory consequences. Previous dual-task studies found increased switch costs for modality incompatible tasks (auditory-manual/visual-vocal) compared to modality compatible tasks (auditory-vocal/visual-manual). The present task-switching study further examined modality compatibility and investigated vibrotactile stimulation as a novel alternative to visual stimulation. Interestingly, a stronger modality compatibility effect on switch costs was revealed for the group with tactile-auditory stimulation compared to the visual-auditory stimulation group. We suggest that the modality compatibility effect is based on crosstalk of central processing codes due to ideomotor “backward” linkages between the anticipated response effects and the stimuli indicating this response. This crosstalk is increased in the tactile-auditory stimulus group compared to the visual-auditory stimulus group due to a higher degree of ideomotor-compatibility in the tactile-manual tasks. Since crosstalk arises between tasks, performance is only affected in task switching and not in single tasks.
9
Zika, Fay. "Tactile Relief: Reconsidering Medium and Modality Specificity." British Journal of Aesthetics 45, no. 4 (October 1, 2005): 426–37. http://dx.doi.org/10.1093/aesthj/ayi052.
Full text
10
Chen, Lihan, and Xiaolin Zhou. "Capture of Intermodal Visual/Tactile Apparent Motion by Moving and Static Sound." Seeing and Perceiving 24, no. 4 (2011): 369–89. http://dx.doi.org/10.1163/187847511x584434.
Full textAbstract:
AbstractApparent motion can occur within a particular modality or between modalities, in which a visual or tactile stimulus at one location is perceived as moving towards the location of the subsequent tactile or visual stimulus. Intramodal apparent motion has been shown to be affected or 'captured' by information from another, task-irrelevant modality, as in spatial or temporal ventriloquism. Here we investigate whether and how intermodal apparent motion is affected by motion direction cues or temporal interval information from a third modality. We demonstrated that both moving and asynchronous static sounds can capture intermodal (visual–tactile and tactile–visual) apparent motion; moreover, while the auditory direction cues have less impact upon the perception of intramodal visual apparent motion than upon the perception of intramodal tactile or intermodal visual/tactile apparent motion, the auditory temporal information has equivalent impacts upon both intramodal and intermodal apparent motion. These findings suggest intermodal apparent motion is susceptible to the influence of dynamic or static auditory information in similar ways as intramodal visual or tactile apparent motion.
11
Heled, Eyal, and Ohad Levi. "Aging’s Effect on Working Memory—Modality Comparison." Biomedicines 12, no. 4 (April 10, 2024): 835. http://dx.doi.org/10.3390/biomedicines12040835.
Full textAbstract:
Research exploring the impact of development and aging on working memory (WM) has primarily concentrated on visual and verbal domains, with limited attention paid to the tactile modality. The current study sought to evaluate WM encompassing storage and manipulation across these three modalities, spanning from childhood to old age. The study included 134 participants, divided into four age groups: 7–8, 11–12, 25–35, and 60–69. Each participant completed the Visuospatial Span, Digit Span, and Tactual Span, with forward and backward recall. The findings demonstrated a consistent trend in both forward and backward stages. Performance improved until young adulthood, progressively diminishing with advancing age. In the forward stage, the Tactual Span performance was worse than that of the Digit and Visuospatial Span for all participants. In the backward stage, the Visuospatial Span outperformed the Digit and Tactual Span across all age groups. Furthermore, the Tactual Span backward recall exhibited significantly poorer performance than the other modalities, primarily in the youngest and oldest age groups. In conclusion, age impacts WM differently across modalities, with tactile storage capacity being the most vulnerable. Additionally, tactile manipulation skills develop later in childhood but deteriorate sooner in adulthood, indicating a distinct component within tactile WM.
12
Krausman, Andrea S., and Timothy L. White. "Using the Tactile Modality as a Communication Medium for Dismounted Soldiers." Proceedings of the Human Factors and Ergonomics Society Annual Meeting 51, no. 18 (October 2007): 1158–62. http://dx.doi.org/10.1177/154193120705101822.
Full textAbstract:
This study examined the issues related to the detection and identification of tactile patterns as combat assault maneuvers were being performed. Three obstacles were used in this study: tires, windows, and high crawl. A baseline condition, in which participants received tactile patterns while standing, was also included in the analysis. In the baseline condition, participants detected and identified 100% of the tactile patterns. Analysis of the obstacle data showed that the obstacles had a significant effect on the detection and identification of the tactile signals. Participants detected 62.5% of the tactile patterns during the high crawl, which was significantly lower than for the tires and windows, with 92% and 88% of signals detected, respectively. With regard to the correct identification of tactile patterns, participants correctly identified 51% of the patterns during the high crawl, as compared to 88.5% for the tires and 77% for the windows.
13
Sambo, Chiara F., and Bettina Forster. "Sustained Spatial Attention in Touch: Modality-Specific and Multimodal Mechanisms." Scientific World JOURNAL 11 (2011): 199–213. http://dx.doi.org/10.1100/tsw.2011.34.
Full textAbstract:
Sustained attention to a body location results in enhanced processing of tactile stimuli presented at that location compared to another unattended location. In this paper, we review studies investigating the neural correlates of sustained spatial attention in touch. These studies consistently show that activity within modality-specific somatosensory areas (SI and SII) is modulated by sustained tactile-spatial attention. Recent evidence suggests that these somatosensory areas may be recruited as part of a larger cortical network,also including higher-level multimodal regions involved in spatial selection across modalities. We discuss, in turn, the following multimodal effects in sustained tactile-spatial attention tasks. First, cross-modal attentional links between touch and vision, reflected in enhanced processing of task-irrelevant visual stimuli at tactuallyattended locations, are mediated by common (multimodal) representations of external space. Second, vision of the body modulates activity underlying sustained tactile-spatial attention, facilitating attentional modulation of tactile processing in between-hand (when hands are sufficiently far apart) and impairing attentional modulation in within-hand selection tasks. Finally, body posture influences mechanisms of sustained tactile-spatial attention, relying, at least partly, on remapping of tactile stimuli in external, visuallydefined, spatial coordinates. Taken together, the findings reviewed in this paper indicate that sustained spatial attention in touch is subserved by both modality-specific and multimodal mechanisms. The interplay between these mechanisms allows flexible and efficient spatial selection within and across sensory modalities.
14
Habets, Boukje, Marlene Hense, Davide Bottari, and Brigitte Roeder. "Intra- and crossmodal refractory effects in auditory and somatosensory ERPs." Seeing and Perceiving 25 (2012): 156. http://dx.doi.org/10.1163/187847612x647874.
Full textAbstract:
Refractory period effects are defined as a temporal decrement in neural response due to a previous activation of the same system. We varied the ISI and modality of a preceding stimulus to investigate overlapping and distinct neural systems processing auditory and tactile stimuli. Auditory stimuli and tactile stimuli were presented in a sequential, random manner with a duration of 50 ms and an ISI of 1000 or 2000 ms. The P1–N1–P2 complex of event-related potentials (ERP) was analyzed separately for auditory and tactile stimuli, as a function of preceding ISI and modality. Main effects of ISI and modality were found within the time-window of the P1 and P2 (auditory) and P1, N1 and P2 (tactile). These results suggest an overlap in underlying neural systems when stimuli from different modalities are being processed.
15
Merz, Simon, Julia Deller, Hauke S. Meyerhoff, Charles Spence, and Christian Frings. "The contradictory influence of velocity: representational momentum in the tactile modality." Journal of Neurophysiology 121, no. 6 (June 1, 2019): 2358–63. http://dx.doi.org/10.1152/jn.00128.2019.
Full textAbstract:
Representational momentum (RM) is the term used to describe a systematic mislocalization of dynamic stimuli, a forward shift; that is, an overestimation of the location of a stimulus along its anticipated trajectory. In the present study, we investigate the effect of velocity on tactile RM, because two distinct and contrasting predictions can be made, based on different theoretical accounts. According to classical accounts of RM, based on numerous visual and auditory RM studies, an increase of the forward shift with increasing target velocity is predicted. In contrast, theoretical accounts explaining spatiotemporal tactile illusions such as the tau or cutaneous rabbit effect predict a decrease of the forward shift with increasing target velocity. In three experiments reported here, a tactile experimental setup modeled on existing RM setups was implemented. Participants indicated the last location of a sequence of three tactile stimuli, which either did or did not imply motion in a consistent direction toward the elbow/wrist. Velocity was manipulated by changing the interstimulus interval as well as the duration of the stimuli. The results reveal that increasing target velocity led to a decrease and even a reversal of the forward shift, resulting in a backward shift. This result is consistent with predictions based on the evidence from tactile spatiotemporal illusions. The theoretical implications of these results for RM are discussed. NEW & NOTEWORTHY This study tests two distinct predictions concerning the influence of velocity on the localization of dynamic tactile stimuli. We demonstrate for tactile stimuli that with increasing velocity, a misperception in the direction of anticipated motion (termed “representational momentum”) turns into a misperception against the direction of motion. This result is in line with predictions based on tactile spatiotemporal illusions but challenges classical theoretical accounts of representational momentum based on evidence from vision and audition.
16
Villanueva, Lia, and Massimiliano Zampini. "Reciprocal Interference Between Audition and Touch in the Perception of Duration." Multisensory Research 31, no. 5 (2018): 351–71. http://dx.doi.org/10.1163/22134808-00002583.
Full textAbstract:
Audition and touch interact with one another and share a number of similarities; however, little is known about their interplay in the perception of temporal duration. The present study intended to investigate whether the temporal duration of an irrelevant auditory or tactile stimulus could modulate the perceived duration of a target stimulus presented in the other modality (i.e., tactile or auditory) adopting both a between-participants (Experiment 1) and a within-participants (Experiment 2) experimental design. In a two-alternative forced-choice task, participants decided which of two events in a target modality was longer. The simultaneously distractor stimuli were presented with a duration that was either congruent or incongruent to the target’s. Results showed that both the auditory and tactile modalities affected duration judgments in the incongruent condition, decreasing performance in both experiments. Moreover, in Experiment 1, the tactile modality enhanced the perception of auditory stimuli in the congruent condition, but audition did not facilitate performance for the congruent condition in the tactile modality; this tactile enhancement of audition was not found in Experiment 2. To the best of our knowledge, this is the first study documenting audiotactile interactions in the perception of duration, and suggests that audition and touch might modulate one another in a more balanced manner, in contrast to audiovisual pairings. The findings support previous evidence as to the shared links and reciprocal influences when audition and touch interact with one another.
17
Myles, Kimberly, and Joel T. Kalb. "Head Tactile Communication." Ergonomics in Design: The Quarterly of Human Factors Applications 21, no. 2 (April 2013): 4–8. http://dx.doi.org/10.1177/1064804613477861.
Full textAbstract:
Although tactile applications have been explored heavily in the past decade, use on the head is rare. Army researchers are exploring the possibility of using a head-mounted tactile display to augment visual displays currently used for navigation. Such a tactile display has the potential to decrease the amount of information the user would otherwise process visually by off-loading the navigation task from the visual to the tactile modality while providing soldiers with a covert method of receiving directional information regarding a navigation or sniper detection task.
18
Hamann, Stephan B. "Implicit Memory in the Tactile Modality: Evidence From Braille Stem Completion in the Blind." Psychological Science 7, no. 5 (September 1996): 284–88. http://dx.doi.org/10.1111/j.1467-9280.1996.tb00375.x.
Full textAbstract:
Research on perceptual priming has previously focused exclusively on priming in the visual and auditory modalities The present study explored whether perceptual priming also extends to the tactile modality Tactile priming for Braille words was examined in a group of blind participants, using a Braille analogue of the stem-completion task The results for tactile priming paralleled previous stem-completion results in other modalities Manipulating the encoding task at study (semantic vs nonsemantic) dissociated implicit and explicit Braille stem-completion performance, and priming was unaffected by the number of study presentations (one vs three) Finally, Braille stem-completion priming was found in a cross-modal paradigm to have both a specifically tactile component and a cross-modal component These results demonstrate for the first time that verbal priming can occur in the tactile domain and that tactile priming has basic functional similarities with stem-completion priming in the visual and auditory domains
19
Hurth, A. "Spatial Acuity of the Nociceptive System and Spatial Summation of Pain: Potential Implications for the Clinic." Douleur et Analgésie 34, no. 4 (October 4, 2021): 260–63. http://dx.doi.org/10.3166/dea-2021-0170.
Full textAbstract:
Previous studies investigating spatial acuity measured by two-point discrimination threshold concluded that the nociceptive system is less accurate than the innocuous tactile system. In the discussed article, the authors point out that the nociceptive system is more accurate than the tactile system when controlling for the stimulus modality and intensity in healthy pain-free individuals. Furthermore, this article shows that the pattern of distance-based and areabased spatial summation of pain is modality independent.
20
Yau, Jeffrey M., Pablo Celnik, Steven S. Hsiao, and John E. Desmond. "Dissociable crossmodal recruitment of visual and auditory cortex for tactile perception." Seeing and Perceiving 25 (2012): 7. http://dx.doi.org/10.1163/187847612x646307.
Full textAbstract:
Primary sensory areas previously thought to be devoted to a single modality can exhibit multisensory responses. Some have interpreted these responses as evidence for crossmodal recruitment (i.e., primary sensory processing for inputs in a non-primary modality); however, the direct contribution of this activity to perception is unclear. We tested the specific contributions of visual and auditory cortex to tactile perception in healthy adult volunteers using anodal transcranial direct current stimulation (tDCS). This form of non-invasive neuromodulation can enhance neural excitability and facilitate learning. In a series of psychophysical experiments we characterized participants’ ability to discriminate grating orientation or vibration frequency. We measured perceptual sensitivity before, during, and after tDCS application over either visual cortex or auditory cortex. Each participant received both anodal and sham interventions on separate sessions in counterbalanced order. We found that anodal stimulation over visual cortex selectively improved tactile spatial acuity, but not frequency sensitivity. Conversely, anodal stimulation over auditory cortex selectively improved tactile frequency sensitivity, but not spatial acuity. Furthermore, we found that improvements in tactile perception persisted after cessation of tDCS. These results reveal a clear double-dissociation in the crossmodal contributions of visual and auditory cortex to tactile perception, and support a supramodal brain organization scheme in which visual and auditory cortex comprise distributed networks that support shape and frequency perception, independent of sensory input modality.
21
Hasuo, Emi, Tsuyoshi Kuroda, and Simon Grondin. "About the time-shrinking illusion in the tactile modality." Acta Psychologica 147 (March 2014): 122–26. http://dx.doi.org/10.1016/j.actpsy.2013.06.007.
Full text
22
Hoggan, Eve. "Crossmodal Audio and Tactile Interaction with Mobile Touchscreens." International Journal of Mobile Human Computer Interaction 2, no. 4 (October 2010): 29–44. http://dx.doi.org/10.4018/jmhci.2010100102.
Full textAbstract:
This article asserts that using crossmodal auditory and tactile interaction can aid mobile touchscreen users in accessing data non-visually and, by providing a choice of modalities, can help to overcome problems that occur in different mobile situations where one modality may be less suitable than another (Hoggan, 2010). By encoding data using the crossmodal parameters of audio and vibration, users can learn mappings and translate information between both modalities. In this regard, data may be presented to the most appropriate modality given the situation and surrounding environment.
23
Wahn, Basil, Basil Wahn, and Peter König. "Vision and Haptics Share Spatial Attentional Resources and Visuotactile Integration Is Not Affected by High Attentional Load." Multisensory Research 28, no. 3-4 (2015): 371–92. http://dx.doi.org/10.1163/22134808-00002482.
Full textAbstract:
Human information processing is limited by attentional resources. Two questions that are discussed in multisensory research are (1) whether there are separate spatial attentional resources for each sensory modality and (2) whether multisensory integration is influenced by attentional load. We investigated these questions using a dual task paradigm: Participants performed two spatial tasks (a multiple object tracking [‘MOT’] task and a localization [‘LOC’] task) either separately (single task condition) or simultaneously (dual task condition). In the MOT task, participants visually tracked a small subset of several randomly moving objects. In the LOC task, participants either received visual, tactile, or redundant visual and tactile location cues. In the dual task condition, we found a substantial decrease in participants’ performance and an increase in participants’ mental effort (indicated by an increase in pupil size) relative to the single task condition. Importantly, participants performed equally well in the dual task condition regardless of whether they received visual, tactile, or redundant multisensory (visual and tactile) location cues in the LOC task. This result suggests that having spatial information coming from different modalities does not facilitate performance, thereby indicating shared spatial attentional resources for the tactile and visual modality. Also, we found that participants integrated redundant multisensory information optimally even when they experienced additional attentional load in the dual task condition. Overall, findings suggest that (1) spatial attentional resources for the tactile and visual modality overlap and that (2) the integration of spatial cues from these two modalities occurs at an early pre-attentive processing stage.
24
Katus, Tobias, Anna Grubert, and Martin Eimer. "Intermodal Attention Shifts in Multimodal Working Memory." Journal of Cognitive Neuroscience 29, no. 4 (April 2017): 628–36. http://dx.doi.org/10.1162/jocn_a_01072.
Full textAbstract:
Attention maintains task-relevant information in working memory (WM) in an active state. We investigated whether the attention-based maintenance of stimulus representations that were encoded through different modalities is flexibly controlled by top–down mechanisms that depend on behavioral goals. Distinct components of the ERP reflect the maintenance of tactile and visual information in WM. We concurrently measured tactile (tCDA) and visual contralateral delay activity (CDA) to track the attentional activation of tactile and visual information during multimodal WM. Participants simultaneously received tactile and visual sample stimuli on the left and right sides and memorized all stimuli on one task-relevant side. After 500 msec, an auditory retrocue indicated whether the sample set's tactile or visual content had to be compared with a subsequent test stimulus set. tCDA and CDA components that emerged simultaneously during the encoding phase were consistently reduced after retrocues that marked the corresponding (tactile or visual) modality as task-irrelevant. The absolute size of cue-dependent modulations was similar for the tCDA/CDA components and did not depend on the number of tactile/visual stimuli that were initially encoded into WM. Our results suggest that modality-specific maintenance processes in sensory brain regions are flexibly modulated by top–down influences that optimize multimodal WM representations for behavioral goals.
25
Katus, Tobias, and Martin Eimer. "Retrospective Selection in Visual and Tactile Working Memory Is Mediated by Shared Control Mechanisms." Journal of Cognitive Neuroscience 32, no. 3 (March 2020): 546–57. http://dx.doi.org/10.1162/jocn_a_01492.
Full textAbstract:
Selective attention regulates the activation of working memory (WM) representations. Retro-cues, presented after memory sample stimuli have been stored, modulate these activation states by triggering shifts of attention to task-relevant samples. Here, we investigated whether the control of such attention shifts is modality-specific or shared across sensory modalities. Participants memorized bilateral tactile and visual sample stimuli before an auditory retro-cue indicated which visual and tactile stimuli had to be retained. Critically, these cued samples were located on the same side or opposite sides, thus requiring spatially congruent or incongruent attention shifts in tactile and visual WM. To track the attentional selection of retro-cued samples, tactile and visual contralateral delay activities (tCDA and CDA components) were measured. Clear evidence for spatial synergy effects from attention shifts in visual WM on concurrent shifts in tactile WM were observed: Tactile WM performance was impaired, and tCDA components triggered by retro-cues were strongly attenuated on opposite-sides relative to same-side trials. These spatial congruency effects were eliminated when cued attention shifts in tactile WM occurred in the absence of simultaneous shifts within visual WM. Results show that, in contrast to other modality-specific aspects of WM control, concurrent attentional selection processes within tactile and visual WM are mediated by shared supramodal control processes.
26
Kalia, Amy, Rose Hopkins, David Jin, Lindsay Yazzolino, Svena Verma, Lotfi Merabet, Flip Phillips, and Pawan Sinha. "Perception of Tactile Graphics: Embossings Versus Cutouts." Multisensory Research 27, no. 2 (2014): 111–25. http://dx.doi.org/10.1163/22134808-00002450.
Full textAbstract:
Graphical information, such as illustrations, graphs, and diagrams, are an essential complement to text for conveying knowledge about the world. Although graphics can be communicated well via the visual modality, conveying this information via touch has proven to be challenging. The lack of easily comprehensible tactile graphics poses a problem for the blind. In this paper, we advance a hypothesis for the limited effectiveness of tactile graphics. The hypothesis contends that conventional graphics that rely upon embossings on two-dimensional surfaces do not allow the deployment of tactile exploratory procedures that are crucial for assessing global shape. Besides potentially accounting for some of the shortcomings of current approaches, this hypothesis also serves a prescriptive purpose by suggesting a different strategy for conveying graphical information via touch, one based on cutouts. We describe experiments demonstrating the greater effectiveness of this approach for conveying shape and identity information. These results hold the potential for creating more comprehensible tactile drawings for the visually impaired while also providing insights into shape estimation processes in the tactile modality.
27
Zhang, Tao, Yang Cong, Gan Sun, Qianqian Wang, and Zhenming Ding. "Visual Tactile Fusion Object Clustering." Proceedings of the AAAI Conference on Artificial Intelligence 34, no. 06 (April 3, 2020): 10426–33. http://dx.doi.org/10.1609/aaai.v34i06.6612.
Full textAbstract:
Object clustering, aiming at grouping similar objects into one cluster with an unsupervised strategy, has been extensively-studied among various data-driven applications. However, most existing state-of-the-art object clustering methods (e.g., single-view or multi-view clustering methods) only explore visual information, while ignoring one of most important sensing modalities, i.e., tactile information which can help capture different object properties and further boost the performance of object clustering task. To effectively benefit both visual and tactile modalities for object clustering, in this paper, we propose a deep Auto-Encoder-like Non-negative Matrix Factorization framework for visual-tactile fusion clustering. Specifically, deep matrix factorization constrained by an under-complete Auto-Encoder-like architecture is employed to jointly learn hierarchical expression of visual-tactile fusion data, and preserve the local structure of data generating distribution of visual and tactile modalities. Meanwhile, a graph regularizer is introduced to capture the intrinsic relations of data samples within each modality. Furthermore, we propose a modality-level consensus regularizer to effectively align the visual and tactile data in a common subspace in which the gap between visual and tactile data is mitigated. For the model optimization, we present an efficient alternating minimization strategy to solve our proposed model. Finally, we conduct extensive experiments on public datasets to verify the effectiveness of our framework.
28
Lange, Kathrin, and Brigitte Röder. "Orienting Attention to Points in Time Improves Stimulus Processing Both within and across Modalities." Journal of Cognitive Neuroscience 18, no. 5 (May 1, 2006): 715–29. http://dx.doi.org/10.1162/jocn.2006.18.5.715.
Full textAbstract:
Spatial attention affects the processing of stimuli of both a task-relevant and a task-irrelevant modality. The present study investigated if similar cross-modal effects exist when attention is oriented to a point in time. Short (600 msec) and long (1200 msec) empty intervals, marked by a tactile onset and an auditory or a tactile offset marker, were presented. In each block, the participants had to attend one interval and one modality. Event-related potentials (ERPs) to auditory and tactile offset markers of attended as compared to unattended intervals were characterized by an enhancement of early negative deflections of the auditory and somatosensory ERPs (audition, 100–140 msec; touch, 130–180 msec) when audition or touch was task relevant, respectively. Similar effects were found for auditory stimuli when touch was task relevant. An additional reaction time experiment revealed faster responses to both auditory and tactile stimuli at the attended as compared to the unattended point in time, irrespective of which modality was primary. Both behavioral and ERP data show that attention can be focused on a point in time, which results in a more efficient processing of auditory and tactile stimuli. The ERP data further suggest that a relative enhancement at perceptual processing stages contributes to the processing advantage for temporally attended stimuli. The existence of cross-modal effects of temporal attention underlines the importance of time as a feature for binding input across different modalities.
29
Güçlü, Burak, Emre Sevinc, and Resit Canbeyli. "Duration Discrimination by Musicians and Nonmusicians." Psychological Reports 108, no. 3 (June 2011): 675–87. http://dx.doi.org/10.2466/11.22.27.pr0.108.3.675-687.
Full textAbstract:
This study investigated the effects of stimulus modality, standard duration, sex, and laterality in duration discrimination by musicians and nonmusicians. Seventeen musicians ( M age = 24.1 yr.) and 22 nonmusicians ( M age = 26.8 yr.) participated. Auditory (1,000 Hz) and tactile (250 Hz) sinusoidal suprathreshold stimuli with varying durations were used. The standard durations tested were 0.5 and 3.0 sec. Participants discriminated comparison stimuli which had durations slightly longer and shorter than the standard durations. Difference limens were found by the method of limits and converted to Weber fractions based on the standard durations. Musicians had lower, i.e., better, Weber fractions than nonmusicians in the auditory modality, but there was no significant difference between musicians and nonmusicians in the tactile modality. Auditory discrimination was better than tactile discrimination. Discrimination improved when the standard duration was increased both for musicians and nonmusicians. These results support previous findings of superior auditory processing by musicians. Significant differences between discrimination in the millisecond and second ranges may be due to a deviation from Weber's law and the discontinuity of timing in different duration ranges reported in the literature.
30
Barbieri, Cristina, and Ennio De Renzi. "Patterns of Neglect Dissociation." Behavioural Neurology 2, no. 1 (1989): 13–24. http://dx.doi.org/10.1155/1989/728487.
Full textAbstract:
Extinction in the visual, tactile and auditory modality, and visual, tactile and motor neglect were investigated in 40 right brain-damaged (RBD) and 50 left brain-damaged (LBD) patients. The presence of neglect was assessed with reference to the performance of 50 control patients. Visual neglect was only found in RBD patients and its severity could vary from one test to another. Tactile neglect was much rarer and it occurred with lesions in either hemisphere. Five cases of motor neglect were found in patients with right parietal damage. Both extinction and neglect could be present either confined to I modality or involving 2 or more. The assumption that extinction always represents an attenuated form of neglect was challenged by the finding of 1 patient with visual neglect but no visual extinction and of3 patients with extinction in all modalities and no sign of neglect. Exploration of contralateral space would appear to be a process monitored by mechanisms decentralized at the level of the single modality rather than by a supramodal supervisor.
31
Mahar, Doug, Brian Mackenzie, and Don McNicol. "Modality-Specific Differences in the Processing of Spatially, Temporally, and Spatiotemporally Distributed Information." Perception 23, no. 11 (November 1994): 1369–86. http://dx.doi.org/10.1068/p231369.
Full textAbstract:
The extent to which auditory, tactile, and visual perceptual representations are similar, particularly when dealing with speech and speech-like stimuli, was investigated. It was found that comparisons between auditory and tactile patterns were easier to perform than were similar comparisons between auditory and visual stimuli. This was true across a variety of styles of tactile and visual display, and was not due to limitations in the discriminability of the visual displays. The findings suggest that auditory and tactile representations of stimuli are more alike than are auditory and visual ones. It was also found that touch and vision differ in terms of the style of information distribution which they process most efficiently. Touch dealt with patterns best when the pattern was characterised by changes across time, whereas vision did best when spatially or spatiotemporally distributed patterns were presented. As the sense of hearing also seems to specialise in the processing of temporally ordered patterns, these results suggest one way in which the senses of hearing and touch differ from vision.
32
Bolognini, Nadia, Costanza Papagno, Daniela Moroni, and Angelo Maravita. "Tactile Temporal Processing in the Auditory Cortex." Journal of Cognitive Neuroscience 22, no. 6 (June 2010): 1201–11. http://dx.doi.org/10.1162/jocn.2009.21267.
Full textAbstract:
Perception of the outside world results from integration of information simultaneously derived via multiple senses. Increasing evidence suggests that the neural underpinnings of multisensory integration extend into the early stages of sensory processing. In the present study, we investigated whether the superior temporal gyrus (STG), an auditory modality-specific area, is critical for processing tactile events. Transcranial magnetic stimulation (TMS) was applied over the left STG and the left primary somatosensory cortex (SI) at different time intervals (60, 120, and 180 msec) during a tactile temporal discrimination task (Experiment 1) and a tactile spatial discrimination task (Experiment 2). Tactile temporal processing was disrupted when TMS was applied to SI at 60 msec after tactile presentation, confirming the modality specificity of this region. Crucially, TMS over STG also affected tactile temporal processing but at 180 msec delay. In both cases, the impairment was limited to the contralateral touches and was due to reduced perceptual sensitivity. In contrary, tactile spatial processing was impaired only by TMS over SI at 60–120 msec. These findings demonstrate the causal involvement of auditory areas in processing the duration of somatosensory events, suggesting that STG might play a supramodal role in temporal perception. Furthermore, the involvement of auditory cortex in somatosensory processing supports the view that multisensory integration occurs at an early stage of cortical processing.
33
Spitoni, Grazia Fernanda, Giorgio Pireddu, Valerio Zanellati, Beatrice Dionisi, Gaspare Galati, and Luigi Pizzamiglio. "Is Right Angular Gyrus Involved in the Metric Component of the Mental Body Representation in Touch and Vision? A tDCS Study." Brain Sciences 11, no. 3 (February 25, 2021): 284. http://dx.doi.org/10.3390/brainsci11030284.
Full textAbstract:
Several studies have found in the sense of touch a good sensory modality by which to study body representation. Here, we address the “metric component of body representation”, a specific function developed to process the discrimination of tactile distances on the body. The literature suggests the involvement of the right angular gyrus (rAG) in processing the tactile metricity on the body. The question of this study is the following: is the rAG also responsible for the visual metric component of body representation? We used tDCS (anodal and sham) in 20 subjects who were administered an on-body distance discrimination task with both tactile and visual stimuli. They were also asked to perform the same task in a near-body condition. The results allow us to confirm the role of rAG in the estimation of tactile distances. Further, we also showed that rAG might be involved in the discrimination of distances on the body not only in tactile but also in visual modality. Finally, based on the significant effects of anodal stimulation even in a near-body visual discrimination task, we proposed a higher-order function of the AG in terms of a supramodal comparator of quantities.
34
Solvi, Cwyn, Selene Gutierrez Al-Khudhairy, and Lars Chittka. "Bumble bees display cross-modal object recognition between visual and tactile senses." Science 367, no. 6480 (February 20, 2020): 910–12. http://dx.doi.org/10.1126/science.aay8064.
Full textAbstract:
Many animals can associate object shapes with incentives. However, such behavior is possible without storing images of shapes in memory that are accessible to more than one sensory modality. One way to explore whether there are modality-independent internal representations of object shapes is to investigate cross-modal recognition—experiencing an object in one sensory modality and later recognizing it in another. We show that bumble bees trained to discriminate two differently shaped objects (cubes and spheres) using only touch (in darkness) or vision (in light, but barred from touching the objects) could subsequently discriminate those same objects using only the other sensory information. Our experiments demonstrate that bumble bees possess the ability to integrate sensory information in a way that requires modality-independent internal representations.
35
Töllner, Thomas, Klaus Gramann, Hermann J. Müller, and Martin Eimer. "The Anterior N1 Component as an Index of Modality Shifting." Journal of Cognitive Neuroscience 21, no. 9 (September 2009): 1653–69. http://dx.doi.org/10.1162/jocn.2009.21108.
Full textAbstract:
Processing of a given target is facilitated when it is defined within the same (e.g., visual–visual), compared to a different (e.g., tactile–visual), perceptual modality as on the previous trial [Spence, C., Nicholls, M., & Driver, J. The cost of expecting events in the wrong sensory modality. Perception & Psychophysics, 63, 330–336, 2001]. The present study was designed to identify electrocortical (EEG) correlates underlying this “modality shift effect.” Participants had to discriminate (via foot pedal responses) the modality of the target stimulus, visual versus tactile (Experiment 1), or respond based on the target-defining features (Experiment 2). Thus, modality changes were associated with response changes in Experiment 1, but dissociated in Experiment 2. Both experiments confirmed previous behavioral findings with slower discrimination times for modality change, relative to repetition, trials. Independently of the target-defining modality, spatial stimulus characteristics, and the motor response, this effect was mirrored by enhanced amplitudes of the anterior N1 component. These findings are explained in terms of a generalized “modality-weighting” account, which extends the “dimension-weighting” account proposed by Found and Müller [Searching for unknown feature targets on more than one dimension: Investigating a “dimension-weighting” account. Perception & Psychophysics, 58, 88–101, 1996] for the visual modality. On this account, the anterior N1 enhancement is assumed to reflect the detection of a modality change and initiation of the readjustment of attentional weight-setting from the old to the new target-defining modality in order to optimize target detection.
36
Salzer, Yael, Daniela Aisenberg, Tal Oron-Gilad, and Avishai Henik. "In Touch With the Simon Effect *The first two authors contributed equally." Experimental Psychology 61, no. 3 (November 1, 2014): 165–79. http://dx.doi.org/10.1027/1618-3169/a000236.
Full textAbstract:
Cognitive control has been extensively studied using the auditory and visual modalities. In the current study, a tactile version of the Simon task was created in order to test control mechanisms in a modality that was less studied, to provide comparative and new information. A significant Simon effect – reaction time gap between congruent (i.e., stimulus and response in the same relative location) and incongruent (i.e., stimulus and response in opposite locations) stimuli – provided grounds to further examine both general and tactile-specific aspects of cognitive control in three experiments. By implementing a neutral condition and conducting sequential and distributional analysis, the present study: (a) supports two different independent mechanisms of cognitive control – reactive control and proactive control; (b) reveals facilitation and interference within the tactile Simon effect; and (c) proposes modality differences in activation and processing of the spatially driven stimulus-response association.
37
Ljungberg, Jessica K., and Fabrice B. R. Parmentier. "Cross-Modal Distraction by Deviance." Experimental Psychology 59, no. 6 (January 1, 2012): 355–63. http://dx.doi.org/10.1027/1618-3169/a000164.
Full textAbstract:
Unexpected task-irrelevant changes in the auditory or visual sensory channels have been shown to capture attention in an ineluctable manner and distract participants away from ongoing auditory or visual categorization tasks. We extend the study of this phenomenon by reporting the first within-participant comparison of deviance distraction in the tactile and auditory modalities. Using vibro-tactile-visual and auditory-visual cross-modal oddball tasks, we found that unexpected changes in the tactile and auditory modalities produced a number of functional similarities: A negative impact of distracter deviance on performance in the ongoing visual task, distraction on the subsequent trial (post-deviance distraction), and a similar decrease – but not the disappearance – of these effects across blocks. Despite these functional similarities, deviance distraction only correlated between the auditory and tactile modalities for the accuracy-based measure of deviance distraction and not for response latencies. Post-deviance distraction showed no correlation between modalities. Overall, the results suggest that behavioral deviance distraction may be underpinned by both modality-specific and multimodal mechanisms, while post-deviance distraction may predominantly relate to modality-specific processes.
38
Làdavas, Elisabetta, Giuseppe di Pellegrino, Alessandro Farnè, and Gabriele Zeloni. "Neuropsychological Evidence of an Integrated Visuotactile Representation of Peripersonal Space in Humans." Journal of Cognitive Neuroscience 10, no. 5 (September 1998): 581–89. http://dx.doi.org/10.1162/089892998562988.
Full textAbstract:
Current interpretations of extinction suggest that the disorder is due to an unbalanced competition between ipsilesional and contralesional representations of space. The question addressed in this study is whether the competition between left and right representations of space in one sensory modality (i.e., touch) can be reduced or exacerbated by the activation of an intact spatial representation in a different modality that is functionally linked to the damaged representation (i.e., vision). This hypothesis was tested in 10 right-hemisphere lesioned patients who suffered from reliable tactile extinction. We found that a visual stimulus presented near the patient's ipsilesional hand (i.e., visual peripersonal space) inhibited the processing of a tactile stimulus delivered on the contralesional hand (cross-modal visuotactile extinction) to the same extent as did an ipsilesional tactile stimulation (unimodal tactile extinction). It was also found that a visual stimulus presented near the contralesional hand improved the detection of a tactile stimulus applied to the same hand. In striking contrast, less modulatory effects of vision on touch perception were observed when a visual stimulus was presented far from the space immediately around the patient's hand (i.e., extrapersonal space). This study clearly demonstrates the existence of a visual peripersonal space centered on the hand in humans and its modulatory effects on tactile perception. These findings are explained by referring to the activity of bimodal neurons in premotor and parietal cortex of macaque, which have tactile receptive fields on the hand and corresponding visual receptive fields in the space immediately adjacent to the tactile fields.
39
Conway, Christopher M., and Morten H. Christiansen. "Modality-Constrained Statistical Learning of Tactile, Visual, and Auditory Sequences." Journal of Experimental Psychology: Learning, Memory, and Cognition 31, no. 1 (2005): 24–39. http://dx.doi.org/10.1037/0278-7393.31.1.24.
Full text
40
Belova, Alla. "GUSTATORY, OLFACTORY, TACTILE MODALITIES IN CONNOISSEURIAL FOOD REVIEWS." Studia Linguistica, no. 22 (2023): 9–22. http://dx.doi.org/10.17721/studling2023.22.9-22.
Full textAbstract:
Sensorial experience has always been of paramount importance for humans, their survival, and world cognition. The rise of Sensory/ Sensorial/ Sensitive Linguistics in the 21st century, interest in multimodality, and digital technologies advance triggered computerized research of gustatory, olfactory, and tactile perception as well as diverse experiments in Psycholinguistics, Neurolinguistics, Cognitive Linguistics. 500 connoisseurial food reviews written by prominent restaurant critics in Great Britain and the United States of America in 2020-2023 were analyzed to find out textual ways of communicating taste. The article analyzes language means used to package taste perception, focusing on gustatory, olfactory, and tactile modalities in Modern English, the intersection of gustation and olfaction, in particular, sensory lexemes across categories. Word frequency and combinability of basic taste terms, gustatory words, and non-taste-related words were analyzed to describe taste types and flavour degrees. Food reviews reveal the dominance of veridical tastes, not generic taste types. Tactile modality is expressed in food reviews in multiple ways, proving that the meal’s texture and some ingredients are one of the essential parameters of the meal evaluation. Visual modality is realized through numerous photos of the dishes and restaurants accompanying reviews. Auditory modality in food reviews is reduced to a couple of adjectives and their derivatives. The research is done within Culinary Linguistics deals with diverse genres of food writing, Sensitive Linguistics that focuses on perceptual modalities, Multimodality Theory as eating and food tasting are viewed as multisensory experience and Cognitive Linguistics, in particular, categorization of sensual perceptions.
41
Lucchini, Karen, Rebecca Umeed, Luana Guimarães, Paulo Santos, Iara Sommer, and Bruna Bezerra. "The role of touch in captive and semi-captive Antillean manatees (Trichechus manatus manatus)." Behaviour 158, no. 3-4 (February 9, 2021): 291–313. http://dx.doi.org/10.1163/1568539x-bja10069.
Full textAbstract:
Abstract Tactile signals have been neglected in aquatic animal studies despite being a major communication modality. We investigated Antillean manatees’ tactile behavioural repertoire and budget in captivity (7-females and 4-males) and semi-captivity (4-males) in Brazil. We detected 17 tactile behaviours (14.03% of the activity budget) with social, self-maintenance, or environmental exploration functions. The observation method influenced the detection of self-maintenance behaviours — focal animal and ad libitum detected more of these behaviours than scan sampling. Age, sex, housing, and centre routines influenced the tactile repertoire. The captive females and semi-captive males tactile patterns differed, suggesting that sex and animal-pool density play a role in tactile patterns. We recommend carefully choosing the observation method when investigating functional categories of manatee tactile behaviours. The monitoring and stimulation of manatee tactile behaviours should integrate rehabilitation and reintroduction practices. Environmental enrichment may stimulate tactile behaviours related to habitat exploration, key behaviours in aiding manatee navigation.
42
Nordmark, Per F., J. Andrew Pruszynski, and Roland S. Johansson. "BOLD Responses to Tactile Stimuli in Visual and Auditory Cortex Depend on the Frequency Content of Stimulation." Journal of Cognitive Neuroscience 24, no. 10 (October 2012): 2120–34. http://dx.doi.org/10.1162/jocn_a_00261.
Full textAbstract:
Although some brain areas preferentially process information from a particular sensory modality, these areas can also respond to other modalities. Here we used fMRI to show that such responsiveness to tactile stimuli depends on the temporal frequency of stimulation. Participants performed a tactile threshold-tracking task where the tip of either their left or right middle finger was stimulated at 3, 20, or 100 Hz. Whole-brain analysis revealed an effect of stimulus frequency in two regions: the auditory cortex and the visual cortex. The BOLD response in the auditory cortex was stronger during stimulation at hearable frequencies (20 and 100 Hz) whereas the response in the visual cortex was suppressed at infrasonic frequencies (3 Hz). Regardless of which hand was stimulated, the frequency-dependent effects were lateralized to the left auditory cortex and the right visual cortex. Furthermore, the frequency-dependent effects in both areas were abolished when the participants performed a visual task while receiving identical tactile stimulation as in the tactile threshold-tracking task. We interpret these findings in the context of the metamodal theory of brain function, which posits that brain areas contribute to sensory processing by performing specific computations regardless of input modality.
43
Nanay, Bence. "Sensory Substitution and Multimodal Mental Imagery." Perception 46, no. 9 (April 11, 2017): 1014–26. http://dx.doi.org/10.1177/0301006617699225.
Full textAbstract:
Many philosophers use findings about sensory substitution devices in the grand debate about how we should individuate the senses. The big question is this: Is “vision” assisted by (tactile) sensory substitution really vision? Or is it tactile perception? Or some sui generis novel form of perception? My claim is that sensory substitution assisted “vision” is neither vision nor tactile perception, because it is not perception at all. It is mental imagery: visual mental imagery triggered by tactile sensory stimulation. But it is a special form of mental imagery that is triggered by corresponding sensory stimulation in a different sense modality, which I call “multimodal mental imagery.”
44
Gentaz, Edouard, Yvette Hatwell, and Arlette Streri. "Constructivist and ecological approaches in tactual perception." Behavioral and Brain Sciences 25, no. 1 (February 2002): 106. http://dx.doi.org/10.1017/s0140525x02320028.
Full textAbstract:
Constructivist and ecological approaches are also observed in tactile perception studies. The question is whether identification and localization are dissociated in the tactile modality as well, and whether Norman's conception may be generalized to the field of touch. An analogue to blindsight was evidenced in passive touch, but no such dissociation was observed in active touch. A study is in progress in this domain.
45
Convento, Silvia, Kira A. Wegner-Clemens, and Jeffrey M. Yau. "Reciprocal Interactions Between Audition and Touch in Flutter Frequency Perception." Multisensory Research 32, no. 1 (2019): 67–85. http://dx.doi.org/10.1163/22134808-20181334.
Full textAbstract:
Abstract In both audition and touch, sensory cues comprising repeating events are perceived either as a continuous signal or as a stream of temporally discrete events (flutter), depending on the events’ repetition rate. At high repetition rates (>100 Hz), auditory and tactile cues interact reciprocally in pitch processing. The frequency of a cue experienced in one modality systematically biases the perceived frequency of a cue experienced in the other modality. Here, we tested whether audition and touch also interact in the processing of low-frequency stimulation. We also tested whether multisensory interactions occurred if the stimulation in one modality comprised click trains and the stimulation in the other modality comprised amplitude-modulated signals. We found that auditory cues bias touch and tactile cues bias audition on a flutter discrimination task. Even though participants were instructed to attend to a single sensory modality and ignore the other cue, the flutter rate in the attended modality is perceived to be similar to that of the distractor modality. Moreover, we observed similar interaction patterns regardless of stimulus type and whether the same stimulus types were experienced by both senses. Combined with earlier studies, our results suggest that the nervous system extracts and combines temporal rate information from multisensory environmental signals, regardless of stimulus type, in both the low- and high temporal frequency domains. This function likely reflects the importance of temporal frequency as a fundamental feature of our multisensory experience.
46
Kishon-Rabin, Liat, Nava Haras, and Moe Bergman. "Multisensory Speech Perception of Young Children With Profound Hearing Loss." Journal of Speech, Language, and Hearing Research 40, no. 5 (October 1997): 1135–50. http://dx.doi.org/10.1044/jslhr.4005.1135.
Full textAbstract:
The contribution of a two-channel vibrotactile aid (Trill VTA 2/3, AVR Communications LTD) to the audiovisual perception of speech was evaluated in four young children with profound hearing loss using words and speech pattern contrasts. An intensive, hierarchical, and systematic training program was provided. The results show that the addition of the tactile (T) modality to the auditory and visual (A+V) modalities enhanced speech perception performance significantly on all tests. Specifically, at the end of the training sessions, the tactile supplementation increased word recognition scores in a 44-word, closed-set task by 12 percentage points; detection of consonant in final position by 50 percentage points; detection of sibilant in final position by 30 percentage points; and detection of voicing in final position by 25 percentage points. Significant learning over time was evident for all test materials, in all modalities. As expected, fastest learning (i.e., smallest time constants) was found for the AVT condition. The results of this study provide further evidence that sensory information provided by the tactile modality can enhance speech perception in young children.
47
Li, Yaoyao, Huailin Zhao, Huaping Liu, Shan Lu, and Yueyang Hou. "Research on visual‐tactile cross‐modality based on generative adversarial network." Cognitive Computation and Systems 3, no. 2 (April 16, 2021): 131–41. http://dx.doi.org/10.1049/ccs2.12008.
Full text
48
Lou, Chunmiao, and Lihan Chen. "The Asymmetric Switch Cost between Subitizing and Estimation in Tactile Modality." Journal of Vision 21, no. 9 (September 27, 2021): 2184. http://dx.doi.org/10.1167/jov.21.9.2184.
Full text
49
Connell, Louise, and Dermot Lynott. "Look but don’t touch: Tactile disadvantage in processing modality-specific words." Cognition 115, no. 1 (April 2010): 1–9. http://dx.doi.org/10.1016/j.cognition.2009.10.005.
Full text
50
Jiang, Yushi, and Lihan Chen. "Mutual Influences of Intermodal Visual/Tactile Apparent Motion and Auditory Motion with Uncrossed and Crossed Arms." Multisensory Research 26, no. 1-2 (2013): 19–51. http://dx.doi.org/10.1163/22134808-00002409.
Full textAbstract:
Intra-modal apparent motion has been shown to be affected or ‘captured’ by information from another, task-irrelevant modality, as shown in cross-modal dynamic capture effect. Here we created inter-modal apparent motion between visual and tactile stimuli and investigated whether there are mutual influences between auditory apparent motion and inter-modal visual/tactile apparent motion. Moreover, we examined whether and how the spatial remapping between somatotopic and external reference frames of tactile events affect the cross-modal capture between auditory apparent motion and inter-modal visual/tactile apparent motion, by introducing two arm postures: arms-uncrossed and arms-crossed. In Experiment 1, we used auditory stimuli (auditory apparent motion) as distractors and inter-modal visual/tactile stimuli (inter-modal apparent motion) as targets while in Experiment 2 we reversed the distractors and targets. In Experiment 1, we found a general detrimental influence of arms-crossed posture in the task of discrimination of direction in visual/tactile stream, but in Experiment 2, the influence of arms-uncrossed posture played a significant role in modulating the inter-modal visual/tactile stimuli capturing over auditory apparent motion. In both Experiments, the synchronously presented motion streams led to noticeable directional congruency effect in judging the target motion. Among the different modality combinations, tactile to tactile apparent motion (TT) and visual to visual apparent motion (VV) are two signatures revealing the asymmetric congruency effects. When the auditory stimuli were targets, the congruency effect was largest with VV distractors, lowest with TT distractors; the pattern was reversed when the auditory stimuli were distractors. In addition, across both experiments the congruency effect in visual to tactile (VT) and tactile to visual (TV) apparent motion was intermediate between the effect-sizes in VV and TT. We replicated the above findings with a block-wise design (Experiment 3). In Experiment 4, we introduced static distractor events (visual or tactile stimulus), and found the modulation of spatial remapping of distractors upon AA motion is reduced. These findings suggest that there are mutual but a robust asymmetric influence between intra-modal auditory apparent motion and intermodal visual/tactile apparent motion. We proposed that relative reliabilities in directional information between distractor and target streams, summed over a remapping process between two spatial reference frames, determined this asymmetric influence.