Journal articles on the topic 'Selective listening paradigm'

The ability to focus ones attention in different acoustical environments has been thoroughly investigated in the past. However, recent technological advancements have made it possible to perform laboratory experiments in a more realistic manner. In order to investigate close-to-real-life scenarios, a classroom was modeled in virtual reality (VR) and an established paradigm to investigate the auditory selective attention (ASA) switch was translated from an audio-only version into an audiovisual VR setting. The new paradigm was validated with adult participants in a listening experiment, and the results were compared to the previous version. Apart from expected effects such as switching costs and auditory congruency effects, which reflect the robustness of the overall paradigm, a difference in error rates between the audio-only and the VR group was found, suggesting enhanced attention in the new VR setting, which is consistent with recent studies. Overall, the results suggest that the presented VR paradigm can be used and further developed to investigate the voluntary auditory selective attention switch in a close-to-real-life classroom scenario.

This article focuses on critically provincialising some of the ethico-political challenges inherent to much of the acoustic ecology vocabulary and conceptual framework. As we will demonstrate, much of the underlying limitations stem from an adherence to a particular self-transformation praxis (from the ‘New Age’ movement) alongside an overtly optimist and culturally selective outlook on how a well-informed acoustic designer would guide individuals and communities to a better sonic world. This epistemological and aesthetic outlook is presented in order to offer an alternative view on how collaborative works that deal with the sonic can take place within communities. One, where rigid hierarchies and orthodoxies are substituted by an intersubjective listening that changes all actors involved in the process. This is the framework from which we present Cildo Meireles’s Sal Sem Carne LP (1975) and Lilian Nakahodo’s sonic cartography Mapa sonoro CWB: Uma cartografia afetiva de Curitiba (2015–).

Speech comprehension in noisy, multitalker situations poses a challenge. Successful behavioral adaptation to a listening challenge often requires stronger engagement of auditory spatial attention and context-dependent semantic predictions. Human listeners differ substantially in the degree to which they adapt behaviorally and can listen successfully under such circumstances. How cortical networks embody this adaptation, particularly at the individual level, is currently unknown. We here explain this adaptation from reconfiguration of brain networks for a challenging listening task (i.e., a linguistic variant of the Posner paradigm with concurrent speech) in an age-varying sample of n = 49 healthy adults undergoing resting-state and task fMRI. We here provide evidence for the hypothesis that more successful listeners exhibit stronger task-specific reconfiguration (hence, better adaptation) of brain networks. From rest to task, brain networks become reconfigured toward more localized cortical processing characterized by higher topological segregation. This reconfiguration is dominated by the functional division of an auditory and a cingulo-opercular module and the emergence of a conjoined auditory and ventral attention module along bilateral middle and posterior temporal cortices. Supporting our hypothesis, the degree to which modularity of this frontotemporal auditory control network is increased relative to resting state predicts individuals’ listening success in states of divided and selective attention. Our findings elucidate how fine-tuned cortical communication dynamics shape selection and comprehension of speech. Our results highlight modularity of the auditory control network as a key organizational principle in cortical implementation of auditory spatial attention in challenging listening situations.

The present research explored the effect of selective remembering and the resulting “silences” on memory. In particular, we examined whether unmentioned information is more likely to be forgotten by a listener if related information is recollected by the speaker than if related information is not recollected by the speaker. In a modification of the retrieval-induced forgetting paradigm, pairs of individuals studied material, but in the practice phase, only one member of each pair selectively recalled it, while the other listened. Experiment 1 employed paired associates, and Experiment 2 used stories. Experiment 3 involved not controlled practice, but free-flowing conversation. In each case, results from a final memory test established not only within-individual retrieval-induced forgetting, but also socially shared retrieval-induced forgetting. The results demonstrate that listening to a speaker remember selectively can induce forgetting of related information in the listener.

In a dichotic listening paradigm, event-related potentials (ERPs) were recorded to linguistic and nonlinguistic probe stimuli embedded in 2 different narrative contexts as they were either attended or unattended. In adults, the typical N1 attention effect was observed for both types of probes: Probes superimposed on the attended narrative elicited an enhanced negativity compared to the same probes when unattended. Overall, this sustained attention effect was greater over medial and left lateral sites, but was more posteriorly distributed and of longer duration for linguistic as compared to nonlinguistic probes. In contrast, in 6-to 8-year-old children the ERPs were morphologically dissimilar to those elicited in adults and children displayed a greater positivity to both types of probe stimuli when embedded in the attended as compared to the unattended narrative. Although both adults and children showed attention effects beginning at about 100 msec, only adults displayed left-lateralized attention effects and a distinct, posterior distribution for linguistic probes. These results suggest that the attentional networks indexed by this task continue to develop beyond the age of 8 years.

Research has shown that the rhythmic structure of speech is relevant to listening outcomes in complex environments. Several studies have shown that an intact, natural target rhythm facilitates listeners’ perception of auditory signals. However, less is known about the effect of competitor signal rhythmic structure on target recognition. The current study uses a synthetic vowel identification paradigm to investigate the influence of the rhythmic structure of to-be-ignored competing signals on listeners’ ability to identify speech information in a target signal. Listeners were tasked with identifying the last three vowels of target sequences of varying length presented alongside competing sequences consisting of either vowel-like harmonic tone complexes or similar vowels. The inter-onset-intervals in these sequences were manipulated to create conditions where the internal rhythm of the sequences was either isochronous or irregular. Competitor rhythm was found to be a significant factor for target recognition only with the vowel-sequence competitors. Isochronous target vowel recognition was better for vowel-sequence competitors with an irregular rhythm than with a regular (isochronous) rhythm. The results of this study highlight (1) the relevance of the rhythmic structure in selective listening tasks and (2) the importance of target and competitor similarity in determining the influence of competitor rhythm.

Purpose Few studies have assessed listening effort (LE)—the cognitive resources required to perceive speech—among populations with intact hearing but reduced availability of cognitive resources. Attention/deficit/hyperactivity disorder (ADHD) is theorized to restrict attention span, possibly making speech perception in adverse conditions more challenging. This study examined the effect of ADHD on LE among adults using a behavioral dual-task paradigm (DTP). Method Thirty-nine normal-hearing adults (aged 21–27 years) participated: 19 with ADHD (ADHD group) and 20 without ADHD (control group). Baseline group differences were measured in visual and auditory attention as well as speech perception. LE using DTP was assessed as the performance difference on a visual–motor task versus a simultaneous auditory and visual–motor task. Results Group differences in attention were confirmed by differences in visual attention (larger reaction times between congruent and incongruent conditions) and auditory attention (lower accuracy in the presence of distractors) among the ADHD group, compared to the controls. LE was greater among the ADHD group than the control group. Nevertheless, no group differences were found in speech perception. Conclusions LE is increased among those with ADHD. As a DTP assumes limited cognitive capacity to allocate attentional resources, LE among those with ADHD may be increased because higher level cognitive processes are more taxed in this population. Studies on LE using a DTP should take into consideration mechanisms of selective and divided attention. Among young adults who need to continuously process great volumes of auditory and visual information, much more effort may be expended by those with ADHD than those without it. As a result, those with ADHD may be more prone to fatigue and irritability, similar to those who are engaged in more outwardly demanding tasks.

Background: Verbally based dichotic-listening experiments and reproduction-mediated response-selection strategies have been used for over four decades to study perceptual/cognitive aspects of auditory information processing and make inferences about hemispheric asymmetries and language lateralization in the brain. Test procedures using dichotic digits have also been used to assess for disorders of auditory processing. However, with this application, limitations exist and paradigms need to be developed to improve specificity of the diagnosis. Use of matched tasks in multiple sensory modalities is a logical approach to address this issue. Herein, we use dichotic listening and dichoptic viewing of visually presented digits for making this comparison. Purpose: To evaluate methodological issues involved in using matched tasks of dichotic listening and dichoptic viewing in normal adults. Research Design: A multivariate assessment of the effects of modality (auditory vs. visual), digit-span length (1–3 pairs), response selection (recognition vs. reproduction), and ear/visual hemifield of presentation (left vs. right) on dichotic and dichoptic digit perception. Study Sample: Thirty adults (12 males, 18 females) ranging in age from 18 to 30 yr with normal hearing sensitivity and normal or corrected-to-normal visual acuity. Data Collection and Analysis: A computerized, custom-designed program was used for all data collection and analysis. A four-way repeated measures analysis of variance (ANOVA) evaluated the effects of modality, digit-span length, response selection, and ear/visual field of presentation. Results: The ANOVA revealed that performances on dichotic listening and dichoptic viewing tasks were dependent on complex interactions between modality, digit-span length, response selection, and ear/visual hemifield of presentation. Correlation analysis suggested a common effect on overall accuracy of performance but isolated only an auditory factor for a laterality index. Conclusions: The variables used in this experiment affected performances in the auditory modality to a greater extent than in the visual modality. The right-ear advantage observed in the dichotic-digits task was most evident when reproduction mediated response selection was used in conjunction with three-digit pairs. This effect implies that factors such as “speech related output mechanisms” and digit-span length (working memory) contribute to laterality effects in dichotic listening performance with traditional paradigms. Thus, the use of multiple-digit pairs to avoid ceiling effects and the application of verbal reproduction as a means of response selection may accentuate the role of nonperceptual factors in performance. Ideally, tests of perceptual abilities should be relatively free of such effects.

There have been disparate findings reported previously by investigators who have examined differences in the cortically generated N1 (i.e., N100) from control and tinnitus samples. Investigators have employed differing stimulation paradigms applied to relatively small subject samples. Accordingly, it is not surprising that there has been no unanimity in the reported findings. The present investigation was conducted to determine, once again, whether differences exist in the cortically generated N1 potential recorded from both normals and subjects with bothersome tinnitus. In this investigation both passive and selective auditory attention paradigms were employed. Subjects were a total of 63 adults (31 controls and 32 tinnitus patients). The mean score on the Tinnitus Handicap Inventory for the tinnitus group was 39 points. Results failed to reveal group differences in the latency of N1 across listening conditions. However, tinnitus patients demonstrated N1 potentials that were of significantly smaller amplitude than those obtained from normal subjects. These findings are consistent with those reported in previous investigations.

Background and Objectives: In distracting listening conditions, individuals need to pay extra attention to selectively listen to the target sounds. To investigate the amount of listening effort required in reverberating and noisy backgrounds, a semantic mismatch was examined.Subjects and Methods: Electroencephalography was performed in 18 voluntary healthy participants using a 64-channel system to obtain N400 latencies. They were asked to listen to sounds and see letters in 2 reverberated×2 noisy paradigms (i.e., Q-0 ms, Q-2000 ms, 3 dB-0 ms, and 3 dB-2000 ms). With auditory-visual pairings, the participants were required to answer whether the auditory primes and letter targets did or did not match. Results: Q-0 ms revealed the shortest N400 latency, whereas the latency was significantly increased at 3 dB-2000 ms. Further, Q-2000 ms showed approximately a 47 ms delayed latency compared to 3 dB-0 ms. Interestingly, the presence of reverberation significantly increased N400 latencies. Under the distracting conditions, both noise and reverberation involved stronger frontal activation. Conclusions: The current distracting listening conditions could interrupt the semantic mismatch processing in the brain. The presence of reverberation, specifically a 2000 ms delay, necessitates additional mental effort, as evidenced in the delayed N400 latency and the involvement of the frontal sources in this study.

The paper explores the concept of ‘listening to unheard voices’ in the urban environment as a design intention and strategy that contributes to an inclusive and alternative approach to urban public space, considering and promoting the imperatives of caring that such space should deliver to the city and its inhabitants. The ideas discussed in the paper find their background in the research on the concept of care in feminist urbanism and feminist studies in general, and specifically in relation to the model of the Caring City, promoting a city that places care at its centre, and aims to include a wider selection of citizens in the construction of the public good. Through the analysis of two case studies of public spaces designed by solo-women architecture practices, this paper identifies an alternative relational paradigm which gives space to unheard voices in the urban environment through processes of inclusion and participation. The two cases, Plaça d'en Baró in Santa Coloma de Gramenet (Barcelona, Spain), designed by Catalan architectural collective Equal Saree, and Ruskin Square in the London Borough of Croydon (London, UK) designed by British architectural practice muf architecture/art, have implemented the concept of listening to ‘unheard voices’ offering insights into the contribution of women to the urban environment and how it is transformed, shaped, and used.

In the visual modality, perceptual demand on a goal-directed task has been shown to modulate the extent to which irrelevant information can be disregarded at a sensory-perceptual stage of processing. In the auditory modality, the effect of perceptual demand on neural representations of task-irrelevant sounds is unclear. We compared simultaneous ERPs and fMRI responses associated with task-irrelevant sounds across parametrically modulated perceptual task demands in a dichotic-listening paradigm. Participants performed a signal detection task in one ear (Attend ear) while ignoring task-irrelevant syllable sounds in the other ear (Ignore ear). Results revealed modulation of syllable processing by auditory perceptual demand in an ROI in middle left superior temporal gyrus and in negative ERP activity 130–230 msec post stimulus onset. Increasing the perceptual demand in the Attend ear was associated with a reduced neural response in both fMRI and ERP to task-irrelevant sounds. These findings are in support of a selection model whereby ongoing perceptual demands modulate task-irrelevant sound processing in auditory cortex.

We present an algorithm that organizes a song repository upon recording a user’s memory experiences from previous music listening activities. Our method forms an affectively annotated network of songs. The network’s connections correspond to a person’s recorded memory experiences related to song preferences when the person is at different states of affective bias. Upon formation of this network, an intelligent affect-sensitive network navigation algorithm synthesizes playlists that conform to desired affective states. The method for the network formation is highly individualized, in the sense that it takes in account an individual’s music preferences which are typically subjective and may differ from user to user. Also, the method is content independent, in the sense that it does not rely or favor any particular music genre. In fact, the method is applicable to any type of media, not only songs. We implement our method and present evaluation results from the introspection of our algorithms’ execution and from feedback recorded during the evaluation by human test subjects. The evaluation results clearly indicate that the proposed method significantly outperforms the most typical paradigm of random song selection.

Previous findings have suggested that auditory attention causes not only enhancement in neural processing gain, but also sharpening in neural frequency tuning in human auditory cortex. The current study was aimed to reexamine these findings. Specifically, we aimed to investigate whether attentional gain enhancement and frequency sharpening emerge at the same or different processing levels and whether they represent independent or cooperative effects. For that, we examined the pattern of attentional modulation effects on early, sensory-driven cortical auditory-evoked potentials occurring at different latencies. Attention was manipulated using a dichotic listening task and was thus not selectively directed to specific frequency values. Possible attention-related changes in frequency tuning selectivity were measured with an adaptation paradigm. Our results show marked disparities in attention effects between the earlier N1 deflection and the subsequent P2 deflection, with the N1 showing a strong gain enhancement effect, but no sharpening, and the P2 showing clear evidence of sharpening, but no independent gain effect. They suggest that gain enhancement and frequency sharpening represent successive stages of a cooperative attentional modulation mechanism that increases the representational bandwidth of attended versus unattended sounds.

This article focuses on learning the hierarchical structure of what we call a “temporal scenario” (for instance, a chord progression) to perform automatic improvisation consistently over several different time scales. We first present a way to represent hierarchical structures with a phrase structure grammar. Such a grammar enables us to analyze a scenario at several levels of organization, creating a “multilevel scenario.” We then develop a method to automatically induce this grammar from a corpus, based on sequence selection with mutual information. We applied this method to a corpus of transcribed improvisations based on the chord sequence, also with chord substitutions, from George Gershwin's “I Got Rhythm.” From these we obtained multilevel scenarios similar to the analyses performed by professional musicians. We then present a novel heuristic approach, exploiting the multilevel structure of a scenario to guide the improvisation with anticipatory behavior in an improvisation paradigm driven by a factor oracle. This method ensures consistency of the improvisation with regard to the global form, and it opens up possibilities when playing on chords that do not exist in memory. This system was evaluated by professional improvisers during listening sessions and received excellent feedback.

Purpose The purpose of this paper is to provide a unique overview of business-to-business (B2B) companies engagement with and strategic approach to use of social media in brand building. This research complements the much more extensive knowledge base regarding social media use in business-to-consumer (B2C) contexts. Design/methodology/approach Since social media marketing is a relatively new activity for B2B companies an interpretivist stance that is inductive in nature is adopted. Semi-structured interviews were conducted with marketing professionals involved in managing social media programmes in France, Ireland, the UK and the USA. Findings The study found that the level of enagement with social media marketing varied, as summarised in the B2B Social Media Engagement Taxonomy. Enhancing brand image, extending brand awareness and facilitating customer engagement were the most common social media objectives. There was no evidence to suggest that companies saw social media as heralding a paradigm shift in brand management and control of the kind discussed and experienced in B2C social media contexts. The B2B social media strategy framework is proposed; this identifies the following six components of a social media strategy: monitoring and listening, empowering and enagaging employees, creating compelling content, stimulating electronic word of mouth, evaluating and selecting channels, and enhacning brand presence through integrating social media. Originality/value The research contributes to the knowledge base associated with social media marketing by offering insights into and a framework summarising B2B social media strategy.

AbstractAuditory processing (AP) is commonly regarded as the perceptual processing of auditory information in the central nervous system. However, the degree to which higher level cognitive processes are involved in AP or its disorders is contentious. Furthermore, there is little evidence regarding the effects of nonauditory cognitive processes on the various tests of AP in common clinical usage and thus on clinical diagnoses of auditory processing disorder.To determine the effects of increased cognitive demand, generated by using a dual-task paradigm, on performance on different AP tests and types of AP tests in common clinical usage. In addition, to investigate the relationship between executive function and changes in AP test performance associated with increased cognitive demand.Counterbalanced repeated measures design, with assessment of AP test performance both on its own and in a dual-task paradigm designed to increase cognitive demand.Twenty-nine young adults, with no reported hearing, learning, language or attention difficulties, English as first language, and hearing and middle-ear status within normal limits.Testing was completed within a single 90-min session. A selection of standard AP tests, representing both adaptive and nonadaptive tests, as well as tests employing difference scores, was administered. These were Competing Sentences Test, Dichotic Digits Test, Frequency Pattern Test (nonadaptive tests); and Listening in Spatialized Noise-Sentences test, conditions “same-voice, 0°”, “different-voice, 0°”, and “same-voice, 90°” (adaptive tests), from which the difference scores “talker advantage” and “spatial advantage” were also derived. Each AP test was completed on its own (alone condition), and simultaneously with a visually presented task (dual-task condition). Executive function was assessed using the phonemic subtest of the Verbal Fluency Test. Nonparametric statistical test procedures were used.All five AP measures obtained from the nonadaptive tests showed a significant performance decrement in the dual-task condition compared with the alone condition, with one exception because of a strong ceiling effect. By contrast, none of the three AP measures obtained from the adaptive tests showed a significant performance decrement in the dual-task condition. Furthermore, neither of the two AP measures based on difference scores showed a significant performance decrement, but this finding simply reflects the lack of significant decrements in the relevant raw scores. Consistent with past reports of associations between executive function and AP performance, a significant positive correlation was found between executive function scores and performance on the Dichotic Digits Test. However, there were no significant correlations between executive function scores and changes in AP test scores between alone and dual-task conditions.Performance on commonly used nonadaptive tests of AP was significantly compromised by the increased cognitive demand resulting from the dual-task paradigm. By contrast, performance on AP measures obtained by adaptive test procedures was not significantly affected. Further investigation of the resilience to increased cognitive demand of the adaptive tests used here, and other adaptive tests of AP, is warranted. Results from this study support the further development of computerized adaptive tests of AP for use in clinical test batteries.

For the first time the International Academy for Systems and Cybernetic Sciences, IASCYS, ( http://iascys.org), has awarded the Charles François International Prize, during the 10thUES-EUS Congress (http://ues-eus.eu), in Brussels, Belgium, Europe. The first step of the procedure was the nomination of interesting papers through asking for the reviewing process by all IASCYS Academicians. So, 6 weeks before the start of the meeting, a booklet of 40 abstracts, all previously anonymously peer-reviewed by the scientific committee of the congress, and each as a 1 page of text, with neither author(s) name(s), nor affiliation(s) or references, was sent to all Academicians. After a 1 month delay, 10 papers of people from 9 Countries (Algeria, Belgium, Denmark, France, Germany, Greece, Italy, Portugal, Russia), have been nominated by Academicians, by e-mails replies. After the congress organizers have proposed as jurors a team of 3 systems scientists who all are speaking both French and English (the official formal languages of the UES-EUS congress), an equal number of 3 Academicians, who are as well fluent in English, French and other languages, attended as the IASCYS part of the jury. After this key step of peers pre-selection, the second step, during the meeting in Brussels, was for all 6 jurors to listen and participate to the corresponding talks-debate for each of the selected papers, in order to rank the top 3 of the most promising works, and then to reflect on the final ranking for the award. The jurors were anonymous. The listening process was the usual process of talk (20 min) and questions (10 min) with the public as in every congress, but also with personal no-formal discussion of jurors with the nominated persons. The first Charles François International Prize of the Academy (gold medal) was awarded to Julio LABORDE, a young Chilean research engineer who is working in the International industrial firm 'Insight Signals'. He is also a student in the prestigious École Pratique des Hautes Études, in Paris, France. His talk was about "Extraction of Information from Agent Base Models. A new pre-topological metric for controlling the propagation of crises." It took place during the 'Methods and tools for risk management of complex socio-technical systems'session. No discussion, his work was the most promising work of the congress. His work was the most promising work of this congress of the European Union for Systemics.This second step allows also, after a debate, to award 3 second places (3 silver medals). They all got the Charles François tutorial in Systems Science on a USB stick and they all, gold and silver medals (Figure 1), will have a certificate of ranking. But, all of them, will get their certificates of award/ranking only after their paper proof will be corrected and accepted. The other 3 certificated persons, silver medals, are (by alphabetic order): -Mick ASHBY, a research engineer in computing sciences who is working for IBM in Germany. His work was about the application of a new paradigm 'The Ethical Regulator Theorem'; -Tjorven HARMSEN, a very young Swedish women who is in Ph. D. in the Leibniz Institute for Research on Society and Space, in Berlin (Germany). Her work was ab out 'Crisis as Social Autocatalysis. On the emergence and Utilization of Opportunities' (a very promising talk, a young researcher to follow; and -Daniela TERRILE, a women who is Professor in the Department of Design at the Polytechnic Institute of Milano, Italy. Her work was about 'Applications of the Target Constellation Model'. 2 other works were also very interesting but one was not into the book of abstracts (it was not peer-reviewed), the other one was into it but it was not pre-selected. No process is perfect. But the rule is the rule: no peer-reviewing, no preselection, means no competition. The important point is that few of the 'preselected and nominated, but not ranked in the top 3' participants said they will attend the next one edition of the Prize in Morocco. And other young researchers said they will do their best to attend another occurrence of the Prize. The Prize was opened to strengthen multi-disciplinary research and the multi-language communication of recent results, towards a worldwide education in Cybernetics and Systems Thinking (Bricage, 2017), which are aims of the Academy (Bricage, 2014). “Want to influence the world? Map reveals the best languages to speak.” (Ronen et al., 2014). On the IASCYS website you will find the rules of the Prize, in English, Spanish, French and Russian.

The growing group of cochlear implant (CI) users includes subjects with preserved acoustic hearing on the opposite side to the CI. The use of both listening sides results in improved speech perception in comparison to listening with one side alone. However, large variability in the measured benefit is observed. It is possible that this variability is associated with the integration of speech across electric and acoustic stimulation modalities. However, there is a lack of established methods to assess speech integration between electric and acoustic stimulation and consequently to adequately program the devices. Moreover, existing methods do not provide information about the underlying physiological mechanisms of this integration or are based on simple stimuli that are difficult to relate to speech integration. Electroencephalography (EEG) to continuous speech is promising as an objective measure of speech perception, however, its application in CIs is challenging because it is influenced by the electrical artifact introduced by these devices. For this reason, the main goal of this work is to investigate a possible electrophysiological measure of speech integration between electric and acoustic stimulation in bimodal CI users. For this purpose, a selective attention decoding paradigm has been designed and validated in bimodal CI users. The current study included behavioral and electrophysiological measures. The behavioral measure consisted of a speech understanding test, where subjects repeated words to a target speaker in the presence of a competing voice listening with the CI side (CIS) only, with the acoustic side (AS) only or with both listening sides (CIS+AS). Electrophysiological measures included cortical auditory evoked potentials (CAEPs) and selective attention decoding through EEG. CAEPs were recorded to broadband stimuli to confirm the feasibility to record cortical responses with CIS only, AS only, and CIS+AS listening modes. In the selective attention decoding paradigm a co-located target and a competing speech stream were presented to the subjects using the three listening modes (CIS only, AS only, and CIS+AS). The main hypothesis of the current study is that selective attention can be decoded in CI users despite the presence of CI electrical artifact. If selective attention decoding improves combining electric and acoustic stimulation with respect to electric stimulation alone, the hypothesis can be confirmed. No significant difference in behavioral speech understanding performance when listening with CIS+AS and AS only was found, mainly due to the ceiling effect observed with these two listening modes. The main finding of the current study is the possibility to decode selective attention in CI users even if continuous artifact is present. Moreover, an amplitude reduction of the forward transfer response function (TRF) of selective attention decoding was observed when listening with CIS+AS compared to AS only. Further studies to validate selective attention decoding as an electrophysiological measure of electric acoustic speech integration are required.

Purpose: This study aimed to investigate the effect of chronic tinnitus on measures of listening effort and cognitive performance, as well as the relation between cognitive performance and the amount of listening effort obtained by those measures. Method: Thirteen normal-hearing young adults with chronic tinnitus were matched with a control group. First, behavioral listening effort was measured using a dual-task paradigm in various favorable and unfavorable listening conditions. Furthermore, verbal working memory, processing speed, selective attention, and cognitive flexibility and inhibition were evaluated. Results: A significant and nonsignificant trend toward more listening effort in the tinnitus group was, respectively, found for the quiet listening condition and the condition with a signal-to-noise ratio of +2 dB. No significant differences in cognitive performances were found between the groups, nor were there significant relationships between the cognitive factors and listening effort scores for either the control or tinnitus group. Conclusions: Listening effort was increased in the tinnitus group. Although no clear differences in cognitive performance could be found between the tinnitus group and their controls, a trend could be seen whereby selective attention deficits in the subjects with tinnitus may be an important factor that affects the amount of listening effort.

AbstractCan preferred music listening improve following attentional and learning performances? Here we suggest that this may be the case. In Experiment 1, following preferred and non-preferred musical-piece listening, we recorded electrophysiological responses to an auditory roving-paradigm. We computed the mismatch negativity (MMN – the difference between responses to novel and repeated stimulation), as an index of perceptual learning, and we measured the correlation between trial-by-trial EEG responses and the fluctuations in Bayesian Surprise, as a quantification of the neural attunement with stimulus informational value. Furthermore, during music listening, we recorded oscillatory cortical activity. MMN and trial-by-trial correlation with Bayesian surprise were significantly larger after subjectively preferred versus non-preferred music, indicating the enhancement of perceptual learning. The analysis on oscillatory activity during music listening showed a selective alpha power increased in response to preferred music, an effect often related to cognitive enhancements. In Experiment 2, we explored whether this learning improvement was realized at the expense of self-focused attention. Therefore, after preferred versus non-preferred music listening, we collected Heart-Beat Detection (HBD) accuracy, as a measure of the attentional focus toward the self. HBD was significantly lowered following preferred music listening. Overall, our results suggest the presence of a specific neural mechanism that, in response to aesthetically pleasing stimuli, and through the modulation of alpha oscillatory activity, redirects neural resources away from the self and toward the environment. This attentional up-weighting of external stimuli might be fruitfully exploited in a wide area of human learning activities, including education, neurorehabilitation and therapy.

AbstractCan preferred music listening improve following attentional and learning performances? Here we suggest that this may be the case. In Experiment 1, following preferred and non-preferred musical-piece listening, we recorded electrophysiological responses to an auditory roving-paradigm. We computed the mismatch negativity (MMN – the difference between responses to novel and repeated stimulation), as an index of perceptual learning, and we measured the correlation between trial-by-trial EEG responses and the fluctuations in Bayesian Surprise, as a quantification of the neural attunement with stimulus informational value. Furthermore, during music listening, we recorded oscillatory cortical activity. MMN and trial-by-trial correlation with Bayesian surprise were significantly larger after subjectively preferred versus non-preferred music, indicating the enhancement of perceptual learning. The analysis on oscillatory activity during music listening showed a selective alpha power increased in response to preferred music, an effect often related to cognitive enhancements. In Experiment 2, we explored whether this learning improvement was realized at the expense of self-focused attention. Therefore, after preferred versus non-preferred music listening, we collected Heart-Beat Detection (HBD) accuracy, as a measure of the attentional focus toward the self. HBD was significantly lowered following preferred music listening. Overall, our results suggest the presence of a specific neural mechanism that, in response to aesthetically pleasing stimuli, and through the modulation of alpha oscillatory activity, redirects neural resources away from the self and toward the environment. This attentional up-weighting of external stimuli might be fruitfully exploited in a wide area of human learning activities, including education, neurorehabilitation and therapy.

Numerous neuroimaging studies demonstrated that the auditory cortex tracks ongoing speech and that, in multi-speaker environments, tracking of the attended speaker is enhanced compared to the other irrelevant speakers. In contrast to speech, multi-instrument music can be appreciated by attending not only on its individual entities (i.e., segregation) but also on multiple instruments simultaneously (i.e., integration). We investigated the neural correlates of these two modes of music listening using electroencephalography (EEG) and sound envelope tracking. To this end, we presented uniquely composed music pieces played by two instruments, a bassoon and a cello, in combination with a previously validated music auditory scene analysis behavioral paradigm (Disbergen et al., 2018). Similar to results obtained through selective listening tasks for speech, relevant instruments could be reconstructed better than irrelevant ones during the segregation task. A delay-specific analysis showed higher reconstruction for the relevant instrument during a middle-latency window for both the bassoon and cello and during a late window for the bassoon. During the integration task, we did not observe significant attentional modulation when reconstructing the overall music envelope. Subsequent analyses indicated that this null result might be due to the heterogeneous strategies listeners employ during the integration task. Overall, our results suggest that subsequent to a common processing stage, top-down modulations consistently enhance the relevant instrument’s representation during an instrument segregation task, whereas such an enhancement is not observed during an instrument integration task. These findings extend previous results from speech tracking to the tracking of multi-instrument music and, furthermore, inform current theories on polyphonic music perception.

Abstract Humans have an exceptional ability to extract specific audio streams of interest in a noisy environment; this is known as the cocktail party effect. It is widely accepted that this ability is related to selective attention, a mental process that enables individuals to focus on a particular object. Evidence suggests that sensory neurons can be modulated by top-down signals transmitted from the prefrontal cortex. However, exactly how the projection of attention signals to the cortex and subcortex influences the cocktail effect is unclear. We constructed computational models to study whether attentional modulation is more effective at earlier or later stages for solving the cocktail party problem along the auditory pathway. We modeled the auditory pathway using deep neural networks (DNNs), which can generate representational neural patterns that resemble the human brain. We constructed a series of DNN models in which the main structures were autoencoders. We then trained these DNNs on a speech separation task derived from the dichotic listening paradigm, a common paradigm to investigate the cocktail party effect. We next analyzed the modulation effects of attention signals during all stages. Our results showed that the attentional modulation effect is more effective at the lower stages of the DNNs. This suggests that the projection of attention signals to lower stages within the auditory pathway plays a more significant role than the higher stages in solving the cocktail party problem. This prediction could be tested using neurophysiological experiments.

Language comprehension relies on integrating words into progressively more complex structures, like phrases and sentences. This hierarchical structure-building is reflected in rhythmic neural activity across multiple timescales in E/MEG in healthy, awake participants. However, recent studies have shown evidence for this “cortical tracking” of higher-level linguistic structures also in a proportion of unresponsive patients. What does this tell us about these patients’ residual levels of cognition and consciousness? Must the listener direct their attention toward higher level speech structures to exhibit cortical tracking, and would selective attention across levels of the hierarchy influence the expression of these rhythms? We investigated these questions in an EEG study of 72 healthy human volunteers listening to streams of monosyllabic isochronous English words that were either unrelated (scrambled condition) or composed of four-word-sequences building meaningful sentences (sentential condition). Importantly, there were no physical cues between four-word-sentences. Rather, boundaries were marked by syntactic structure and thematic role assignment. Participants were divided into three attention groups: from passive listening (passive group) to attending to individual words (word group) or sentences (sentence group). The passive and word groups were initially naïve to the sentential stimulus structure, while the sentence group was not. We found significant tracking at word- and sentence rate across all three groups, with sentence tracking linked to left middle temporal gyrus and right superior temporal gyrus. Goal-directed attention to words did not enhance word-rate-tracking, suggesting that word tracking here reflects largely automatic mechanisms, as was shown for tracking at the syllable-rate before. Importantly, goal-directed attention to sentences relative to words significantly increased sentence-rate-tracking over left inferior frontal gyrus. This attentional modulation of rhythmic EEG activity at the sentential rate highlights the role of attention in integrating individual words into complex linguistic structures. Nevertheless, given the presence of high-level cortical tracking under conditions of lower attentional effort, our findings underline the suitability of the paradigm in its clinical application in patients after brain injury. The neural dissociation between passive tracking of sentences and directed attention to sentences provides a potential means to further characterise the cognitive state of each unresponsive patient.

A central aim of neuroethological research is to discover the mechanisms of natural behaviors in controlled laboratory studies. This goal, however, comes with challenges, namely the selection of experimental paradigms that allow full expression of natural behaviors. Here, we explore this problem in echolocating bats that evolved Doppler shift compensation (DSC) of sonar vocalizations to yield close matching between echo frequency and hearing sensitivity. We ask if behavioral tasks influence the precision of DSC in Pratt’s roundleaf bat, Hipposideros pratti, in three classic laboratory paradigms evoking audio-vocal adjustments: Stationary bats listening to echo playbacks, bats transported on a moving pendulum, and bats flying freely. We found that experimental conditions had a strong influence on the expression of the audiovocal frequency adjustments in bats. H. pratti exhibited robust DSC in both free-flying and moving-pendulum experiments but did not exhibit consistent audiovocal adjustments in echo playback experiments. H. pratti featured a maximum compensation magnitude of 87% and a compensation precision of 0.27% in the free flight experiment. Interestingly, in the moving pendulum experiment H. pratti displayed surprisingly high-precision DSC, with an 84% maximum compensation magnitude and a 0.27% compensation precision. Such DSC performance places H. pratti among the bat species exhibiting the most precise audio-vocal control of echo frequency. These data support the emerging view that Hipposiderid bats have a high-precision DSC system and highlight the importance of selecting experimental paradigms that yield the expression of robust natural behaviors.

This study explored the performance of Chinese college students with different severity of trait depression to process English emotional speech under a complete semantics–prosody Stroop effect paradigm in quiet and noisy conditions. A total of 24 college students with high-trait depression and 24 students with low-trait depression participated in this study. They were required to selectively attend to either the prosodic emotion (happy, sad) or semantic valence (positive and negative) of the English words they heard and then respond quickly. Both prosody task and semantic task were performed in quiet and noisy listening conditions. Results showed that the high-trait group reacted slower than the low-trait group in the prosody task due to their bluntness and insensitivity toward emotional processing. Besides, both groups reacted faster under the consistent situation, showing a clear congruency-induced facilitation effect and the wide existence of the Stroop effect in both tasks. Only the Stroop effect played a bigger role during emotional prosody identification in quiet condition, and the noise eliminated such an effect. For the sake of experimental design, both groups spent less time on the prosody task than the semantic task regardless of consistency in all listening conditions, indicating the friendliness of basic emotion identification and the difficulty for second language learners in face of semantic judgment. These findings suggest the unneglectable effects of college students’ mood conditions and noise outside on emotion word processing.

This study explored the performance of Chinese college students with different severity of trait depression to process English emotional speech under a complete semantics–prosody Stroop effect paradigm in quiet and noisy conditions. A total of 24 college students with high-trait depression and 24 students with low-trait depression participated in this study. They were required to selectively attend to either the prosodic emotion (happy, sad) or semantic valence (positive and negative) of the English words they heard and then respond quickly. Both prosody task and semantic task were performed in quiet and noisy listening conditions. Results showed that the high-trait group reacted slower than the low-trait group in the prosody task due to their bluntness and insensitivity toward emotional processing. Besides, both groups reacted faster under the consistent situation, showing a clear congruency-induced facilitation effect and the wide existence of the Stroop effect in both tasks. Only the Stroop effect played a bigger role during emotional prosody identification in quiet condition, and the noise eliminated such an effect. For the sake of experimental design, both groups spent less time on the prosody task than the semantic task regardless of consistency in all listening conditions, indicating the friendliness of basic emotion identification and the difficulty for second language learners in face of semantic judgment. These findings suggest the unneglectable effects of college students’ mood conditions and noise outside on emotion word processing.

We report the results of an eye tracking study investigating German children’s comprehension of subject and object relative clauses with morphologically unambiguous head and embedded NPs. The experimental paradigm was adopted from Adani & Fritzsche (2015). Children’s eye movements were tracked on the visual display while they were listening to a subject or an object relative clause . Subsequently, they had to choose the most appropriate visual character on the screen to go with a particular relative clause type in a character selection paradigm. All the head NP and the embedded NPs were of masculine gender. Thus, the relative clause syntax was disambiguated by the ending on the relative pronoun and, subsequently, on the determiner in the embedded NP. We computed fixation probabilities towards the syntactic competitor and the embedded NP character in addition to the proportions of looks towards the target character on the screen. Thematic reversal error remained the dominant error type on children’s response accuracy data. The subject advantage was also confirmed on the eye tracking data, though it was overridden in the post-relative clause time window. However, there was a significant increase in fixation probabilities towards the embedded NP character in the ORC, but not in the SRC condition. While children were less efficient to use the morphological information on the relative pronoun to generate an expectation of a non-canonical ORC structure, they obviously used embedded NP morphology later in the sentence to update their ongoing structural analysis.

Word-picture verification, a task that requires a yes/no response to whether a word and a picture match, has been used for both receptive and expressive language; however, there is limited systematic investigation on the linguistic subprocesses targeted by the task. Verification may help to identify linguistic strengths and weaknesses to ultimately provide more targeted, individualized lexical retrieval intervention. The current study assessed the association of semantic and phonological skills with verification performance to demonstrate early efficacy of the paradigm as an aphasia assessment. Sixteen adults with chronic post-stroke aphasia completed a battery of language assessments in addition to reading and auditory verification tasks. Verification scores were positively correlated with auditory and reading comprehension. Accuracy of semantic and phonological verification were positively correlated with accuracy on respective receptive language tasks. More semantic errors were made during verification than naming. The relationship of phonological errors between naming and verification varied by modality (reading or listening). Semantic and phonological performance significantly predicted verification response accuracy and latency. In sum, we propose that verification tasks are particularly useful because they inform semantics pre-lemma selection and phonological decoding, helping to localize individual linguistic strengths and weaknesses, especially in the presence of significant motor speech impairment that can obscure expressive language abilities.

Abstract We previously hypothesised that Functional Cognitive Disorder is characterised by heightened subjective mental effort, exhausted attentional reserve and metacognitive failure. To test this hypothesis, we administered a colour-word Stroop task in which attentional demand was varied by task difficulty (congruent versus incongruent cues) and the presence of a secondary auditory stimulus (passive or active listening to an oddball-type paradigm). We measured subjective mental effort, objective performance (reaction times and accuracy), metacognition and EEG-based biomarkers of mental workload. We tested 19 Functional Cognitive Disorder patients and 23 healthy controls. Patients reported higher levels of depression, anxiety, fatigue, pain, sleep disruption, dissociation and obsessiveness. They rated their memory as significantly poorer than healthy controls; however, accuracy did not differ between groups in any condition. In contrast to healthy controls, patients rated their performance as poorer on the congruent Stroop task with background noise compared to silent conditions. Functional Cognitive Disorder was consistently associated with slower reaction times but this was not exacerbated by increased attentional demand. Patients but not healthy controls reported greater mental workload in noisy conditions but EEG biomarkers were similar between groups, regardless of task difficulty. Functional Cognitive Disorder has significant syndromic overlap with mood disorders and chronic fatigue and pain. It is associated with global metacognitive failure whereas local (task-specific) metacognition is only selectively impaired. Patients were slower than healthy controls, which might contribute to the “brain fog” reported in this condition. Although subjective mental effort was increased in noisy conditions, we found no evidence of attentional exhaustion in Functional Cognitive Disorder. Our results suggest that Functional Cognitive Disorder is a multisystem condition affecting reaction time, subjective mental effort and global metacognition.

Dichotic listening along with the right-ear advantage (REA) has been a standard method of investigating auditory laterality ever since it was first introduced into neuropsychology in the early 1960s. Beginning in the 1980s, authors reported that it was possible to modulate the bottom-up driven perceptual REA by instructing subjects to selectively attend to and report only from the right or left ear. In the present study, we investigated neuronal correlates of both the bottom-up and top-down modulation of the REA through two fMRI analysis approaches: a traditional region approach and a network connectivity approach. Blood-Oxygenation-Level-Dependent (BOLD) fMRI data were acquired while subjects performed the standard forced-attention paradigm. We asked two questions, could the behavioral REA be replicated in unique brain markers, and second if the profound instruction-induced modulation of the REA found in behavioral data would correspond to a similar modulation of brain activation, both region- and network-specific modulations. The subjects were 70 healthy adult right-handers, about half men and half women. fMRI data were acquired in a 3T MR scanner, and the behavioral results replicated previous findings with a REA in the non-forced (NF) and forced-right (FR) conditions, and a tendency for a left-ear advantage (LEA) in the FL-condition. The fMRI data showed unique activations in the speech perception areas of the left temporal lobe when directly contrasted with activations in the homologous right side. However, there were no remaining unique activations when the FR- and FL-conditions were contrasted against each other, and with the NF-condition, using a conservative significance thresholding. The fMRI results are conceptualized within a network connectivity frame of reference, especially with reference to the extrinsic mode network (EMN). The EMN is a generalized task-positive network that is upregulated whenever the task demands exceed a certain threshold irrespective of the specifics and demands of the task. This could explain the similarity of activations for the FR- and FL-conditions, despite the clear differences in behavior.

IntroductionThis essay considers three design projects as microprotests. Reflecting on the ways design practice can generate spaces, sites and methods of protest, we use the concept of microprotest to consider how we, as designers ourselves, can protest by scaling down, focussing, slowing down and paying attention to the edges of our practice. Design microprotest is a form of design activism that is always collaborative, takes place within a community, and involves careful translation of a political conversation. While microprotest can manifest in any design discipline, in this essay we focus on visual communication design. In particular we consider the deep, reflexive practice of listening as the foundation of microprotests in visual communication design.While small in scale and fleeting in duration, these projects express rich and deep political engagements through conversations that create and maintain safe spaces. While many design theorists (Julier; Fuad-Luke; Clarke; Irwin et al.) have done important work to contextualise activist design as a broad movement with overlapping branches (social design, community design, eco-design, participatory design, critical design, and transition design etc.), the scope of our study takes ‘micro’ as a starting point. We focus on the kind of activism that takes shape in moments of careful design; these are moments when designers move politically, rather than necessarily within political movements. These microprotests respond to community needs through design more than they articulate a broad activist design movement. As such, the impacts of these microprotests often go unnoticed outside of the communities within which they take place. We propose, and test in this essay, a mode of analysis for design microprotests that takes design activism as a starting point but pays more attention to community and translation than designers and their global reach.In his analysis of design activism, Julier proposes “four possible conceptual tactics for the activist designer that are also to be found in particular qualities in the mainstream design culture and economy” (Julier, Introduction 149). We use two of these tactics to begin exploring a selection of attributes common to design microprotests: temporality – which describes the way that speed, slowness, progress and incompletion are dealt with; and territorialisation – which describes the scale at which responsibility and impact is conceived (227). In each of three projects to which we apply these tactics, one of us had a role as a visual communicator. As such, the research is framed by the knowledge creating paradigm described by Jonas as “research through design”.We also draw on other conceptualisations of design activism, and the rich design literature that has emerged in recent times to challenge the colonial legacies of design studies (Schultz; Tristan et al.; Escobar). Some analyses of design activism already focus on the micro or the minor. For example, in their design of social change within organisations as an experimental and iterative process, Lensjkold, Olander and Hasse refer to Deleuze and Guattari’s minoritarian: “minor design activism is ‘a position in co-design engagements that strives to continuously maintain experimentation” (67). Like minor activism, design microprotests are linked to the continuous mobilisation of actors and networks in processes of collective experimentation. However microprotests do not necessarily focus on organisational change. Rather, they create new (and often tiny) spaces of protest within which new voices can be heard and different kinds of listening can be done.In the first of our three cases, we discuss a representation of transdisciplinary listening. This piece of visual communication is a design microprotest in itself. This section helps to frame what we mean by a safe space by paying attention to the listening mode of communication. In the next sections we explore temporality and territorialisation through the design microprotests Just Spaces which documents the collective imagining of safe places for LBPQ (Lesbian, Bisexual, Pansexual, and Queer) women and non-binary identities through a series of graphic objects and Conversation Piece, a book written, designed and published over three days as a proposition for a collective future. A Representation of Transdisciplinary ListeningThe design artefact we present in this section is a representation of listening and can be understood as a microprotest emerging from a collective experiment that materialises firstly as a visual document asking questions of the visual communication discipline and its role in a research collaboration and also as a mirror for the interdisciplinary team to reflexively develop transdisciplinary perspectives on the risks associated with the release of environmental flows in the upper reaches of Hawkesbury Nepean River in NSW, Australia. This research project was funded through a Challenge Grant Scheme to encourage transdisciplinarity within the University. The project team worked with the Hawkesbury Nepean Catchment Management Authority in response to the question: What are the risks to maximising the benefits expected from increased environmental flows? Listening and visual communication design practice are inescapably linked. Renown American graphic designer and activist Sheila de Bretteville describes a consciousness and a commitment to listening as an openness, rather than antagonism and argument. Fiumara describes listening as nascent or an emerging skill and points to listening as the antithesis of the Western culture of saying and expression.For a visual communication designer there is a very specific listening that can be described as visual hearing. This practice materialises the act of hearing through a visualisation of the information or knowledge that is shared. This act of visual hearing is a performative process tracing the actors’ perspectives. This tracing is used as content, which is then translated into a transcultural representation constituted by the designerly act of perceiving multiple perspectives. The interpretation contributes to a shared project of transdisciplinary understanding.This transrepresentation (Fig. 1) is a manifestation of a small interaction among a research team comprised of a water engineer, sustainable governance researcher, water resource management researcher, environmental economist and a designer. This visualisation is a materialisation of a structured conversation in response to the question What are the risks to maximising the benefits expected from increased environmental flows? It represents a small contribution that provides an opportunity for reflexivity and documents a moment in time in response to a significant challenge. In this translation of a conversation as a visual representation, a design microprotest is made against reduction, simplification, antagonism and argument. This may seem intangible, but as a protest through design, “it involves the development of artifacts that exist in real time and space, it is situated within everyday contexts and processes of social and economic life” (Julier 226). This representation locates conversation in a visual order that responds to particular categorisations of the political, the institutional, the socio-economic and the physical in a transdisciplinary process that focusses on multiple perspectives.Figure 1: Transrepresentation of responses by an interdisciplinary research team to the question: What are the risks to maximising the benefits expected from increased environmental flows in the Upper Hawkesbury Nepean River? (2006) Just Spaces: Translating Safe SpacesListening is the foundation of design microprotest. Just Spaces emerged out of a collaborative listening project It’s OK! An Anthology of LBPQ (Lesbian, Bisexual, Pansexual and Queer) Women’s and Non-Binary Identities’ Stories and Advice. By visually communicating the way a community practices supportive listening (both in a physical form as a book and as an online resource), It’s OK! opens conversations about how LBPQ women and non-binary identities can imagine and help facilitate safe spaces. These conversations led to thinking about the effects of breaches of safe spaces on young LBPQ women and non-binary identities. In her book The Cultural Politics of Emotion, Sara Ahmed presents Queer Feelings as a new way of thinking about Queer bodies and the way they use and impress upon space. She makes an argument for creating and imagining new ways of creating and navigating public and private spaces. As a design microprotest, Just Spaces opens up Queer ways of navigating space through a process Ahmed describes as “the ‘non-fitting’ or discomfort .... an opening up which can be difficult and exciting” (Ahmed 154). Just Spaces is a series of workshops, translated into a graphic design object, and presented at an exhibition in the stairwell of the library at the University of Technology Sydney. It protests the requirement of navigating heteronormative environments by suggesting ‘Queer’ ways of being in and designing in space. The work offers solutions, suggestions, and new ways of doing and making by offering design methods as tools of microprotest to its participants. For instance, Just Spaces provides a framework for sensitive translation, through the introduction of a structure that helps build personas based on the game Dungeons and Dragons (a game popular among certain LGBTQIA+ communities in Sydney). Figure 2: Exhibition: Just Spaces, held at UTS Library from 5 to 27 April 2018. By focussing the design process on deep listening and rendering voices into visual translations, these workshops responded to Linda Tuhiwai Smith’s idea of the “outsider within”, articulating the way research should be navigated in vulnerable groups that have a history of being exploited as part of research. Through reciprocity and generosity, trust was generated in the design process which included a shared dinner; opening up participant-controlled safe spaces.To open up and explore ideas of discomfort and safety, two workshops were designed to provide safe and sensitive spaces for the group of seven LBPQ participants and collaborators. Design methods such as drawing, group imagining and futuring using a central prototype as a prompt drew out discussions of safe spaces. The prototype itself was a small folded house (representative of shelter) printed with a number of questions, such as:Our spaces are often unsafe. We take that as a given. But where do these breaches of safety take place? How was your safe space breached in those spaces?The workshops resulted in tangible objects, made by the participants, but these could not be made public because of privacy implications. So the next step was to use visual communication design to create sensitive and honest visual translations of the conversations. The translations trace images from the participants’ words, sketches and notes. For example, handwritten notes are transcribed and reproduced with a font chosen by the designer based on the tone of the comment and by considering how design can retain the essence of person as well as their anonymity. The translations focus on the micro: the micro breaches of safety; the interactions that take place between participants and their environment; and the everyday denigrating experiences that LBPQ women and non-binary identities go through on an ongoing basis. This translation process requires precise skills, sensitivity, care and deep knowledge of context. These skills operate at the smallest of scales through minute observation and detailed work. This micro-ness translates to the potential for truthfulness and care within the community, as it establishes a precedent through the translations for others to use and adapt for their own communities.The production of the work for exhibition also occurred on a micro level, using a Risograph, a screenprinting photocopier often found in schools, community groups and activist spaces. The machine (ME9350) used for this project is collectively owned by a co-op of Sydney creatives called Rizzeria. Each translation was printed only five times on butter paper. Butter paper is a sensitive surface but difficult to work with making the process slow and painstaking and with a lot of care.All aspects of this process and project are small: the pieced-together translations made by assembling segments of conversations; zines that can be kept in a pocket and read intimately; the group of participants; and the workshop and exhibition spaces. These small spaces of safety and their translations make possible conversations but also enable other safe spaces that move and intervene as design microprotests. Figure 3: Piecing the translations together. Figure 4: Pulling the translation off the drum; this was done every print making the process slow and requiring gentleness. This project was and is about slowing down, listening and visually translating in order to generate and imagine safe spaces. In this slowness, as Julier describes “...the activist is working in a more open-ended way that goes beyond the materialization of the design” (229). It creates methods for listening and collaboratively generating ways to navigate spaces that are fraught with micro conflict. As an act of territorialisation, it created tiny and important spaces as a design microprotest. Conversation Piece: A Fast and Slow BookConversation Piece is an experiment in collective self-publishing. It was made over three days by Frontyard, an activist space in Marrickville, NSW, involved in community “futuring”. Futuring for Frontyard is intended to empower people with tools to imagine and enact preferred futures, in contrast to what design theorist Tony Fry describes as “defuturing”, the systematic destruction of possible futures by design. Materialised as a book, Conversation Piece is also an act of collective futuring. It is a carefully designed process for producing dialogues between unlikely parties using an image archive as a starting point. Conversation Piece was designed with the book sprint format as a starting point. Founded by software designer Adam Hyde, book sprints are a method of collectively generating a book in just a few days then publishing it. Book sprints are related to the programming sprints common in agile software development or Scrum, which are often used to make FLOSS (Free and Open Source Software) manuals. Frontyard had used these techniques in a previous project to develop the Non Cash Arts Asset Platform.Conversation Piece was also modeled on two participatory books made during sprints that focussed on articulating alternative futures. Collaborative Futures was made during Transmediale in 2009, and Futurish: Thinking Out Loud about Futures (2015).The design for Conversation Piece began when Frontyard was invited to participate in the Hobiennale in 2017, a free festival emerging from the “national climate of uncertainty within the arts, influenced by changes to the structure of major arts organisations and diminishing funding opportunities.” The Hobiennale was the first Biennale held in Hobart, Tasmania, but rather than producing a standard large art survey, it focussed on artist-run spaces and initiatives, emergant practices, and marginalised voices in the arts. Frontyard is not an artist collective and does not work for commissions. Rather, the response to the invitation was based on how much energy there was in the group to contribute to Hobiennale. At Frontyard one of the ways collective and individual energy is accounted for is using spoon theory, a disability metaphor used to describe the planning that many people have to do to conserve and ration energy reserves in their daily lives (Miserandino). As outlined in the glossary of Conversation Piece, spoon theory is:A way of accounting for our emotional or physical energy and therefore our ability to participate in activities. Spoon theory can be used to collaborate with care and avoid guilt and burn out. Usually spoon theory is applied at an individual level, but it can also be used by organisations. For example, Hobiennale had enough spoons to participate in the Hobiennale so we decided to give it a go. (180)To make to book, Frontyard invited visitors to Hobiennale to participate in a series of open conversations that began with the photographic archive of the organisation over the two years of its existence. During a prototyping session, Frontyard designed nine diagrams that propositioned ways to begin conversations by combining images in different ways. Figure 5: Diagram 9. Conversation Piece: p.32-33One of the purposes of the diagrams, and the book itself, was to bring attention to the micro dynamics of conversation over time, and to create a safe space to explore the implications of these. While the production process and the book itself is micro (ten copies were printed and immediately given away), the decisions made in regards to licensing (a creative commons license is used), distribution (via the Internet Archive) and content generation (through participatory design processes) the project’s commitment to open design processes (Van Abel, Evers, Klaassen and Troxler) mean its impact is unpredictable. Counter-logical to the conventional copyright of books, open design borrows its definition - and at times its technologies and here its methods - from open source software design, to advocate the production of design objects based on fluid and shared circulation of design information. The tension between the abundance produced by an open approach to making, and the attention to the detail of relationships produced by slowing down and scaling down communication processes is made apparent in Conversation Piece:We challenge ourselves at Frontyard to keep bureaucratic processes as minimal an open as possible. We don’t have an application or acquittal process: we prefer to meet people over a cup of tea. A conversation is a way to work through questions. (7)As well as focussing on the micro dynamics of conversations, this projects protests the authority of archives. It works to dismantle the hierarchies of art and publishing through the design of an open, transparent, participatory publishing process. It offers a range of propositions about alternative economies, the agency of people working together at small scales, and the many possible futures in the collective imaginaries of people rethinking time, outcomes, results and progress.The contributors to the book are those in conversation – a complex networks of actors that are relationally configured and themselves in constant change, so as Julier explains “the object is subject to constant transformations, either literally or in its meaning. The designer is working within this instability.” (230) This is true of all design, but in this design microprotest, Frontyard works within this instability in order to redirect it. The book functions as a series of propositions about temporality and territorialisation, and focussing on micro interventions rather than radical political movements. In one section, two Frontyard residents offer a story of migration that also serves as a recipe for purslane soup, a traditional Portuguese dish (Rodriguez and Brison). Another lifts all the images of hand gestures from the Frontyard digital image archive and represents them in a photo essay. Figure 6: Talking to Rocks. Conversation Piece: p.143ConclusionThis article is an invitation to momentarily suspend the framing of design activism as a global movement in order to slow down the analysis of design protests and start paying attention to the brief moments and small spaces of protest that energise social change in design practice. We offered three examples of design microprotests, opening with a representation of transdisciplinary listening in order to frame design as a way if interpreting and listening as well as generating and producing. The two following projects we describe are collective acts of translation: small, momentary conversations designed into graphic forms that can be shared, reproduced, analysed, and remixed. Such protests have their limitations. Beyond the artefacts, the outcomes generated by design microprotests are difficult to identify. While they push and pull at the temporality and territorialisation of design, they operate at a small scale. How design microprotests connect to global networks of protest is an important question yet to be explored. The design practices of transdisciplinary listening, Queer Feelings and translations, and collaborative book sprinting, identified in these design microprotests change the thoughts and feelings of those who participate in ways that are impossible to measure in real time, and sometimes cannot be measured at all. Yet these practices are important now, as they shift the way designers design, and the way others understand what is designed. By identifying the common attributes of design microprotests, we can begin to understand the way necessary political conversations emerge in design practice, for instance about safe spaces, transdisciplinarity, and archives. Taking a research through design approach these can be understood over time, rather than just in the moment, and in specific territories that belong to community. They can be reconfigured into different conversations that change our world for the better. References Ahmed, Sara. “Queer Feelings.” The Cultural Politics of Emotion. Edinburgh: Edinburgh UP, 2004. 143-167.Clarke, Alison J. "'Actions Speak Louder': Victor Papanek and the Legacy of Design Activism." Design and Culture 5.2 (2013): 151-168.De Bretteville, Sheila L. Design beyond Design: Critical Reflection and the Practice of Visual Communication. Ed. Jan van Toorn. Maastricht: Jan van Eyck Akademie Editions, 1998. 115-127.Evers, L., et al. Open Design Now: Why Design Cannot Remain Exclusive. Amsterdam: BIS Publishers, 2011.Escobar, Arturo. Designs for the Pluriverse: Radical Interdependence, Autonomy, and the Making of Worlds. Duke UP, 2018.Fiumara, G.C. The Other Side of Language: A Philosophy of Listening. London: Routledge, 1995.Fuad-Luke, Alastair. Design Activism: Beautiful Strangeness for a Sustainable World. London: Routledge, 2013.Frontyard Projects. 2018. Conversation Piece. Marrickville: Frontyard Projects. Fry, Tony. A New Design Philosophy: An Introduction to Defuturing. Sydney: UNSW P, 1999.Hanna, Julian, Alkan Chipperfield, Peter von Stackelberg, Trevor Haldenby, Nik Gaffney, Maja Kuzmanovic, Tim Boykett, Tina Auer, Marta Peirano, and Istvan Szakats. Futurish: Thinking Out Loud about Futures. Linz: Times Up, 2014. Irwin, Terry, Gideon Kossoff, and Cameron Tonkinwise. "Transition Design Provocation." Design Philosophy Papers 13.1 (2015): 3-11.Julier, Guy. "From Design Culture to Design Activism." Design and Culture 5.2 (2013): 215-236.Julier, Guy. "Introduction: Material Preference and Design Activism." Design and Culture 5.2 (2013): 145-150.Jonas, W. “Exploring the Swampy Ground.” Mapping Design Research. Eds. S. Grand and W. Jonas. Basel: Birkhauser, 2012. 11-41.Kagan, S. Art and Sustainability. Bielefeld: Transcript, 2011.Lenskjold, Tau Ulv, Sissel Olander, and Joachim Halse. “Minor Design Activism: Prompting Change from Within.” Design Issues 31.4 (2015): 67–78. doi:10.1162/DESI_a_00352.Max-Neef, M.A. "Foundations of Transdisciplinarity." Ecological Economics 53.53 (2005): 5-16.Miserandino, C. "The Spoon Theory." <http://www.butyoudontlooksick.com>.Nicolescu, B. "Methodology of Transdisciplinarity – Levels of Reality, Logic of the Included Middle and Complexity." Transdisciplinary Journal of Engineering and Science 1.1 (2010): 19-38.Palmer, C., J. Gothe, C. Mitchell, K. Sweetapple, S. McLaughlin, G. Hose, M. Lowe, H. Goodall, T. Green, D. Sharma, S. Fane, K. Brew, and P. Jones. “Finding Integration Pathways: Developing a Transdisciplinary (TD) Approach for the Upper Nepean Catchment.” Proceedings of the 5th Australian Stream Management Conference: Australian Rivers: Making a Difference. Thurgoona, NSW: Charles Sturt University, 2008.Rodriguez and Brison. "Purslane Soup." Conversation Piece. Eds. Frontyard Projects. Marrickville: Frontyard Projects, 2018. 34-41.Schultz, Tristan, et al. "What Is at Stake with Decolonizing Design? A Roundtable." Design and Culture 10.1 (2018): 81-101.Smith, Linda Tuhiwai. Decolonising Methodologies: Research and Indigenous Peoples. New York: ZED Books, 1998. Van Abel, Bas, et al. Open Design Now: Why Design Cannot Remain Exclusive. Bis Publishers, 2014.Wing Sue, Derald. Microaggressions in Everyday Life: Race, Gender, and Sexual Orientation. London: John Wiley & Sons, 2010. XV-XX.

“The intellect must not only desire surreptitious delights; it must become completely free and celebrate Saturnalia.” (Nietzsche 6) Theory-jamming suggests an array of eclectic methods, deployed in response to emerging conditions, using traditional patterns to generate innovative moves, seeking harmony and syncopation, transparent about purpose and power, aiming for demonstrable certainties while aware of their own provisional fragility. In this paper, theory-jamming is suggested as an antidote for the confusion and disarray that typifies communication theory. Communication theory as the means to conceptualise the transmission of information and the negotiation of meaning has never been a stable entity. Entrenched divisions between ‘administrative’ and ‘critical’ tendencies are played out within schools and emerging disciplines and across a range of scientific/humanist, quantitative/qualitative and political/cultural paradigms. “Of course, this is only the beginning of the mischief for there are many other polarities at play and a host of variations within polar contrasts” (Dervin, Shields and Song). This paper argues that the play of contending schools with little purchase on each other, or anything much, has turned meta-discourse about communication into an ontological spiral. Perhaps the only way to ride out this storm is to look towards communication practices that confront these issues and appreciate their theoretical underpinnings. From its roots in jazz and blues to its contemporary manifestations in rap and hip-hop and throughout the communication industries, the jam (or improvised reorganisation of traditional themes into new and striking patterns) confronts the ontological spiral in music, and life, by taking the flotsam flung out of the spiral to piece together the means to transcend the downward pull into the abyss. Many pretenders have a theory. Theory abounds: language theory, number theory, game theory, quantum theory, string theory, chaos theory, cyber-theory, queer theory, even conspiracy theory and, most poignantly, the putative theory of everything. But since Bertrand Russell’s unsustainable class of all classes, Gödel’s systemically unprovable propositions and Heisenberger’s uncertainty principle, the propensity for theories to fall into holes in themselves has been apparent. Nowhere is this more obvious than in communication theory where many schools contend without actually connecting to each other. From the 1930s, as the mass media formed, there have been administrative and critical tendencies at war in the communication arena. Some point to the origins of the split in the Institute of Social Research’s Radio Project where pragmatic sociologist, Paul Lazarsfeld broke with Frankfurt School critical theorist, Theodor Adorno over the quality of data. Lazarsfeld was keen to produce results while Adorno complained the data over-simplified the relationship between mass media and audiences (Rogers). From this split grew the twin disciplines of mass communication (quantitative, liberal, commercial and lost in its obsession with the measurement of minor media effects) and cultural/media studies (qualitative, post-Marxist, radical and lost in simulacra of their own devising). The complexity of interactions between these two disciplines, with the same subject matter but very different ways of thinking about it, is the foundation of the ontological black hole in communication theory. As the disciplines have spread out across universities, professional organizations and publishers, they have been used and abused for ideological, institutional and personal purposes. By the summer of 1983, the split was documented in a special issue of the Journal of Communication titled “Ferment in the Field”. Further, professional courses in journalism, public relations, marketing, advertising and media production have complex relations with both theoretical wings, which need the student numbers and are adept at constructing and defending new boundaries. The 90s saw any number ‘wars’: Journalism vs Cultural Studies, Cultural Studies vs Cultural Policy Studies, Cultural Studies vs Public Relations, Public Relations vs Journalism. More recently, the study of new communication technologies has led to a profusion of nascent, neo-disciplines shadowing, mimicking and reacting with old communication studies: “Internet studies; New media studies; Digital media studies; Digital arts and culture studies; Cyberculture studies; Critical cyberculture studies; Networked culture studies; Informatics; Information science; Information society studies; Contemporary media studies” (Silver & Massanari 1). As this shower of cyberstudies spirals by, it is further warped by the split between the hard science of communication infrastructure in engineering and information technology and what the liberal arts have to offer. The early, heroic attempt to bridge this gap by Claude Shannon and, particularly, Warren Weaver was met with disdain by both sides. Weaver’s philosophical interpretation of Shannon’s mathematics, accommodating the interests of technology and of human communication together, is a useful example of how disparate ideas can connect productively. But how does a communications scholar find such connections? How can we find purchase amongst this avalanche of ideas and agendas? Where can we get the traction to move beyond twentieth century Balkanisation of communications theory to embrace the whole? An answer came to me while watching the Discovery Channel. A documentary on apes showed them leaping from branch to branch, settling on a swaying platform of leaves, eating and preening, then leaping into the void until they make another landing, settling again… until the next leap. They are looking for what is viable and never come to ground. Why are we concerned to ground theory which can only prove its own impossibility while disregarding the certainty of what is viable for now? I carried this uneasy insight for almost five years, until I read Nietzsche on the methods of the pre-Platonic philosophers: “Two wanderers stand in a wild forest brook flowing over rocks; the one leaps across using the stones of the brook, moving to and fro ever further… The other stands there helplessly at each moment. At first he must construct the footing that can support his heavy steps; when this does not work, no god helps him across the brook. Is it only boundless rash flight across great spaces? Is it only greater acceleration? No, it is with flights of fantasy, in continuous leaps from possibility to possibility taken as certainties; an ingenious notion shows them to him, and he conjectures that there are formally demonstrable certainties” (Nietzsche 26). Nietzsche’s advice to take the leap is salutary but theory must be more than jumping from one good idea to the next. What guidance do the practices of communication offer? Considering new forms that have developed since the 1930s, as communication theory went into meltdown, the significance of the jam is unavoidable. While the jam session began as improvised jazz and blues music for practice, fellowship and fun, it quickly became the forum for exploring new kinds of music arising from the deconstruction of the old and experimentation with technical, and ontological, possibilities. The jam arose as a spin-off of the dance music circuit in the 1930s. After the main, professional show was over, small groups would gather together in all-night dives for informal, spontaneous sessions of unrehearsed improvisation, playing for their own pleasure, “in accordance with their own esthetic [sic] standards” (Cameron 177). But the jam is much more than having a go. The improvisation occurs on standard melodies: “Theoretically …certain introductions, cadenzas, clichés and ensemble obbligati assume traditional associations (as) ‘folkways’… that are rarely written down but rather learned from hearing (“head jobs”)” (Cameron 178-9). From this platform of tradition, the artist must “imagine in advance the pattern which unfolds… select a part in the pattern appropriate to the occasion, instrument and personal abilities (then) produce startlingly distinctive sound patterns (that) rationalise the impossible.” The jam is founded on its very impossibility: “the jazz aesthetic is basically a paradox… traditionalism and the radical originality are irreconcilable” (Cameron 181). So how do we escape from this paradox, the same paradox that catches all communication theorists between the demands of the past and the impossibility of the future? “Experimentation is mandatory and formal rules become suspect because they too quickly stereotype and ossify” (Cameron 181). The jam seems to work because it offers the possibility of the impossible made real by the act of communication. This play between the possible and the impossible, the rumbling engine of narrative, is the dynamo of the jam. Theory-jamming seeks to activate just such a dynamo. Rather than having a group of players on their instruments, the communication theorist has access a range of theoretical riffs and moves that can be orchestrated to respond to the question in focus, to latest developments, to contradictions or blank spaces within theoretical terrains. The theory-jammer works to their own standards, turning ideas learned from others (‘head jobs’) into their own distinctive patterns, still reliant on traditional melody, harmony and syncopation but now bent, twisted and reorganised into an entirely new story. The practice of following old pathways to new destinations has a long tradition in the West as eclecticism, a Graeco-Roman, particularly Alexandrian, philosophical tradition from the first century BC to the end of the classical period. Typified by Potamo who “encouraged his pupils instead to learn from a variety of masters”, eclecticism sought the best from each school, “all that teaches righteousness combined, the complete eclectic unity” (Kelley 578). By selecting the best, most reasonable, most useful elements from existing philosophical beliefs, polymaths such as Cicero sought the harmonious solution of particular problems. We see something similar to eclecticism in the East in the practices of ‘wild fox zen’ which teaches liberation from conceptual fixation (Heine). The 20th century’s most interesting eclectic was probably Walter Benjamin whose method owes something to both scientific Marxism and the Jewish Kabbalah. His hero was the rag-picker who had the cunning to create life from refuse and detritus. Benjamin’s greatest work, the unfinished Arcades Project, sought to create history from the same. It is a collection of photos, ephemera and transcriptions from books and newspapers (Benjamin). The particularity of eclecticism may be contrasted with the claim to universality of syncretism, the reconciliation of disparate or opposing beliefs by melding together various schools of thought into a new orthodoxy. Theory-jammers are not looking for a final solution but rather they seek what will work on this problem now, to come to a provisional solution, always aware that other, better, further solutions may be ahead. Elements of the jam are apparent in other contemporary forms of communication. For example bricolage, the practice from art, culture and information systems, involves tinkering elements together by trial and error, in ways not originally planned. Pastiche, from literature to the movies, mimics style while creating a new message. In theatre and TV comedy, improvisation has become a style in itself. Theory-jamming has direct connections with brainstorming, the practice that originated in the advertising industry to generate new ideas and solutions by kicking around possibilities. Against the hyper-administration of modern life, as the disintegration of grand theory immobilises thinkers, theory-jamming provides the means to think new thoughts. As a political activist and communications practitioner in Australia over the last thirty years, I have always been bemused by the human propensity to factionalise. Rather than getting bogged down by positions, I have sought to use administrative structures to explore critical ideas, to marshal critical approaches into administrative apparatus, to weld together critical and administrative formations in ways useful to both sides, bust most importantly, in ways useful to human society and a healthy environment. I've been accused of selling-out by the critical camp and of being unrealistic by the administrative side. My response is that we have much more to learn by listening and adapting than we do by self-satisfied stasis. Five Theses on Theory-Jamming Eclecticism requires Ethnography: the eclectic is the ethnographer loose in their own mind. “The free spirit surveys things, and now for the first time mundane existence appears to it worthy of contemplation…” (Nietzsche 6). Enculturation and Enumeration need each other: qualitative and quantitative research work best when they work off each other. “Beginners learned how to establish parallels, by means of the Game’s symbols, between a piece of classical music and the formula for some law of nature. Experts and Masters of the Game freely wove the initial theme into unlimited combinations.” (Hesse) Ephemera and Esoterica tell us the most: the back-story is the real story as we stumble on the greatest truths as if by accident. “…the mind’s deeper currents often need to be surprised by indirection, sometimes, indeed, by treachery and ruse, as when you steer away from a goal in order to reach it more directly…” (Jameson 71). Experimentation beyond Empiricism: more than testing our sense of our sense data of the world. Communication theory extends from infra-red to ultraviolet, from silent to ultrasonic, from absolute zero to complete heat, from the sub-atomic to the inter-galactic. “That is the true characteristic of the philosophical drive: wonderment at that which lies before everyone.” (Nietzsche 6). Extravagance and Exuberance: don’t stop until you’ve got enough. Theory-jamming opens the possibility for a unified theory of communication that starts, not with a false narrative certainty, but with the gaps in communication: the distance between what we know and what we say, between what we say and what we write, between what we write and what others read back, between what others say and what we hear. References Benjamin, Walter. The Arcades Project. Cambridge, Mass: Harvard UP, 2002. Cameron, W. B. “Sociological Notes on the Jam Session.” Social Forces 33 (Dec. 1954): 177–82. Dervin, B., P. Shields and M. Song. “More than Misunderstanding, Less than War.” Paper at International Communication Association annual meeting, New York City, NY, 2005. 5 Oct. 2006 http://www.allacademic.com/meta/p13530_index.html>. “Ferment in the Field.” Journal of Communication 33.3 (1983). Heine, Steven. “Putting the ‘Fox’ Back in the ‘Wild Fox Koan’: The Intersection of Philosophical and Popular Religious Elements in The Ch’an/Zen Koan Tradition.” Harvard Journal of Asiatic Studies 56.2 (Dec. 1996): 257-317. Hesse, Hermann. The Glass Bead Game. Harmondsworth: Penguin, 1972. Jameson, Fredric. “Postmodernism, or the Cultural Logic of Late Capitalism.” New Left Review 146 (1984): 53-90. Kelley, Donald R. “Eclecticism and the History of Ideas.” Journal of the History of Ideas 62.4 (Oct. 2001): 577-592 Nietzsche, Friedrich. The Pre-Platonic Philosophers. Urbana: University of Illinois Press, 2001. Rogers, E. M. “The Empirical and the Critical Schools of Communication Research.” Communication Yearbook 5 (1982): 125-144. Shannon, C.E., and W. Weaver. The Mathematical Theory of Communication. Urbana: University of Illinois Press, 1949. Silver, David, Adrienne Massanari. Critical Cyberculture Studies. New York: NYU P, 2006. Citation reference for this article MLA Style Stockwell, Stephen. "Theory-Jamming: Uses of Eclectic Method in an Ontological Spiral." M/C Journal 9.6 (2006). echo date('d M. Y'); ?> <http://journal.media-culture.org.au/0612/09-stockwell.php>. APA Style Stockwell, S. (Dec. 2006) "Theory-Jamming: Uses of Eclectic Method in an Ontological Spiral," M/C Journal, 9(6). Retrieved echo date('d M. Y'); ?> from <http://journal.media-culture.org.au/0612/09-stockwell.php>.

IntroductionLike other forms of embodiment, pregnancy has increasingly become subject to representation and interpretation via digital technologies. Pregnancy and the unborn entity were largely private, and few people beyond the pregnant women herself had access to the foetus growing within her (Duden). Now pregnant and foetal bodies have become open to public portrayal and display (Lupton The Social Worlds of the Unborn). A plethora of online materials – websites depicting the unborn entity from the moment of conception, amateur YouTube videos of births, social media postings of ultrasounds and self-taken photos (‘selfies’) showing changes in pregnant bellies, and so on – now ensure the documentation of pregnant and unborn bodies in extensive detail, rendering them open to other people’s scrutiny. Other recent digital technologies directed at pregnancy include mobile software applications, or ‘apps’. In this article, we draw on our study involving a critical discourse analysis of a corpus of pregnancy-related apps offered in the two major app stores. In so doing, we discuss the ways in which pregnancy-related apps portray pregnant and unborn bodies. We place a particular focus on the ludification and gamification strategies employed to position pregnancy as a playful, creative and fulfilling experience that is frequently focused on consumption. As we will demonstrate, these strategies have wider implications for concepts of pregnant and foetal embodiment and subjectivity.It is important here to make a distinction between ludification and gamification. Ludification is a broader term than gamification. It is used in the academic literature on gaming (sometimes referred to as ‘ludology’) to refer to elements of games reaching into other aspects of life beyond leisure pursuits (Frissen et al. Playful Identities: The Ludification of Digital Media Cultures; Raessens). Frissen et al. (Frissen et al. "Homo Ludens 2.0: Play, Media and Identity") for example, claim that even serious pursuits such as work, politics, education and warfare have been subjected to ludification. They note that digital technologies in general tend to incorporate ludic dimensions. Gamification has been described as ‘the use of game design elements in non-game contexts’ (Deterding et al. 9). The term originated in the digital media industry to describe the incorporation of features into digital technologies that not explicitly designed as games, such as competition, badges, rewards and fun that engaged and motivated users to make them more enjoyable to use. Gamification is now often used in literatures on marketing strategies, persuasive computing or behaviour modification. It is an important element of ‘nudge’, an approach to behaviour change that involves persuasion over coercion (Jones, Pykett and Whitehead). Gamification thus differs from ludification in that the former involves applying ludic principles for reasons other than the pleasures of enjoying the game for their own sake, often to achieve objectives set by actors and agencies other than the gamer. Indeed, this is why gamification software has been described by Bogost (Bogost) as ‘exploitationware’. Analysing Pregnancy AppsMobile apps have become an important medium in contemporary digital technology use. As of May 2015, 1.5 million apps were available to download on Google Play while 1.4 million were available in the Apple App Store (Statista). Apps related to pregnancy are a popular item in app stores, frequently appearing on the Apple App Store’s list of most-downloaded apps. Google Play’s figures show that many apps directed at pregnant women have been downloaded hundreds of thousands, or even millions, of times. For example, ‘Pregnancy +’, ‘I’m Expecting - Pregnancy App’ and ‘What to Expect - Pregnancy Tracker’ have each been downloaded between one and five million times, while ‘My Pregnancy Today’ has received between five and ten million downloads. Pregnancy games for young girls are also popular. Google Play figures show that the ‘Pregnant Emergency Doctor’ game, for example, has received between one and five million downloads. Research has found that pregnant women commonly download pregnancy-related apps and find them useful sources of information and support (Hearn, Miller and Fletcher; Rodger et al.; Kraschnewski et al.; Declercq et al.; Derbyshire and Dancey; O'Higgins et al.). We conducted a comprehensive analysis of all pregnancy-related smartphone apps in the two major app stores, Apple App Store and Google Play, in late June 2015. Android and Apple’s iOS have a combined market share of 91 percent of apps installed on mobile phones (Seneviratne et al.). A search for all pregnancy-related apps offered in these stores used key terms such as pregnancy, childbirth, conception, foetus/fetus and baby. After eliminating apps listed in these searches that were clearly not human pregnancy-related, 665 apps on Google Play and 1,141 on the Apple App Store remained for inclusion in our study. (Many of these apps were shared across the stores.)We carried out a critical discourse analysis of these apps, looking closely at the app descriptions offered in the two stores. We adopted the perspective that sees apps, like any other form of media, as sociocultural artefacts that both draw on and reproduce shared norms, ideals, knowledges and beliefs (Lupton "Quantified Sex: A Critical Analysis of Sexual and Reproductive Self-Tracking Using Apps"; Millington "Smartphone Apps and the Mobile Privatization of Health and Fitness"; Lupton "Apps as Artefacts: Towards a Critical Perspective on Mobile Health and Medical Apps"). In undertaking our analysis of the app descriptions in our corpus, attention was paid to the title of each app, the textual accounts of its content and use and the images that were employed, such as the logo of the app and the screenshots that were used to illustrate its content and style. Our focus in this article is on the apps that we considered as including elements of entertainment. Pregnancy-related game apps were by far the largest category of the apps in our corpus. These included games for young girls and expectant fathers as well as apps for ultrasound manipulation, pregnancy pranks, foetal sex prediction, choosing baby names, and quizzes. Less obviously, many other apps included in our analysis offered some elements of gamification and ludification, and these were considered in our analysis. ‘Pregnant Adventures’: App Games for GirlsOne of the major genres of apps that we identified was games directed at young girls. These apps invited users to shop for clothes, dress up, give a new hair style, ‘make-over’ and otherwise beautify a pregnant woman. These activities were directed at the goal of improving the physical attractiveness and therefore (it was suggested) the confidence of the woman, who was presented as struggling with coming to terms with changes in her body during pregnancy. Other apps for this target group involved the player assuming the role of a doctor in conducting medical treatments for injured pregnant women or assisting the birth of her baby.Many of these games represented the pregnant woman visually as looking like an archetypal Barbie doll, with a wardrobe to match. One app (‘Barbara Pregnancy Shopping’) even uses the name ‘Barbara’ and the screenshots show a woman similar in appearance to the doll. Its description urges players to use the game to ‘cheer up’ an ‘unconfident’ Barbara by taking her on a ‘shopping spree’ for new, glamorous clothes ‘to make Barbara feel beautiful throughout her pregnancy’. Players may find ‘sparkly accessories’ as well for Barbara and help her find a new hairstyle so that she ‘can be her fashionable self again’ and ‘feel prepared to welcome her baby!’. Likewise, the game ‘Pregnant Mommy Makeover Spa’ involves players selecting clothes, applying beauty treatments and makeup and adding accessories to give a makeover to ‘Pregnant Princess’ Leila. The ‘Celebrity Mommy’s Newborn Baby Doctor’ game combines the drawcard of ‘celebrity’ with ‘mommy’. Players are invited to ‘join the celebrities in their pregnancy adventure!’ and ‘take care of Celebrity Mom during her pregnancy!’.An app by the same developer of ‘Barbara Pregnancy Shopping’ also offers ‘Barbara’s Caesarean Birth’. The app description claims that: ‘Of course her poor health doesn’t allow Barbara to give birth to her baby herself.’ It is up to players to ‘make everything perfect’ for Barbara’s caesarean birth. The screenshots show Barbara’s pregnant abdomen being slit open, retracted and a rosy, totally clean infant extracted from the incision, complete with blonde hair. Players then sew up the wound. A final screenshot displays an image of a smiling Barbara standing holding her sleeping, swaddled baby, with the words ‘You win’.Similar games involve princesses, mermaids, fairies and even monster and vampire pregnant women giving birth either vaginally or by caesarean. Despite their preternatural status, the monster and vampire women conform to the same aesthetic as the other pregnant women in these games: usually with long hair and pretty, made-up faces, wearing fashionable clothing even on the operating table. Their newborn infants are similarly uniform in their appearance as they emerge from the uterus. They are white-skinned, clean and cherubic (described in ‘Mommy’s Newborn Baby Princess’ as ‘the cutest baby you probably want’), a far cry from the squalling, squashed-faced infants smeared in birth fluids produced by the real birth process.In these pregnancy games for girls, the pain and intense bodily effort of birthing and the messiness produced by the blood and other body fluids inherent to the process of labour and birth are completely missing. The fact that caesarean birth is a major abdominal surgery requiring weeks of recovery is obviated in these games. Apart from the monsters and vampires, who may have green- or blue-hued skin, nearly all other pregnant women are portrayed as white-skinned, young, wearing makeup and slim, conforming to conventional stereotypical notions of female beauty. In these apps, the labouring women remain glamorous, usually smiling, calm and unsullied by the visceral nature of birth.‘Track Your Pregnancy Day by Day’: Self-Monitoring and Gamified PregnancyElements of gamification were evident in a large number of the apps in our corpus, including many apps that invite pregnant users to engage in self-tracking of their bodies and that of their foetuses. Users are asked to customise the apps to document their changing bodies and track their foetus’ development as part of reproducing the discourse of the miraculous nature of pregnancy and promoting the pleasures of self-tracking and self-transformation from pregnant woman to mother. When using the ‘Pregnancy+’ app, for example, users can choose to construct a ‘Personal Dashboard’ that includes details of their pregnancy. They can input their photograph, first name and their expected date of delivery so that that each daily update begins with ‘Hello [name of user], you are [ ] weeks and [ ] days pregnant’ with the users’ photograph attached to the message. The woman’s weight gain over time and a foetal kick counter are also included in this app. It provides various ways for users to mark the passage of time, observe the ways in which their foetuses change and move week by week and monitor changes in their bodies. According to the app description for ‘My Pregnancy Today’, using such features allows a pregnant woman to: ‘Track your pregnancy day by day.’ Other apps encourage women to track such aspects of physical activity, vitamin and fluid intake, diet, mood and symptoms. The capacity to visually document the pregnant user’s body is also a feature of several apps. The ‘Baby Bump Pregnancy’, ‘WebMD Pregnancy’, ‘I’m Expecting’,’iPregnant’ and ‘My Pregnancy Today’ apps, for example, all offer an album feature for pregnant bump photos taken by the user of herself (described as a ‘bumpie’ in the blurb for ‘My Pregnancy Today’). ‘Baby Buddy’ encourages women to create a pregnant avatar of themselves (looking glamorous, well-dressed and happy). Some apps even advise users on how they should feel. As a screenshot from ‘Pregnancy Tracker Week by Week’ claims: ‘Victoria, your baby is growing in your body. You should be the happiest woman in the world.’Just as pregnancy games for little girls portrayal pregnancy as a commodified and asetheticised experience, the apps directed at pregnant women themselves tend to shy away from discomforting fleshly realities of pregnant and birthing embodiment. Pregnancy is represented as an enjoyable and fashionable state of embodiment: albeit one that requires constant self-surveillance and vigilance.‘Hello Mommy!’: The Personalisation and Aestheticisation of the FoetusA dominant feature of pregnancy-related apps is the representation of the foetus as already a communicative person in its own right. For example, the ‘Pregnancy Tickers – Widget’ app features the image of a foetus (looking far more like an infant, with a full head of wavy hair and open eyes) holding a pencil and marking a tally on the walls of the uterus. The app is designed to provide various icons showing the progress of the user’s pregnancy each day on her mobile device. The ‘Hi Mommy’ app features a cartoon-like pink and cuddly foetus looking very baby-like addressing its mother from the womb, as in the following message that appears on the user’s smartphone: ‘Hi Mommy! When will I see you for the first time?’ Several pregnancy-tracking apps also allow women to input the name that they have chosen for their expected baby, to receive customised notifications of its progress (‘Justin is nine weeks and two days old today’).Many apps also incorporate images of foetuses that represent them as wondrous entities, adopting the visual style of 1960s foetal photography pioneer Lennart Nilsson, or what Stormer (Stormer) has referred to as ‘prenatal sublimity’. The ‘Pregnancy+’ app features such images. Users can choose to view foetal development week-by-week as a colourful computerised animation or 2D and 3D ultrasound scans that have been digitally manipulated to render them aesthetically appealing. These images replicate the softly pink, glowing portrayals of miraculous unborn life typical of Nilsson’s style.Other apps adopt a more contemporary aesthetic and allow parents to store and manipulate images of their foetal ultrasounds and then share them via social media. The ‘Pimp My Ultrasound’ app, for example, invites prospective parents to manipulate images of their foetal ultrasounds by adding in novelty features to the foetal image such as baseball caps, jewellery, credit cards and musical instruments. The ‘Hello Mom’ app creates a ‘fetal album’ of ultrasounds taken of the user’s foetus, while the ‘Ultrasound Viewer’ app lets users manipulate their 3/4 D foetal ultrasound images: ‘Have fun viewing it from every angle, rotating, panning and zooming to see your babies [sic] features and share with your family and friends via Facebook and Twitter! … Once uploaded, you can customise your scan with a background colour and skin colour of your choice’.DiscussionPregnancy, like any other form of embodiment, is performative. Pregnant women are expected to conform to norms and assumptions about their physical appearance and deportment of their bodies that expect them to remain well-groomed, fit and physically attractive without appearing overly sexual (Longhurst "(Ad)Dressing Pregnant Bodies in New Zealand: Clothing, Fashion, Subjectivities and Spatialities"; Longhurst "'Corporeographies’ of Pregnancy: ‘Bikini Babes'"; Nash; Littler). Simultaneously they must negotiate the burden of bodily management in the interests of risk regulation. They are expected to protect their vulnerable unborn from potential dangers by stringently disciplining their bodies and policing to what substances they allow entry (Lupton The Social Worlds of the Unborn; Lupton "'Precious Cargo': Risk and Reproductive Citizenship"). Pregnancy self-tracking apps enact the soft politics of algorithmic authority, encouraging people to conform to expectations of self-responsibility and self-management by devoting attention to monitoring their bodies and acting on the data that they generate (Whitson; Millington "Amusing Ourselves to Life: Fitness Consumerism and the Birth of Bio-Games"; Lupton The Quantified Self: A Sociology of Self-Tracking).Many commentators have remarked on the sexism inherent in digital games (e.g. Dickerman, Christensen and Kerl-McClain; Thornham). Very little research has been conducted specifically on the gendered nature of app games. However our analysis suggests that, at least in relation to the pregnant woman, reductionist heteronormative, cisgendered, patronising and paternalistic stereotypes abound. In the games for girls, pregnant women are ideally young, heterosexual, partnered, attractive, slim and well-groomed, before, during and after birth. In self-tracking apps, pregnant women are portrayed as ideally self-responsible, enthused about their pregnancy and foetus to the point that they are counting the days until the birth and enthusiastic about collecting and sharing details about themselves and their unborn (often via social media).Ambivalence about pregnancy, the foetus or impending motherhood, and lack of interest in monitoring the pregnancy or sharing details of it with others are not accommodated, acknowledged or expected by these apps. Acknowledgement of the possibility of pregnant women who are not overtly positive about their pregnancy or lack interest in it or who identify as transgender or lesbian or who are sole mothers is distinctly absent.Common practices we noted in apps – such as giving foetuses names before birth and representing them as verbally communicating with their mothers from inside the womb – underpin a growing intensification around the notion of the unborn entity as already an infant and social actor in its own right. These practices have significant implications for political agendas around the treatment of pregnant women in terms of their protection or otherwise of their unborn, and for debates about women’s reproductive rights and access to abortion (Lupton The Social Worlds of the Unborn; Taylor The Public Life of the Fetal Sonogram: Technology, Consumption and the Politics of Reproduction). Further, the gamification and ludification of pregnancy serve to further commodify the experience of pregnancy and childbirth, contributing to an already highly commercialised environment in which expectant parents, and particularly mothers, are invited to purchase many goods and services related to pregnancy and early parenthood (Taylor "Of Sonograms and Baby Prams: Prenatal Diagnosis, Pregnancy, and Consumption"; Kroløkke; Thomson et al.; Taylor The Public Life of the Fetal Sonogram: Technology, Consumption and the Politics of Reproduction; Thomas).In the games for girls we examined, the pregnant woman herself was a commodity, a selling point for the app. The foetus was also frequently commodified in its representation as an aestheticised entity and the employment of its image (either as an ultrasound or other visual representations) or identity to market apps such as the girls’ games, apps for manipulating ultrasound images, games for predicting the foetus’ sex and choosing its name, and prank apps using fake ultrasounds purporting to reveal a foetus inside a person’s body. As the pregnant user engages in apps, she becomes a commodity in yet another way: the generator of personal data that are marketable in themselves. In this era of the digital data knowledge economy, the personal information about people gathered from their online interactions and content creation has become highly profitable for third parties (Andrejevic; van Dijck). Given that pregnant women are usually in the market for many new goods and services, their personal data is a key target for data mining companies, who harvest it to sell to advertisers (Marwick).To conclude, our analysis suggests that gamification and ludification strategies directed at pregnancy and childbirth can serve to obfuscate the societal pressures that expect and seek to motivate pregnant women to maintain physical fitness and attractiveness, simultaneously ensuring that they protect their foetuses from all possible risks. In achieving both ends, women are encouraged to engage in intense self-monitoring and regulation of their bodies. These apps also reproduce concepts of the unborn entity as a precious and beautiful already-human. These types of portrayals have important implications for how young girls learn about pregnancy and childbirth, for pregnant women’s experiences and for concepts of foetal personhood that in turn may influence women’s reproductive rights and abortion politics.ReferencesAndrejevic, Mark. Infoglut: How Too Much Information Is Changing the Way We Think and Know. New York: Routledge, 2013. Print.Bogost, Ian. "Why Gamification Is Bullshit." The Gameful World: Approaches, Issues, Applications. Eds. Steffen Walz and Sebastian Deterding. Boston, MA: MIT Press, 2015. 65-80. Print.Declercq, E.R., et al. Listening to Mothers III: Pregnancy and Birth. New York: Childbirth Connection, 2013. Print.Derbyshire, Emma, and Darren Dancey. "Smartphone Medical Applications for Women's Health: What Is the Evidence-Base and Feedback?" International Journal of Telemedicine and Applications (2013).Deterding, Sebastian, et al. "From Game Design Elements to Gamefulness: Defining Gamification." Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments. ACM, 2011. Dickerman, Charles, Jeff Christensen, and Stella Beatríz Kerl-McClain. "Big Breasts and Bad Guys: Depictions of Gender and Race in Video Games." Journal of Creativity in Mental Health 3.1 (2008): 20-29. Duden, Barbara. Disembodying Women: Perspectives on Pregnancy and the Unborn. Trans. Lee Hoinacki. Cambridge, MA: Harvard University Press, 1993. Frissen, Valerie, et al. "Homo Ludens 2.0: Play, Media and Identity." Playful Identities: The Ludification of Digital Media Cultures. Eds. Valerie Frissen et al. Amsterdam: University of Amsterdam Press, 2015. 9-50. ———, eds. Playful Identities: The Ludification of Digital Media Cultures. Amsterdam: Amsterdam University Press, 2015. Hearn, Lydia, Margaret Miller, and Anna Fletcher. "Online Healthy Lifestyle Support in the Perinatal Period: What Do Women Want and Do They Use It?" Australian Journal of Primary Health 19.4 (2013): 313-18. Jones, Rhys, Jessica Pykett, and Mark Whitehead. "Big Society's Little Nudges: The Changing Politics of Health Care in an Age of Austerity." Political Insight 1.3 (2010): 85-87. Kraschnewski, L. Jennifer, et al. "Paging “Dr. Google”: Does Technology Fill the Gap Created by the Prenatal Care Visit Structure? Qualitative Focus Group Study with Pregnant Women." Journal of Medical Internet Research. 16.6 (2014): e147. Kroløkke, Charlotte. "On a Trip to the Womb: Biotourist Metaphors in Fetal Ultrasound Imaging." Women's Studies in Communication 33.2 (2010): 138-53. Littler, Jo. "The Rise of the 'Yummy Mummy': Popular Conservatism and the Neoliberal Maternal in Contemporary British Culture." Communication, Culture & Critique 6.2 (2013): 227-43. Longhurst, Robyn. "(Ad)Dressing Pregnant Bodies in New Zealand: Clothing, Fashion, Subjectivities and Spatialities." Gender, Place & Culture 12.4 (2005): 433-46. ———. "'Corporeographies’ of Pregnancy: ‘Bikini Babes'." Environment and Planning D: Society and Space 18.4 (2000): 453-72. Lupton, Deborah. "Apps as Artefacts: Towards a Critical Perspective on Mobile Health and Medical Apps." Societies 4.4 (2014): 606-22. ———. "'Precious Cargo': Risk and Reproductive Citizenship." Critical Public Health 22.3 (2012): 329-40. ———. The Quantified Self: A Sociology of Self-Tracking. Cambridge: Polity Press, 2016. ———. "Quantified Sex: A Critical Analysis of Sexual and Reproductive Self-Tracking Using Apps." Culture, Health & Sexuality 17.4 (2015): 440-53. ———. The Social Worlds of the Unborn. Houndmills: Palgrave Macmillan, 2013. Marwick, Alice. "How Your Data Are Being Deeply Mined." The New York Review of Books (2014). Millington, Brad. "Amusing Ourselves to Life: Fitness Consumerism and the Birth of Bio-Games." Journal of Sport & Social Issues 38.6 (2014): 491-508. ———. "Smartphone Apps and the Mobile Privatization of Health and Fitness." Critical Studies in Media Communication 31.5 (2014): 479-93. Nash, Meredith. Making 'Postmodern' Mothers: Pregnant Embodiment, Baby Bumps and Body Image. Houndmills: Palgrave Macmillan, 2013. O'Higgins, A., et al. "The Use of Digital Media by Women Using the Maternity Services in a Developed Country." Irish Medical Journal 108.5 (2015). Raessens, Joost. "Playful Identities, or the Ludification of Culture." Games and Culture 1.1 (2006): 52-57. Rodger, D., et al. "Pregnant Women’s Use of Information and Communications Technologies to Access Pregnancy-Related Health Information in South Australia." Australian Journal of Primary Health 19.4 (2013): 308-12. Seneviratne, Suranga, et al. "Your Installed Apps Reveal Your Gender and More!" Mobile Computing and Communications Review 18.3 (2015): 55-61. Statista. "Number of Apps Available in Leading App Stores as of May 2015." 2015. Stormer, Nathan. "Looking in Wonder: Prenatal Sublimity and the Commonplace 'Life'." Signs 33.3 (2008): 647-73. Taylor, Janelle. "Of Sonograms and Baby Prams: Prenatal Diagnosis, Pregnancy, and Consumption." Feminist Studies 26.2 (2000): 391-418. ———. The Public Life of the Fetal Sonogram: Technology, Consumption and the Politics of Reproduction. New Brunswick, NJ: Rutgers University Press, 2008. Thomas, Gareth M. "Picture Perfect: ‘4d’ Ultrasound and the Commoditisation of the Private Prenatal Clinic." Journal of Consumer Culture. Online first, 2015. Thomson, Rachel, et al. Making Modern Mothers. Bristol: Policy Press, 2011. Thornham, Helen. “'It's a Boy Thing'.” Feminist Media Studies 8.2 (2008): 127-42. Van Dijck, José. "Datafication, Dataism and Dataveillance: Big Data between Scientific Paradigm and Ideology." Surveillance & Society 12.2 (2014): 197-208. Whitson, Jennifer. "Gaming the Quantified Self." Surveillance & Society 11.1/2 (2013): 163-76.