Dissertations / Theses on the topic 'Multimodal technology'

To see the other types of publications on this topic, follow the link: Multimodal technology.

Create a spot-on reference in APA, MLA, Chicago, Harvard, and other styles

Select a source type:

Consult the top 50 dissertations / theses for your research on the topic 'Multimodal technology.'

Next to every source in the list of references, there is an 'Add to bibliography' button. Press on it, and we will generate automatically the bibliographic reference to the chosen work in the citation style you need: APA, MLA, Harvard, Chicago, Vancouver, etc.

You can also download the full text of the academic publication as pdf and read online its abstract whenever available in the metadata.

Browse dissertations / theses on a wide variety of disciplines and organise your bibliography correctly.

1

Schüssel, Felix [Verfasser]. "Multimodal input fusion for companion technology / Felix Schüssel." Ulm : Universität Ulm, 2018. http://d-nb.info/1154486818/34.

Full text
APA, Harvard, Vancouver, ISO, and other styles
2

Hewson, Emma Louise. "Multimodal interactions in a carbonated beverage system." Thesis, University of Nottingham, 2008. http://eprints.nottingham.ac.uk/11159/.

Full text
Abstract:
Predicting flavour perception is complicated by interactions occurring both within and across sensory modalities, but understanding these interactions and the resulting multimodal integration is crucial to the formulation of successful products. Despite the commercial appeal of carbonated soft drinks, few studies have examined the effects of tastant: aroma: carbonation interactions on sensory perception. To facilitate these investigations, a citrus flavoured model beverage was created containing ingredients common in commercial beverages; water, aroma volatiles, sugar (glucose or fructose; equi-sweet levels), and acid (citric and lactic acid; equi-sour levels). The complexity of the beverage was gradually increased (influence of carbonation and caffeine) until the model beverage contained elements capable of stimulating gustatory, olfactory and trigeminal systems. Samples, selected according to D-optimal designs, were evaluated instrumentally (APCI-MS measuring volatile release, rheological measures of viscosity), and sensorially (using a trained panel of assessors). Predictive polynomial models were generated from mean panel data to explain variations in the attributes as a function of the design factors. The model beverages provided evidence that multi-modal interactions occurred within this model beverage system. Increasing both sugars and acids resulted in an increase in perceived citrus flavour which was not related to any alteration in volatile release measured instrumentally. Intriguingly, glucose and fructose showed different flavour perception enhancement profiles despite being used at perceptually equi-sweet levels. This difference between the monosaccharides was also evident in the predictive models generated for mouthfeel attributes. 'Overall fizziness' was dependant only on carbonation level and unaffected by levels of tastants. However, varying levels of glucose impacted on 'tingling', a relationship not mimicked by fructose. Addition of carbonation increased perceived sourness, in agreement with previous literature, but results also demonstrated a suppressive effect on perceived sweetness. Interestingly, evaluation of non-caffeinated beverages revealed the perception of a bitter aftertaste, which was primarily driven by CO2 level, enhanced by citric acid, and suppressed by increasing sugar concentration. In caffeinated beverages, however, caffeine concentration was the main influence on 'bitterness' and 'bitter aftertaste' attributes. Despite beverage manufacturers including caffeine as 'flavouring' there was little evidence to suggest caffeine concentration modified perception of citrus flavour in this system. This project provides a comprehensive assessment of the sensory profile of a model carbonated beverage. Combining instrumental and sensorial analysis provided novel evidence of the influence of multi-modal interactions on sensory perception, and highlights the differential effects of two monosaccharides on several key sensory attributes.
APA, Harvard, Vancouver, ISO, and other styles
3

Heljedal, Martin. "Factors Influencing the Choice between Road and Multimodal Transportation." Licentiate thesis, Linköpings universitet, Kommunikations- och transportsystem, 2013. http://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-102169.

Full text
Abstract:
Non-sustainable transportation is a great part of the stress that human activities put on the environment. Road transportation constituted 74% of the total inland tonne-kilometres in the EU during 2009, to be compared to rail transportation at 15%. In Sweden the numbers are slightly more in favour of rail transportation, but still a small share despite the fact that the European Committee promotes sustainable modes of transport. To reduce the environmental impact from the transport sector, and be able to promote the use of sustainable transport modes, it is important to gain an understanding of why the modal balance is disposed this way. By case studies and a survey, four factors, viz costs, environmental impact, attitudes and risks, and their impact on the choice of mode of transportation for companies located in the vicinity of a rail terminal are studied. The results clearly show that the environmental impact of rail transportation is only a fraction of that of the road transportation and could possibly influence the choice of rail transportation in a positive way. However, rail transportation is less cost efficient, flexible and reliable and these aspects – despite the advantageous conditions in terms of infrastructure and geographical vicinity to a rail terminal – contribute to a negative bias towards rail transportation among companies in the study. Thus, the cost and attitudes factors counteract the choice of rail transportation. In addition, risks, as the final factor, also counteracts the choice, since it is found that respondents consider the risks of disturbances such as delays, theft and accidents to be important when considering mode of transportation and that rail transportation is viewed as lacking compared to road transportation. This thesis contributes to the existing theory about the costs-related issues and the environmental impact of rail transportation, as well as how companies with beneficial conditions to employ rail transportation consider the mode with regards to e.g. reliability and safety, and how these factors influence the modal choice among buyers of transportation services that are located close to a rail terminal. With this knowledge, policymakers are informed of which areas to concentrate taxes, subsidizations and information to. These things are in all probability necessary if a large scale modal shift is desired. The contribution of the effect a modal shift could have on the environmental impact of the transportation might make certain practitioners that compete on a market where a low environmental footprint is a strong competitive weapon to rethink their modal choice.

In the printed version is the Licentiate series number and ISSN is incorrect. In the electronic version is the correct series number changed to 1635 and the ISSN to the correct one.

APA, Harvard, Vancouver, ISO, and other styles
4

Birch, Dawn P. "Factors influencing academics' development of interactive multimodal technology-mediated distance higher education courses." Thesis, Queensland University of Technology, 2008. https://eprints.qut.edu.au/16698/1/Dawn_Birch_Thesis.pdf.

Full text
Abstract:
Advances in technology and the continued emergence of the Web as a major source of global information have encouraged tertiary educators to take advantage of this growing array of resources and move beyond traditional face-to-face and distance education correspondence modes toward a rich technology-mediated learning environment. Moreover, ready access to multimedia at the desk-top has provided an opportunity for educators to develop flexible, engaging and interactive learning resources incorporating multimedia and hypermedia. This study investigates pedagogical, individual and institutional factors influencing the adoption and integration of educational technology by academics at a regional Australian university for the purpose of developing interactive multimodal technology-mediated distance education courses. These courses include a range of multimodal learning objects and multiple representations of content in order to cater for different learning styles and modal preferences. The findings of this study revealed that a range of pedagogical, individual and institutional factors influence academics' development of interactive multimodal technology-mediated distance education courses. Implications for distance education providers and individual academics arising from these factors and subsequent recommendations are presented.
APA, Harvard, Vancouver, ISO, and other styles
5

Birch, Dawn P. "Factors influencing academics' development of interactive multimodal technology-mediated distance higher education courses." Queensland University of Technology, 2008. http://eprints.qut.edu.au/16698/.

Full text
Abstract:
Advances in technology and the continued emergence of the Web as a major source of global information have encouraged tertiary educators to take advantage of this growing array of resources and move beyond traditional face-to-face and distance education correspondence modes toward a rich technology-mediated learning environment. Moreover, ready access to multimedia at the desk-top has provided an opportunity for educators to develop flexible, engaging and interactive learning resources incorporating multimedia and hypermedia. This study investigates pedagogical, individual and institutional factors influencing the adoption and integration of educational technology by academics at a regional Australian university for the purpose of developing interactive multimodal technology-mediated distance education courses. These courses include a range of multimodal learning objects and multiple representations of content in order to cater for different learning styles and modal preferences. The findings of this study revealed that a range of pedagogical, individual and institutional factors influence academics' development of interactive multimodal technology-mediated distance education courses. Implications for distance education providers and individual academics arising from these factors and subsequent recommendations are presented.
APA, Harvard, Vancouver, ISO, and other styles
6

Hung, Hing-keung, and 孔慶強. "Learning with multimodal meaning representation : engaging students in creating video representation on community issues." Thesis, The University of Hong Kong (Pokfulam, Hong Kong), 2014. http://hdl.handle.net/10722/198842.

Full text
Abstract:
Triggered by the rapid development of information technology, the global teaching and learning environment is facing a revolutionary change in terms of the modes of communication. Since the advent of the first schools, verbal presentation and written text have been the dominant modes of teaching. However, as information technology becomes increasingly integrated in education—with the development of social network communication acting as a catalyst—students are communicating beyond the text mode to incorporate other visual elements, experiencing ‘multimodal communication’. New modes of communication between teachers and students are emerging to replace the once unique textual mode, both within and beyond school. Audio, pictures, symbols and gestures are widely used in the multimodal communication of meaning. Literacy, which is about ability in reading and writing, has gradually shifted towards the emerging multiliteracies. Given this growing use—supported by information technology—of multimodal communication among students, more research is needed to enhance our understanding of the learning processes involved. The objective of my thesis is to explore what and how students learn through multimodal meaning representation on community issues. The research focused in particular on 2007, a transitional year in the curriculum reform of Hong Kong’s secondary schools. During this time, the global social communication network was well used by youth in a local context, and it was found that students were able to create video artefacts including multimodal meaning representation of issues beyond the subject disciplines included in the curriculum reform. This research involved a multiple-case study of six Grade 10 students creating multimodal meaning representation of community issues in 2007, in preparation for a new core subject, “Liberal Studies”, prior to its implementation in the new Hong Kong senior secondary school curriculum in 2009. The Hong Kong Education Bureau introduced a new school-based assessment in the new curriculum, along with the written examination. It specified that each student must make an enquiry on community issues and submit an Independent Enquiry Study (IES) report, in either written or non-written mode such as a video artefact. By conducting participant observations of and in-depth interviews with the students and teachers involved, and applying multimodal analysis to the student video artefacts, the research found that students had learnt through multimodal meaning representation. The findings have helped to conceptualise a new learning framework beyond traditional literacy learning at school. The results have implications for further understanding of how students learn with multimodal meaning representation, and add value to the curriculum reform by incorporating innovative pedagogy in engaging student learning through creating video artefacts on community issues beyond the traditional subject-based curriculum. It is argued that traditional literacy might not be the only condition for the development of multiliteracies, and that the use of multimodal representation will facilitate the development of multiliteracies. Overall, students will learn about topics related to community issues by creating video artefacts with multimodal meaning representation to explain the issues, and at the same time they will develop important thinking skills related to the 21st century.
published_or_final_version
Education
Doctoral
Doctor of Philosophy
APA, Harvard, Vancouver, ISO, and other styles
7

Ferguson, Ralph. "Multimodal Literacy as a form of Communication : What is the state of the students at Dalarna University multimodal literacy?" Thesis, Högskolan Dalarna, Ljud- och musikproduktion, 2015. http://urn.kb.se/resolve?urn=urn:nbn:se:du-16835.

Full text
Abstract:
Literacy is an invaluable asset to have, and has allowed for communication, documentation and the spreading of ideas since the beginning of the written language. With technological advancements, and new possibilities to communicate, it is important to question the degree to which people’s abilities to utilise these new methods have developed in relation to these emerging technologies. The purpose of this bachelor’s thesis is to analyse the state of students’ at Dalarna University mulitimodal literacy, as well as their experience of multimodality in their education. This has led to the two main research questions: What is the state of the students at Dalarna University multimodal literacy? And: How have the students at Dalarna University experienced multimodality in education? The paper is based on a mixed-method study that incorporates both a quantitative and qualitative aspect to it. The main thrust of the research paper is, however, based on a quantitative study that was conducted online and emailed to students via their program coordinators. The scope of the research is in audio-visual modes, i.e. audio, video and images, while textual literacy is presumed and serves as an inspiration to the study. The purpose of the study is to analyse the state of the students’ multimodal literacy and their experience of multimodality in education. The study revealed that the students at Dalarna University have most skill in image editing, while not being very literate in audio or video editing. The students seem to have had mediocre experience creating meaning through multimodality both in private use and in their respective educational institutions. The study also reveals that students prefer learning by means of video (rather than text or audio), yet are not able to create meaning (communicate) through it.
APA, Harvard, Vancouver, ISO, and other styles
8

Smith, Mandy Beth. "How students use multimodal composition to write about communities." Columbus, Ohio : Ohio State University, 2008. http://rave.ohiolink.edu/etdc/view?acc%5Fnum=osu1211985069.

Full text
APA, Harvard, Vancouver, ISO, and other styles
9

Burström, Johan. "A Multimodal Approach to Autonomous Document Categorization Using Convolutional Neural Networks." Thesis, Umeå universitet, Institutionen för datavetenskap, 2018. http://urn.kb.se/resolve?urn=urn:nbn:se:umu:diva-156289.

Full text
Abstract:
When international students apply for the Swedish educational system, they send documents to verify their merits. These documents are categorized and evaluated by administrators. This thesis approach the problem of document classification with a multimodal convolutional network. By looking at both image and text features together, it is examined if the classification is better than any of the sources alone. The best result for single source classification was when the input was text at 85.2% accuracy, this was topped by the multimodal approach with a accuracy of 88.4%.This thesis concludes that there is a gain in accuracy when using a multimodal approach.
APA, Harvard, Vancouver, ISO, and other styles
10

Kadić, Amir, and Arta Javadi. "Multimodal interaktion : som stöd för rehabilitering av Parkinsonpatienter." Thesis, Högskolan i Borås, Institutionen Handels- och IT-högskolan, 2012. http://urn.kb.se/resolve?urn=urn:nbn:se:hb:diva-16614.

Full text
Abstract:
Det finns ett behov inom vårdsektorn att på ett mera effektivt sätt kunna bedöma om patienter med Parkinsons sjukdom har rätt medicinering. Behovet ligger i att se om det är möjligt att med hjälp av ett IT-system kunna göra bedömningen på distans och på så sätt effektivisera processen.I och med att Parkinsonpatienter har symptom som t.ex. överrörlighet är inte traditionella lösningar med styrenheter såsom mus och tangentbord lämpliga. Istället har ett användargränssnitt baserat på multimodal interaktion utformats, där användaren interagerar med systemet genom röststyrning och rörelseigenkänning.Detta har gjorts med hjälp av Microsofts Kinect kamera, som är ett verktyg som möjliggör bredare och mer betydelsefull multimodal interaktion mellan människa och dator. Design av gränssnittet har gjorts efter etablerade designprinciper där användbarhet har legat i fokus. Även empiriska undersökningar har genomförts för att skapa en bredare förståelse för hur ett gränssnitt bör utformas för att bli användbart.Resultatet visar att grundprinciperna för ett användbart gränssnitt är väldigt lika oavsett om interaktionen sker på ett traditionellt sätt eller genom nyare teknik som t.ex. röst- och rörelsestyrning. Nyckelaspekter är att systemet ska vara effektivt, lätt att lära sig och förstå, samt att fel ska hanteras på ett korrekt sätt.Utifrån teorin och de empiriska undersökningarna har ett antal riktlinjer tagits fram för utformning av ett användbart multimodalt gränssnitt. Teorierna har även testats mot verkligheten genom en prototyp som använder sig av röst- och rörelsestyrning.
Program: Systemvetarutbildningen
APA, Harvard, Vancouver, ISO, and other styles
11

Hall, Matthew. "Designing is learning| An investigation of designing multimodal texts." Thesis, New York University, 2013. http://pqdtopen.proquest.com/#viewpdf?dispub=3599872.

Full text
Abstract:

This qualitative study analyzed the meaning-making practices of urban adolescents participating in a college preparatory program featuring philosophical inquiry into cosmopolitanism and the creation of multimodal texts. In contrast to studies of composing that focus on individual outcomes, this dissertation traced group meaning making. The study was grounded in sociocultural perspectives that theorize literacy as diverse, socially constructed, meaning-making practices that emerge in particular cultural and social contexts, and include multiple modes of communication. Data included interviews, observations, and artifacts. To analyze the data, a music-inspired analytic system was devised to examine the collaborative nature of composing.

The study demonstrated, first, that composing in this setting was a collaborative process exceeding customary understandings of collaborative composing. Uncovered after examining complex patterns of interactions over varied timescales, collaboration at the group level occurred while community members created individual products. Second, the study revealed that improvisation was an important strategy for shaping the content of this collaborative process. During informal jam sessions, participants creatively explored options for representing content. They actively built upon ideas offered by other participants in the moment, in order to read, interpret, select, and design the content of their multimodal texts. Last, facilitated by the complex patterns of interaction and shaped by the improvised frames for representing content, this study revealed the ways in which participants constructed a shared meaning of the concept of cosmopolitanism at the group level. Utilizing an image-afforded exploration of juxtaposition, this shared understanding evolved from early conceptions of cosmopolitanism as represented in juxtaposed images to an understanding of cosmopolitanism as the act of creating and interpreting juxtaposition between varying perspectives.

This study contributes to growing empirical research on meaning making through multimodal text design. It extends socio-cultural explanations of what counts as `social' in educational contexts, illustrating that composing is not just influenced by social interaction but rather is social. Finally, in an age of standards, testing, and accountability that can narrow what constitutes valued literacy practices, this study provides an example of the varied interactional paths and diverse compositional strategies and products that can engage learners and expand opportunities for meaning making.

APA, Harvard, Vancouver, ISO, and other styles
12

Zakaria, Zulina. "Framework for designing regional planning architecture for APTS-enabled regional multimodal public transportation system." Thesis, Massachusetts Institute of Technology, 2004. http://hdl.handle.net/1721.1/32272.

Full text
Abstract:
Thesis (S.M.)--Massachusetts Institute of Technology, Engineering Systems Division, Technology and Policy Program, 2004.
Includes bibliographical references (leaves 100-101).
Unsustainable transportation systems have been the cause of many problems facing urban areas around the world. Lack of regard for sustainable development considerations by those responsible for planning and implementing transportation systems has caused unhealthy air quality, noise pollution, traffic congestion, loss of green spaces and biodiversity, disruption of neighborhoods, equity problems, resource use etc. Many factors could potentially cause unsustainable transportation systems to persist. Transportation planning and decision-making is crucial in determining the structure and operation of transportation systems and hence also its sustainability. This thesis explores the idea of transportation planning institutions with the capability to design and implement sustainable transportation systems and how these institutions can be developed. The Regional Strategic Transportation Planning/CLIOS Process and Regional Planning Architecture Protocol were combined to form a Regional Planning Architecture Strategic Design Framework. To illustrate the use of the framework, it was applied in developing a RPA for planning a sustainable APTS-enabled regional multimodal public transportation system for the rapidly developing Kuala Lumpur Metropolitan Region in Malaysia.
by Zulina Zakaria.
S.M.
APA, Harvard, Vancouver, ISO, and other styles
13

Rossiter, James. "Multimodal intent recognition for natural human-robotic interaction." Thesis, University of Birmingham, 2011. http://etheses.bham.ac.uk//id/eprint/1469/.

Full text
Abstract:
The research questions posed for this work were as follows: Can speech recognition and techniques for topic spotting be used to identify spoken intent in unconstrained natural speech? Can gesture recognition systems based on statistical speech recognition techniques be used to bridge the gap between physical movements and recognition of gestural intent? How can speech and gesture be combined to identify the overall communicative intent of a participant with better accuracy than recognisers built for individual modalities? In order to answer these questions a corpus collection experiment for Human-Robotic Interaction was designed to record unconstrained natural speech and 3 dimensional motion data from 17 different participants. A speech recognition system was built based on the popular Hidden Markov Model Toolkit and a topic spotting algorithm based on usefulness measures was designed. These were combined to create a speech intent recognition system capable of identifying intent given natural unconstrained speech. A gesture intent recogniser was built using the Hidden Markov Model Toolkit to identify intent directly from 3D motion data. Both the speech and gesture intent recognition systems were evaluated separately. The output from both systems were then combined and this integrated intent recogniser was shown to perform better than each recogniser separately. Both linear and non-linear methods of multimodal intent fusion were evaluated and the same techniques were applied to the output from individual intent recognisers. In all cases the non-linear combination of intent gave the highest performance for all intent recognition systems. Combination of speech and gestural intent scores gave a maximum classification performance of 76.7% of intents correctly classified using a two layer Multi-Layer Perceptron for non-linear fusion with human transcribed speech input to the speech classifier. When compared to simply picking the highest scoring single modality intent, this represents an improvement of 177.9% over gestural intent classification, 67.5% over a human transcription of speech based speech intent classifier and 204.4% over an automatically recognised speech based speech intent classifier.
APA, Harvard, Vancouver, ISO, and other styles
14

Toney, Jennifer L. Toney. "Third Grade Students Literacy Practices As They Compose Multimodal Texts In A Digital Writing Workshop." Kent State University / OhioLINK, 2017. http://rave.ohiolink.edu/etdc/view?acc_num=kent1508600000499313.

Full text
APA, Harvard, Vancouver, ISO, and other styles
15

Appelstål, Michael. "Multimodal Model for Construction Site Aversion Classification." Thesis, Uppsala universitet, Institutionen för informationsteknologi, 2020. http://urn.kb.se/resolve?urn=urn:nbn:se:uu:diva-421011.

Full text
Abstract:
Aversion on construction sites can be everything from missingmaterial, fire hazards, or insufficient cleaning. These aversionsappear very often on construction sites and the construction companyneeds to report and take care of them in order for the site to runcorrectly. The reports consist of an image of the aversion and atext describing the aversion. Report categorization is currentlydone manually which is both time and cost-ineffective. The task for this thesis was to implement and evaluate an automaticmultimodal machine learning classifier for the reported aversionsthat utilized both the image and text data from the reports. Themodel presented is a late-fusion model consisting of a Swedish BERTtext classifier and a VGG16 for image classification. The results showed that an automated classifier is feasible for thistask and could be used in real life to make the classification taskmore time and cost-efficient. The model scored a 66.2% accuracy and89.7% top-5 accuracy on the task and the experiments revealed someareas of improvement on the data and model that could be furtherexplored to potentially improve the performance.
APA, Harvard, Vancouver, ISO, and other styles
16

Rudqwist, Lucas, and Max Magnusson. "Framtidens reseplanerare : Hur man designar en mobil, dynamisk & multimodal reseplanerare." Thesis, KTH, Skolan för datavetenskap och kommunikation (CSC), 2016. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-188828.

Full text
Abstract:
Detta arbete tar en titt in i framtidens möjligheter för mobila, dynamiska och multimodala reseplanerare. Detta genom att ställa frågorna: Hur kan en multimodal reseplaneringstjänst med data och information från befintliga resurser se ut och fungera i Stockholms län? Hur designar man en väl fungerande mobil resetjänst som förmedlar dynamiska multimodala transportvägar med god användbarhet? Vilken information och vilka system finns tillgängliga öppet och vilken information måste framtidens reseplanerare själv skapa? Genom skapandet av prototyper och användartester i tre steg knyter vi samman tidigare genomförd forskning med den faktiska data och information som finns tillgängligt öppen i Stockholms län. Detta för att visa hur framtidens reseplanerare kan komma att se ut och fungera. Den slutgiltiga designen visar hur morgondagens reseplanerare sömlöst och enkelt kommer kunna guida användaren att resa multimodalt genom att koppla ihop flera olika trafikinformationssystem, elektroniska betalsystem och smarta mobiltelefoners inbyggda resurser (så som t.ex. dess GPS/A-GPS). Som komplement till designförslaget presenterar vi de tre komponenterna som, enligt vår studie, är mest kritiska för att lyckas med framtidens reseplanerare.
This thesis takes a look at the future of mobile, dynamic and multimodal travel planners by asking the questions: How can a multimodal travel planner with data and information from existing resources be designed and function in Stockholm County? How do you design a well-functioning mobile travel planner that delivers dynamic multimodal travel with high usability? What information and what systems are publicly accessible today and what information must the future travel planner create by itself? By creating prototypes and by usability testing in three steps we tie previous research together with available data and information publicly accessible in Stockholm County. The goal of this is to show how a future travel planner can look and work. The final design of the travel planner of tomorrow shows how seamless and simple it will be to guide the user to multimodal travel. All this by connecting traffic information systems, electronic payment methods and smartphones built in resources (e.g. its GPS/A-GPS). As a complement to the design we present three key components that, according to this study, are the most critical to succeed with a future travel planner.
APA, Harvard, Vancouver, ISO, and other styles
17

Purdon, Patrick L. (Patrick Lee) 1974. "Multimodal neuroimaging with simultaneous electroencephalogram and high-field functional magnetic resonance imaging." Thesis, Massachusetts Institute of Technology, 2005. http://hdl.handle.net/1721.1/33074.

Full text
Abstract:
Thesis (Ph. D.)--Harvard-MIT Division of Health Sciences and Technology, 2005.
Includes bibliographical references.
Simultaneous recording of electroencephalogram (EEG) and functional magnetic resonance imaging (tMRI) is an important emerging tool in functional neuroimaging with the potential to reveal new mechanisms for brain function by combining the high spatial resolution of fMRI with the high temporal resolution of EEG. Applications for this technique include studies of sleep, epilepsy, and anesthesia, as well as basic sensory, perceptual, and cognitive processes. Unlike methods that combine these modalities from separate recordings, simultaneous recordings can reveal temporal correlations between EEG and fMRI. Simultaneous recordings also eliminate environmental confounds inherent with separate recordings. MRI systems produce electromagnetic interference that can corrupt sensitive electrophysiological recordings, making simultaneous recordings challenging. Gradient switching and RF pulses can saturate EEG amplifiers, and cardiac pulsation within the static magnetic field produces large artifact signals ("ballistocardiogram") that confound EEG analysis. In this Ph.D. thesis, we develop an EEG acquisition system compatible with fMRI at 3 and 7 Tesla, a method for eliminating the ballistocardiogram artifact using adaptive filtering, and use these methods to study the 40-Hz auditory steady-state response (ASSR). The adaptive filtering method outperforms existing standard methods by up to 600%. The ASSR is a sub-microvolt level auditory evoked potential related to sleep, consciousness, and anesthesia.
(cont.) Simultaneous recordings of ASSR and fMRI reveal that spontaneous fluctuations in the amplitude of the ASSR are represented throughout the auditory system, from cortex to brainstem, suggesting that brainstem structures play an important role in generating the 40-Hz ASSR and that integration of sensory information across multiple hierarchical scales, including the earliest portions of the central nervous system, may constitute an important component of awareness or arousal.
by Patrick L. Purdon.
Ph.D.
APA, Harvard, Vancouver, ISO, and other styles
18

Parker, Beard Jeannie C. Ph D. "Composing on the Screen: Student Perceptions of Traditional and Multimodal Composition." Digital Archive @ GSU, 2012. http://digitalarchive.gsu.edu/english_diss/98.

Full text
Abstract:
When college composition teachers carefully consider the role and function of multimodal composition in their classrooms, they can enhance the teaching of writing and communication, engage and empower students, and better prepare students for the challenges and possibilities of life in our rapidly changing digital age. To meet this teaching challenge and study the impact of multimedia on student writers, I designed this mixed-methods case study to examine how video documentary essays function as a form of multimodal composition in first-year composition courses and how these types of texts may enhance the teaching of traditional composition skills, as well as contribute to the academic and professional communication skills of students. The study was designed to determine how students react to multimodal composition and how they view the benefits as well as pitfalls of composing new kinds of texts in their first-year writing courses. This teacher research was conducted at a mid-sized, urban community college located in southern Tennessee. I used surveys, interviews and reflection essays to collect the data from student participants. I then analyzed the collected data for this project. My conclusions are that students learn valuable skills in the multimodal composition process, such as organization and time management, in addition to learning how to use movie-making software. Students also develop a keener sense of audience and purpose when they compose video documentary essays. Multimodal composition can be used to teach traditional writing and rhetoric. Multimodal composition can be used to enhance the teaching of writing and communication, engage and empower students to participate in convergence culture, and better prepare them for the challenges and possibilities of life in our rapidly changing digital age.
APA, Harvard, Vancouver, ISO, and other styles
19

Olofsson, Malin, and Hampus Söderberg. "Investigating Hand Gestures as Additional Input in a Multimodal Input Interface." Thesis, Malmö högskola, Fakulteten för kultur och samhälle (KS), 2013. http://urn.kb.se/resolve?urn=urn:nbn:se:mau:diva-22973.

Full text
Abstract:
At the time of writing, touch is revolutionizing the market with devices that have touch as the primary input modality. In this thesis we have been able to explore how another input modality, touchless, can complement touch in everyday applications. Touchless refers to an input method that is able to recognize hand gestures and act upon them. To investigate how these two input modalities can be combined, an Android prototype application featuring both touch and touchless was created. We chose to create a recipe reader because we found that a lot of people can relate to having soggy hands in the kitchen. The outcome of this thesis is assembled to form design principles that we find worthy to consider when designing multimodal input interfaces that includes both touch and touchless.
APA, Harvard, Vancouver, ISO, and other styles
20

Steiner, Lindsay B. "The Available Means of Design: A Rhetorical Investigation of Professional Multimodal Composition." Kent State University / OhioLINK, 2013. http://rave.ohiolink.edu/etdc/view?acc_num=kent1374244511.

Full text
APA, Harvard, Vancouver, ISO, and other styles
21

Kadner, Kay. "Erweiterung einer Komponentenplattform zur Unterstützung multimodaler Anwendungen mit föderierten Endgeräten." Doctoral thesis, Saechsische Landesbibliothek- Staats- und Universitaetsbibliothek Dresden, 2008. http://nbn-resolving.de/urn:nbn:de:bsz:14-ds-1215608960958-10148.

Full text
Abstract:
Zur Erledigung einer Aufgabe kann der Benutzer mit verschiedenen Endgeräten interagieren, welche unterschiedliche Interaktionsarten (Modalitäten) anbieten. Dabei gibt es jedoch kein Endgerät, welches alle erdenkbaren Modalitäten unterstützt. Aus diesem Grund wird eine komponentenbasierte Integrationsschicht auf Basis einer Komponentenplattform entwickelt, die dem Nutzer die gewünschte Freiheit bei der Wahl der Endgeräte und somit der Modalitäten ermöglicht. Als Ausgangsbasis dafür dient das W3C Multimodal Interaction Framework. Mit Hilfe der Integrationsschicht kann der Nutzer beispielsweise Endgeräteföderationen erzeugen, die einzeln oder gemeinsam zur Interaktion verwendet werden können. Die Integrationsschicht besitzt verschiedene Konzepte, um z.B. Geschäftslogik zur Laufzeit zu verteilen, Komponentenausfälle zu behandeln und die auf verschiedene Endgeräte verteilte Nutzerschnittstelle zu synchronisieren. Die entwickelten Konzepte wurden prototypisch implementiert, validiert und auf Performanz untersucht.
APA, Harvard, Vancouver, ISO, and other styles
22

Liu, Ariel. "The relationship between engagement and learning in school students' interactions with technology-driven multimodal exhibits in museums." Thesis, University of Oxford, 2012. http://ora.ox.ac.uk/objects/uuid:5c8405d5-a834-4b0f-b160-56c988f452f8.

Full text
Abstract:
This thesis reports a qualitative study of the use of multimodal technologies in museums— specifically, it examines the relationship between visitor engagement and learning, focusing on the use of multimodal technologies during school trips. The study was conducted in the Natural History Museum and the Churchill Museum, both in London, with participants from several secondary schools. These sites were chosen due to their concern for the added value of learning and public engagement, including their education-orientated investments in technology, museum activities, and architecture. In the course of data collection, visits were made to six schools and both museum sites; the participants included 117 students, 18 teachers, three museum educators, and eight museum curators and media designers. The study used a combination of video data analysis, stimulated recall interviews, document analysis, and engaging students in talk and reflection about their visit both at the museum and afterwards. The qualitative approach and multimodal analysis identify how the students’ social interactions help them construct learning through decontextualised bodily movements, which trigger contextualised discussion. The study demonstrates how multimodal analysis can be used in research to capture a wide scope of information, while maintaining a micro-level of analysis and understanding—here, capturing the detail of students’ interactions and perceptions. The findings suggest that the learning experience in museums is produced through multiple layers of interaction and through the exchange of physical and psychological behaviour among people, resources, and space. Here, the multimodal technologies with which the students engaged essentially acted as initial platforms for sensory stimuli and social interaction, supporting their peer communication and motivating them to further explore both the given topic and their own understanding of their learning methods. It was the students’ further conversation, observation, and participation, however, that created a more meaningful and entertaining learning experience in the museums.
APA, Harvard, Vancouver, ISO, and other styles
23

Adame, Andre. "Fully Immersed, Fully Present: Examining the User Experience Through the Multimodal Presence Scale and Virtual Reality Gaming Variables." CSUSB ScholarWorks, 2019. https://scholarworks.lib.csusb.edu/etd/918.

Full text
Abstract:
Over the past few years, video games have served as a catalyst for virtual reality (VR) technology to become more accessible to the average consumer, resulting in an increased interest in VR’s potential applications across several disciplines. To best capitalize on these applications, however, researchers require a thorough understanding of the user’s experience in virtual environments. And while many studies on VR experiences tend to focus on presence, video games offer another angle of approach: immersion. This study uses both qualitative and quantitative methods to examine the relationships between the VR experience of presence and the gaming experience of immersion. First, a focus group of individuals with VR gaming experience explored variables impacting presence. Then a survey questionnaire consisting of items from the multimodal presence scale (MPS), Jennett et al.’s (2008) immersion questionnaire, and the focus group was distributed online. Finally, the collected data was analyzed using factor analysis and linear regression to explore the relationships between presence and immersion. Results of the analysis identified involvement to be an important factor impacting a user’s perceived presence in a VR gaming experience.
APA, Harvard, Vancouver, ISO, and other styles
24

Sheffield, Jenna Pack. "Writing Program Administration and Technology: Toward a Critical Digital Literacy in Programmatic Contexts." Diss., The University of Arizona, 2015. http://hdl.handle.net/10150/556599.

Full text
Abstract:
Grounded in computers and composition scholarship, this mixed-methods dissertation project investigates how digital literacy is being represented and instantiated across U.S. writing programs. Using critical theories of technology as my theoretical framework, I draw on three large data sets, including a national survey of 70 Writing Program Administrators (WPAs) concerning programmatic commitments to digital literacy, a multimodal critical discourse analysis of these programs' websites, and follow-up interviews with survey respondents. Based on my analysis of these data sets, I argue that the focus of most programmatic discourses and practices tends to construct digital literacy in terms of how technological tools can be employed to meet rhetorical outcomes. I maintain, however, that with writing programs as a central force in the renegotiation of digital literacies, WPAs are in a unique position, through discourses and practices, to rearticulate digital literacy as not just a skill or means to improving rhetorical awareness for print composing but also an analytic to examine the social, political, and educational forces undergirding electronic texts and technologies—making visible the social relations involved in technology implementation and encouraging examinations of how technologies affect composing processes. This critical approach positions students as not just consumers but producers of new media who are able to become active agents of change in technological environments. Discussing the challenges that come along with taking a critical approach to technology integration at the programmatic level, I suggest a framework for addressing these challenges—including localizing technologies, mapping local practices to national goals, employing a multiliteracies training model, foregrounding assessment, and fostering communities of practice around digital literacy.
APA, Harvard, Vancouver, ISO, and other styles
25

Margarella, Erin E. ""It's Not Pixie Dust"| An Exploratory Qualitative Case Study of a School-Based Multimodal Tablet Initiative." Thesis, University of South Florida, 2016. http://pqdtopen.proquest.com/#viewpdf?dispub=10108030.

Full text
Abstract:

This dissertation presents findings from a qualitative case study of three English teachers representing varying levels of comfort with technology and years of teaching experience at St. Patrick Catholic High School. This research was motivated by two questions: (1) What are three literacy educators’ perceptions of a multimodal tablet initiative at a Catholic High School? (2) How is information regarding the use of iPad technology for literacy disseminated to three High School English teachers within a Catholic School system? Data was collected over a twelve-week period during the first academic year of implementation of a school-based multimodal tablet (iPad) initiative. Implementation during this time period was limited to students in their first and second year of high school. Under the direction of the initiative, teachers were tasked with utilizing the iPad as part of their daily instruction. Moreover, three Apps were highlighted for explicit use for uploading assignments and sharing content with students. Additionally, all textbooks utilized were in digital format. Data collected includes: artifacts, observations, interviews, and reflective field notes. Findings from this research indicate that all participants had positive perceptions of the tablet initiative and its promise for the future of the school and effect on student achievement. They felt, however, many areas that would support the effective implementation of the initiative were overlooked in lieu of the school remaining overly focused on maintaining its competitive edge against neighboring private schools. In essence, the school’s leadership utilized the iPads like “pixie dust”- sprinkling them around campus and hoping for an increase in achievement and digital citizenship among students without providing appropriate support and guidance for the teaching staff. Furthermore, the teachers believed the device presented new difficulties within the classroom dynamic including struggles with classroom management, academic honesty, and networking. The path of dissemination for information was convoluted with leadership members often verbally presenting conflicting expectations and information. While promising, the initiative lacked clearly articulated expectations for how teachers should integrate the device in their classrooms. Information related to the initiative was most often disseminated verbally via faculty meetings, but also uploaded within the school’s digital communication system. This digital drive was overly crowded with documents and lacked organization making locating information tedious and challenging. Given the pilot status of this implementation, the administrators did not present fully developed evaluative procedures or expectations for iPad integration creating uncertainty for teachers. These findings offer insight into the need for meaningful and individualized professional development opportunities for teachers that focus on deep interactions with multimodal capabilities prior to the onset of any initiative aiming to integrate iPad technology. Additionally, a clear path of dissemination in which expectations are written, explicit, and correlated with evaluative procedures would likely reduce confusion among teachers. Aligning the goals from all leadership members in an effort to create consistency among the information shared with staff is critical to implementing a technology initiative effectively.

APA, Harvard, Vancouver, ISO, and other styles
26

Park, Junghee. "Language adaptation to technology-mediated communication multimodal stance marking on the Korean Internet and TV in written mode /." Diss., Restricted to subscribing institutions, 2007. http://proquest.umi.com/pqdweb?did=1428837981&sid=1&Fmt=2&clientId=1564&RQT=309&VName=PQD.

Full text
APA, Harvard, Vancouver, ISO, and other styles
27

Akl, Amira. "Multimodal Expressions of Young Arab Muslim American Women." Bowling Green State University / OhioLINK, 2014. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1404692026.

Full text
APA, Harvard, Vancouver, ISO, and other styles
28

Winkler, Erica. "Hur ljud marknadsför en kommande långfilm : En multimodal analys av audiovisuella val i filmtrailers." Thesis, Högskolan Dalarna, Institutionen för kultur och samhälle, 2021. http://urn.kb.se/resolve?urn=urn:nbn:se:du-36769.

Full text
Abstract:
Film har en stor efterfrågan och en sak som kan avgöra vilken film en person väljer att tittapå, är filmtrailern. Syftet med den här studien är att via multimodalitet analysera fyra olikafilmtrailers: Män som hatar kvinnor (2009) (svensk och amerikansk trailerversion), Get Out(2016) och Tenet (2019). Studien undersöker hur ljudelementen används inom utvaldafilmtrailers, för att se hur ljud och bild samverkar för att skapa ett intresse till att vilja se detillhörande långfilmerna. Analys visar att rytmisk bakgrundsmusik, ljudeffekter och dialogverkar ha stor betydelse i filmtrailern för Get Out (2016) och Tenet (2019), medan det somsticker ut för båda trailerversioner av Män som hatar kvinnor (2009) är avsaknaden av dialog.Studiens resultat visar att det inom skräckfilm verkar som att ljudeffekter har mer betydelseän genren kriminalfilm, men att det i actionfilm framför allt är rytmisk bakgrundsmusik somverkar utgöra det mest unika.
APA, Harvard, Vancouver, ISO, and other styles
29

Марченко, Владислав Сергійович, and Vladyslav Serhiiovych Marchenko. "Modern ways of maintaining and ensuring a high level of multimodal transportation development in Ukraine and the world." Thesis, National Aviation University, 2021. https://er.nau.edu.ua/handle/NAU/50746.

Full text
Abstract:
1. Multimodal transport. URL: https://www.plslogistics.com/blog/multimodal-transport-what-is-multimodal-shipping 2. «Door-to-door». URL: https://www.eximlogistics.com/door-to-door-delevery/ 3. Geography of Ukraine. URL: https://www.britannica.com/place/Ukraine 4. Multimodal transportation. URL: http://www.deniint.com.mk/tag/advantages-of-multimodal-transportation/
In our time - the era of continuous technological development and innovations, to imagine the modern world without the participation of transport - is almost impossible. Transport is the key driver of the system, which leads it to movement, creates new market trends, expands the range of services, and adjusts planning strategies. In order to maximize the basic level of the logistics system efficiency, in recent years, incredible efforts have been made to solve the problems of one of the most promising and financially profitable areas, namely - the development of multimodal transportation.
У наш час - епоху безперервного технологічного розвитку та інновацій, уявити сучасний світ без участі транспорту - майже неможливо. Транспорт є ключовим рушієм системи, який веде її до руху, створює нові ринкові тенденції, розширює спектр послуг та коригує стратегії планування. З метою максимізації базового рівня ефективності логістичної системи в останні роки докладаються неймовірні зусилля для вирішення проблем одного з найбільш перспективних та фінансово вигідних напрямків, а саме - розвитку мультимодальних перевезень.
APA, Harvard, Vancouver, ISO, and other styles
30

Kadner, Kay. "Erweiterung einer Komponentenplattform zur Unterstützung multimodaler Anwendungen mit föderierten Endgeräten." Doctoral thesis, Technische Universität Dresden, 2007. https://tud.qucosa.de/id/qucosa%3A23614.

Full text
Abstract:
Zur Erledigung einer Aufgabe kann der Benutzer mit verschiedenen Endgeräten interagieren, welche unterschiedliche Interaktionsarten (Modalitäten) anbieten. Dabei gibt es jedoch kein Endgerät, welches alle erdenkbaren Modalitäten unterstützt. Aus diesem Grund wird eine komponentenbasierte Integrationsschicht auf Basis einer Komponentenplattform entwickelt, die dem Nutzer die gewünschte Freiheit bei der Wahl der Endgeräte und somit der Modalitäten ermöglicht. Als Ausgangsbasis dafür dient das W3C Multimodal Interaction Framework. Mit Hilfe der Integrationsschicht kann der Nutzer beispielsweise Endgeräteföderationen erzeugen, die einzeln oder gemeinsam zur Interaktion verwendet werden können. Die Integrationsschicht besitzt verschiedene Konzepte, um z.B. Geschäftslogik zur Laufzeit zu verteilen, Komponentenausfälle zu behandeln und die auf verschiedene Endgeräte verteilte Nutzerschnittstelle zu synchronisieren. Die entwickelten Konzepte wurden prototypisch implementiert, validiert und auf Performanz untersucht.
APA, Harvard, Vancouver, ISO, and other styles
31

Karpinska, Justyna. "Designing tangible play objects for toddlers’ open-ended play using multimodal feedback and multisensory stimuli." Thesis, Södertörns högskola, Medieteknik, 2017. http://urn.kb.se/resolve?urn=urn:nbn:se:sh:diva-32952.

Full text
Abstract:
Designing tangible objects for children’s development andlearning has been a common theme in the HCI community.However, studies involving designing of tangibles fortoddlers’ hedonic interaction and play experiences havebeen few. This paper explores how toddlers (between oneand three years old) behave when interacting with tangibleplay objects in the context of open-ended play. The aim ofthis study was to explore how the integration ofmultisensory stimuli and multimodal feedback in tangibleobjects can affect toddlers’ play, behaviors and engagementin the context of open-ended play. Furthermore, two playobjects called Sound Cubes were developed and used in aninteraction study conducted at a preschool in Stockholm.The results presented in this paper suggest that the openendedplay objects provided toddlers with opportunity formultiple manipulations that lead to interesting interactions.Moreover, multimodal feedback and multisensory stimulicreated a positive affect on toddlers’ engagement in play.
APA, Harvard, Vancouver, ISO, and other styles
32

Haenssler, Olaf Christian. "Multimodal sensing and imaging technology by integrated scanning electron, force, and near-field microwave microscopy and its application to submicrometer studies." Thesis, Lille, 2018. http://www.theses.fr/2018LIL1I006.

Full text
Abstract:
La combinaison de plusieurs procédés d’imagerie et de mesure permet d’obtenir des ensembles de données complémentaires et parfois uniques. A l’aide d’une technique hybride de microscopie présentant des modalités de mesure différentes et des enregistrements synchrones, on peut recueillir des informations complémentaires sur des échantillons à l’échelle nanométrique. De plus, l’intégration de procédés nanorobotiques et de logiciels open-source permet une approche technologique pour la recherche sur les semi-conducteurs et les sciences des matériaux. Ce travail démontre le potentiel d’une telle technologie. Ce démonstrateur fonctionne dans la chambre d‘un MEB et sert de plateforme technologique dans laquelle sont intégrés différentes modalités, technologies et procédés. Un AFM basé sur un interféromètre optique compact permet l’imagerie de la topographie de surface tandis qu’un microscope à micro-ondes à balayage enregistre les caractéristiques électromagnétiques dans la gamme de fréquence des micro-ondes, le tout opérant dans le même MEB. L’engin est contrôlé par un ensemble de logiciels qui est optimisé pour la nanorobotique basée sur l‘imagerie. Ce démonstrateur technologique permet d’observer en direct la région d’intérêt à l’aide du microscope électronique tandis qu’est effectuée en champ proche la caractérisation de la surface de l’échantillon par intermédiaire des micro-ondes évanescentes et des forces intermoléculaires. Ensuite, est présenté un standard multimodal de test et qui valide la fonctionnalité de l’instrument démonstrateur. Le présent travail est complété par une analyse électrique de capacités MOS ainsi que leur approximation destinée au calibrage
Various disciplines of micro- and nanotechnology requires combinatorial tools for the investigation, manipulation and transport of materials in the submicrometer range. The coupling of multiple sensing and imaging techniques allows for obtaining complementary and often unique datasets of samples under test. By means of an integrated microscopy technique with different modalities, it is possible to gain multiple information about nanoscale samples by recording at the same time. The expansion with nanorobotics and an open-source software framework, leads to a technology approach for semiconductor research and material science. This work shows the potential of such a multimodal technology approach by focusing on a demonstrator setup. It operates under high-vacuum conditions inside the chamber of a Scanning Electron Microscope and serves as a technology platform by fusing various microscopy modalities, techniques and processes. An Atomic Force Microscope based on a compact, optical interferometer performs imaging of surface topography, and a Scanning Microwave Microscope records electromagnetic properties in the microwave frequency domain, both operating inside an SEM. A software framework controls the instrument. The setup allows for observing with SEM, while imaging and characterizing with interacting evanescent microwaves and intermolecular forces simultaneously. In addition, a multimodal test standard is introduced and subsequently confirms the functionality of the demonstrator. Within this context, the work also includes an electrical analysis of micro-scale MOS capacitors, including an approximation for use in the calibration
APA, Harvard, Vancouver, ISO, and other styles
33

Gustafson, Joakim. "Developing Multimodal Spoken Dialogue Systems : Empirical Studies of Spoken Human–Computer Interaction." Doctoral thesis, KTH, Tal, musik och hörsel, 2002. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-3460.

Full text
Abstract:
This thesis presents work done during the last ten years on developing five multimodal spoken dialogue systems, and the empirical user studies that have been conducted with them. The dialogue systems have been multimodal, giving information both verbally with animated talking characters and graphically on maps and in text tables. To be able to study a wider rage of user behaviour each new system has been in a new domain and with a new set of interactional abilities. The five system presented in this thesis are: The Waxholm system where users could ask about the boat traffic in the Stockholm archipelago; the Gulan system where people could retrieve information from the Yellow pages of Stockholm; the August system which was a publicly available system where people could get information about the author Strindberg, KTH and Stockholm; the AdAptsystem that allowed users to browse apartments for sale in Stockholm and the Pixie system where users could help ananimated agent to fix things in a visionary apartment publicly available at the Telecom museum in Stockholm. Some of the dialogue systems have been used in controlled experiments in laboratory environments, while others have been placed inpublic environments where members of the general public have interacted with them. All spoken human-computer interactions have been transcribed and analyzed to increase our understanding of how people interact verbally with computers, and to obtain knowledge on how spoken dialogue systems canutilize the regularities found in these interactions. This thesis summarizes the experiences from building these five dialogue systems and presents some of the findings from the analyses of the collected dialogue corpora.
QC 20100611
APA, Harvard, Vancouver, ISO, and other styles
34

Kuechenmeister, Bobby James. "Answering the Call of Duty: Composition Pedagogy Problems, Multimodal Solutions, and Gaming Literacies." Bowling Green State University / OhioLINK, 2011. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1308242965.

Full text
APA, Harvard, Vancouver, ISO, and other styles
35

Fernström, Torbjörn. "Audiovisualitet : En diskursanalys om det nya gamla." Thesis, Högskolan Dalarna, Ljud- och musikproduktion, 2017. http://urn.kb.se/resolve?urn=urn:nbn:se:du-24533.

Full text
Abstract:
Syftet med denna diskursanalys är att bidra med kunskap om hur audiovisualitet har setts på och förändrats från 1936 fram till 2008. Detta undersöks utifrån sex stycken texter som är uppsatsens empiri. Huvudfrågan i denna uppsats begrundar huruvida dessa skillnader finns och hur de kan relateras till varandra. Analysprocessen utgår från socialkonstruktivism som teori för att kunna förstå de skillnader som undersöks. Resultatet av denna undersökning visar att det finns små skillnader i hur vissa relaterade begrepp används, detta tas vidare upp i diskussionsdelen där det även diskuteras hur förutsättningar för tidigare och framtida diskurser om audiovisualitet ser ut. Förslag till fortsatt forskning är en liknande studie med fokus på moderna texter för att se om det finns samtida skillnader och även om resultatet utifrån det skiljer sig från det i denna undersökning.
APA, Harvard, Vancouver, ISO, and other styles
36

Zapata, Rojas Julian. "Translators in the Loop: Observing and Analyzing the Translator Experience with Multimodal Interfaces for Interactive Translation Dictation Environment Design." Thesis, Université d'Ottawa / University of Ottawa, 2016. http://hdl.handle.net/10393/34978.

Full text
Abstract:
This thesis explores interactive translation dictation (ITD), a translation technique that involves interaction with multimodal interfaces equipped with voice recognition (VR) technology throughout the entire translation process. Its main objective is to provide a solid theoretical background and an analysis of empirical qualitative and quantitative data that demonstrate ITD’s advantages and challenges, with a view to integrating this technique into the translation profession. Many empirical studies in human-computer interaction have strived to demonstrate the efficiency of voice input versus keyboard input. Although it was implicit in the earliest works that voice input was expected to completely replace—rather than complement—text-input devices, it was soon proposed that VR often performed better in combination with other input modes. This study introduces multimodal interaction to translation, taking advantage of the unparallelled robustness of commercially available voice-and-touch-enabled multimodal interfaces such as touch-screen computers and tablets. To that end, an experiment was carried out with 14 professional English-to-French translators, who performed a translation task either with the physical prototype of an ITD environment, or with a traditional keyboard-and-mouse environment. The hypothesis was that the prototypical environment would consistently provide translators with a better translator experience (TX) than the traditional environment, considering the translation process as a whole. The notion of TX as introduced in this work is defined as a translator’s perceptions of and responses to the use or anticipated use of a product, system or service. Both quantitative and qualitative data were collected using different methods, such as video and screen recording, input logging and semi-structured interviews. The combined analysis of objective and subjective usability measures suggests a better TX with the experimental environment versus the keyboard-and-mouse workstation, but significant challenges still need to be overcome for ITD to be fully integrated into the profession. Thus, this doctoral study provides a basis for better-grounded research in translator-computer interaction and translator-information interaction and, more specifically, for the design and development of an ITD environment, which is expected to support professional translators’ cognitive functions, performance and well-being. Lastly, this research aims to demonstrate that translation studies research, and translation technology in particular, needs to be more considerate of the translator, the TX, and the changing realities of the interaction between humans, computers and information in the twenty-first century.
APA, Harvard, Vancouver, ISO, and other styles
37

Herman, Jennifer Linda. "Effecting Science in Affective Places: The Rhetoric of Science in American Science and Technology Centers." The Ohio State University, 2014. http://rave.ohiolink.edu/etdc/view?acc_num=osu1396961008.

Full text
APA, Harvard, Vancouver, ISO, and other styles
38

Mann, Hilda. "Förskollärares syn på digitala verktyg i verksamheten." Thesis, Karlstads universitet, Institutionen för pedagogiska studier (from 2013), 2020. http://urn.kb.se/resolve?urn=urn:nbn:se:kau:diva-77798.

Full text
Abstract:
The purpose of this study is to contribute with knowledge of how preschool teachers experience the work with digital tools in teaching. The study has been done at a preschool that has been carefully selected because they work in a thoughtful way with digital tools to support childrens learning. Qualitative interviews with audio recording have been used as a data collection method from a phenomenographic perspective. Transcription of data has been carried out using an analytical model. The results show that preschool teachers perceive work with digital tools as an aid to their teaching. Preschool teachers use several digital tools in different subject areas in varying way. There is some withdrawal in the work with the tools and reflections on the purpose of the use with the children. This results in the fact that it looks different in the work with digital tools depending in interest and expertise. The conclusion of the study shows that there is interest in learning more and that the use of digital tools is seen as a natural way for preschool teachers to use for the purpose of teaching.
Syftet med denna studie är att bidra med kunskap om hur förskollärare upple- ver arbetet kring digitala verktyg i undervisningen. Studien har gjorts på en förskola som noga valts ut eftersom de arbetar på ett genomtänkt sätt med di- gitala verktyg som stöd för barnens lärande. Kvalitativa intervjuer med ljud- upptagning har använts som datainsamlingsmetod ur ett fenomenografiskt perspektiv. Transkribering av data har genomförts med hjälp av en analysmo- dell. Studiens resultat visar att förskollärarna upplever arbetet med digitala verktyg som ett hjälpmedel för deras undervisning. Förskollärarna använder flera digitala verktyg i olika ämnesområden på varierande sätt. Det finns en viss tillbakadragenhet i arbetet med verktygen och funderingar kring syftet av användningen tillsammans med barnen. Detta resulterar i att det ser olika ut i arbetet med digitala verktyg beroende på intresse och kompetens. Slutsatsen av studien visar att det finns intresse för att lära sig mer och att användningen av digitala verktyg ses som ett naturligt sätt för förskollärarna att använda sig av i syfte till undervisning.
APA, Harvard, Vancouver, ISO, and other styles
39

Kupferberg, Becky Lynn. "The Influence of Digital Multimodal Composition in First-Year Composition: A Moment in the 2015-2016 School Year." University of Findlay / OhioLINK, 2016. http://rave.ohiolink.edu/etdc/view?acc_num=findlay1465992849.

Full text
APA, Harvard, Vancouver, ISO, and other styles
40

Larsson, Ann-Sofie, and Frida Persson. "Jippieserien : En kvalitativ studie om hur multimodal media kan nå ut till barn med neuropsykiatriska funktionsnedsättningar och deras föräldrar." Thesis, Södertörns högskola, Institutionen för naturvetenskap, miljö och teknik, 2014. http://urn.kb.se/resolve?urn=urn:nbn:se:sh:diva-23561.

Full text
Abstract:
This report describes the work process to an interactive movie addressed to children with neurodevelopmental disabilities, where Jippieserien is the client. The aim is to explore how multimodal media can convey Jippieseriens message to children with neurodevelopmental disabilities and their parents, by taking the users needs into account. It is important to focus on the people who will use the system when designing interactive systems. This project is therefore using the designprocess human-centered design for interactive systems. The process includes four basic elements and provides guidelines for user-centered design. These parts are analysis, prototyping, implementation, and evaluation (Johansson. D &Lagerstedt. J, 2006). The users have expressed their needs in qualitative methods such as user testing with focus groups. The results from this study shows that you can customize a design based on the users different conditions through close communication between the customer, target audience and the use of multimedia. The previous research and the result of the user testing indicates that there is a strong connection between multimedia, disabilities and how Jippieseriens messages can reach out to the entire audience. You can give the user the ability to use multiple senses simultaneously then using various of media at the same time.
APA, Harvard, Vancouver, ISO, and other styles
41

Lenz, Kent Alan. "The Semiotics, Practical Application, and Assessment of the Modalities." Bowling Green State University / OhioLINK, 2014. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1398773919.

Full text
APA, Harvard, Vancouver, ISO, and other styles
42

Hänßler, Olaf C. [Verfasser], Didier [Akademischer Betreuer] Théron, and Sergej [Akademischer Betreuer] Fatikow. "Multimodal sensing and imaging technology by integrated scanning electron, force, and nearfield microwave microscopy and its application to submicrometer studies / Olaf C. Hänßler ; Didier Théron, Sergej Fatikow." Oldenburg : BIS der Universität Oldenburg, 2018. http://d-nb.info/1157010199/34.

Full text
APA, Harvard, Vancouver, ISO, and other styles
43

Hänßler, Olaf C. Verfasser], Didier [Akademischer Betreuer] Théron, and Sergej [Akademischer Betreuer] [Fatikow. "Multimodal sensing and imaging technology by integrated scanning electron, force, and nearfield microwave microscopy and its application to submicrometer studies / Olaf C. Hänßler ; Didier Théron, Sergej Fatikow." Oldenburg : BIS der Universität Oldenburg, 2018. http://d-nb.info/1157010199/34.

Full text
APA, Harvard, Vancouver, ISO, and other styles
44

Kurlinkus, William C. "Nostalgia and New Media: Designing Difference into Rhetoric, Composition, and Technology." The Ohio State University, 2014. http://rave.ohiolink.edu/etdc/view?acc_num=osu1397529531.

Full text
APA, Harvard, Vancouver, ISO, and other styles
45

Husseini, Orabi Ahmed. "Multi-Modal Technology for User Interface Analysis including Mental State Detection and Eye Tracking Analysis." Thesis, Université d'Ottawa / University of Ottawa, 2017. http://hdl.handle.net/10393/36451.

Full text
Abstract:
We present a set of easy-to-use methods and tools to analyze human attention, behaviour, and physiological responses. A potential application of our work is evaluating user interfaces being used in a natural manner. Our approach is designed to be scalable and to work remotely on regular personal computers using expensive and noninvasive equipment. The data sources our tool processes are nonintrusive, and captured from video; i.e. eye tracking, and facial expressions. For video data retrieval, we use a basic webcam. We investigate combinations of observation modalities to detect and extract affective and mental states. Our tool provides a pipeline-based approach that 1) collects observational, data 2) incorporates and synchronizes the signal modality mentioned above, 3) detects users' affective and mental state, 4) records user interaction with applications and pinpoints the parts of the screen users are looking at, 5) analyzes and visualizes results. We describe the design, implementation, and validation of a novel multimodal signal fusion engine, Deep Temporal Credence Network (DTCN). The engine uses Deep Neural Networks to provide 1) a generative and probabilistic inference model, and 2) to handle multimodal data such that its performance does not degrade due to the absence of some modalities. We report on the recognition accuracy of basic emotions for each modality. Then, we evaluate our engine in terms of effectiveness of recognizing basic six emotions and six mental states, which are agreeing, concentrating, disagreeing, interested, thinking, and unsure. Our principal contributions include the implementation of a 1) multimodal signal fusion engine, 2) real time recognition of affective and primary mental states from nonintrusive and inexpensive modality, 3) novel mental state-based visualization techniques, 3D heatmaps, 3D scanpaths, and widget heatmaps that find parts of the user interface where users are perhaps unsure, annoyed, frustrated, or satisfied.
APA, Harvard, Vancouver, ISO, and other styles
46

Moore, Jeffrey Salem. "Digital Literacy and Composing Practices of Second Language Students: A Student Perspective on Writing, Technology, and Privilege." Bowling Green State University / OhioLINK, 2017. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu148715983643726.

Full text
APA, Harvard, Vancouver, ISO, and other styles
47

VOLTA, ERICA. "Multisensory learning in adaptive interactive systems." Doctoral thesis, Università degli studi di Genova, 2020. http://hdl.handle.net/11567/1001795.

Full text
Abstract:
The main purpose of my work is to investigate multisensory perceptual learning and sensory integration in the design and development of adaptive user interfaces for educational purposes. To this aim, starting from renewed understanding from neuroscience and cognitive science on multisensory perceptual learning and sensory integration, I developed a theoretical computational model for designing multimodal learning technologies that take into account these results. Main theoretical foundations of my research are multisensory perceptual learning theories and the research on sensory processing and integration, embodied cognition theories, computational models of non-verbal and emotion communication in full-body movement, and human-computer interaction models. Finally, a computational model was applied in two case studies, based on two EU ICT-H2020 Projects, "weDRAW" and "TELMI", on which I worked during the PhD.
APA, Harvard, Vancouver, ISO, and other styles
48

Augustinson, Christian. "Videor i mobila nyhetsartiklar." Thesis, KTH, Skolan för teknikvetenskaplig kommunikation och lärande (ECE), 2017. http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-206858.

Full text
Abstract:
Denna studie undersöker hur engagemanget för nyhetsartiklar bestående av både text och video förändras om artikeln består av flera kortare videor istället för en längre video. Detta för att se hur multimodala metoder påverkar engagemanget för nyheter. Med mutimodala metoder menas blandningen av olika medier i en kommunikation vilket används för att skapa mening för användarna. Undersökningen består av totalt 23 st användartester där användarna blir exponerades för en av tre olika varianter av en nyhetsartikel. Skillnaden var att de bestod av noll, ett eller tre videoklipp. Engagemanget mättes sedan utifrån hur användaren agerar och hur användaren beskriver artikeln och video. I studien så undersöks engagemanget ur två aspekter, det inre engagemanget och det yttre engagemanget. Det inre engagemanget beskriver hur användaren upplever artikeln när hen läser den samt hur användaren läser artikeln. Det yttre engagemanget beskriver vad användare väljer att göra med artikeln efter att hen har läst klart den. Studiens resultat är att en uppdelad video påverkar vissa delar av engagemanget men inte alla aspekter. Mycket tyder på att det är troligare att användare väljer att se minst en video om den är uppdelad i flera kortare videor. De användare som exponerades för denna artikel utvärderade även varje video separat samtidigt som användarna som fick artikeln med en video talade mer allmänt om video i de fall de inte såg videoklippet. Användare som fick prototypen med fler video talade även mer negativt om video generellt.
This study examines how user engagement in news article consisting of text and video changes if the article consists of multiple short videos instead of one long video. This is to investigate how a multimodal methods affect user engagement in news articles. Multimodal methods is a combination of different types media in communication. The study consists of a total of 23 user tests where users was exposed to one of three different versions of a news article. The difference between the articles was that it consisted zero, one or three videos. Engagement levels was measured in how the user read the article and how the user described video. The study look at user engagement from two aspects, inner engagement and outer engagement. Inner engagement describes how users feel about the article when he or se reads it. Outer engagement describes what the user chose to do after he or she finish reading the article. The conclusions of the study is that multiple videos affects some parts of user engagement but not all aspects of it. The result suggests that its more likely that a user choses too se at least one video if there is more shorter videos to chose from. Users that tested this article evaluated each video separately and the users that tested the article whit one video evaluated video as a whole and not the individual clip. User that was exposed to multiple videos also spoke more negative about video.
APA, Harvard, Vancouver, ISO, and other styles
49

Stinson, Samuel D. "Writing with Video Games." Ohio University / OhioLINK, 2018. http://rave.ohiolink.edu/etdc/view?acc_num=ohiou1525803463021262.

Full text
APA, Harvard, Vancouver, ISO, and other styles
50

Hvit, Lindstrand Sara. "Små barns tecken- och meningsskapande i förskola : Multimodalt görande och teknologi." Doctoral thesis, Högskolan för lärande och kommunikation, Högskolan i Jönköping, Förskolepedagogisk didaktisk forskning, 2015. http://urn.kb.se/resolve?urn=urn:nbn:se:hj:diva-26423.

Full text
Abstract:
This thesis explores how activities that young children are engaged in within the preschool environment, can be understood in terms of early language and literacy processes. The overall aim is to construct knowledge about young children’s spontaneous sign processes as well as meaning making and early literacy processes in preschool. A wider aim is to contribute to the theoretical understanding of young children’s multimodal use of language. More specifically, there is an interest to show how preschool educators describe and analyse young children’s literacy and how young children construct language in interaction with other children and technology. The overall theoretical view of is a social constructionist perspective of language and knowledge. Young childrens’ early literacy is seen from Early Childhood Literacy and multimodal views. The results are presented in four studies that together construct knowledge about the overall aim. The first two studies, based on focus groups, give insight into preschool educators’ views, and professional language about young children’s literacy. Young children’s interactions with each other and an interactive board (IWB), were then explored by video recordings in the third and fourth studies. The interactions are discussed in relation to sign- and meaning making, imagination and creativity. The professional language of Swedish preschool educators is eventually discussed as a dialogism of earlier theoretical and leading voices. The use of concepts such as bodily alliterations and pictographic writing are proposed as ways to expand the theoretical approach to young children’s literacy processes in preschool. By observing childrens interactions and view their bodily activities and their use of resources as doing literacy- and language their literacy could be challenged in preschools in its own right, and seen as literacy education.
APA, Harvard, Vancouver, ISO, and other styles
We offer discounts on all premium plans for authors whose works are included in thematic literature selections. Contact us to get a unique promo code!

To the bibliography