Academic literature on the topic 'Static multimodal texts'

Kaleidographic is a dynamic and interactive data visualization tool that allows users to observe and explore relations between any number of variables. It was developed in reaction to the problem of capturing the complex ways in which words and images combine to make meaning. This article introduces the Kaleidographic tool through a case study examining the multimodal construction of news values in news items widely shared on the Facebook social media platform. The design and functionality of the tool are explained in relation to the challenges faced when exploring both the visual and verbal elements of these news items as part of a multimodal discourse analysis. Through this case study, the authors show that Kaleidographic offers multimodal researchers a means of exploring relations at the intersection of different semiotic modes that might be missed in static graphs and tables. Despite Kaleidographic being initially conceived out of the analysis of text–image relations, the case study demonstrates that it has potential applications beyond multimodal discourse analysis. To facilitate broader applications of the tool, it is now publicly available online for use without charge.

This study examines the efficacy of a multimodal online bilingual dictionary based on cognitive linguistics in order to explore the advantages and limitations of explicit multimodal L2 vocabulary learning. Previous studies have examined the efficacy of the verbal and visual representation of words while reading L2 texts, concluding that it facilitates incidental word retention. This study explores other potentials of multimodal L2 vocabulary learning: explicit learning with a multimodal dictionary could enhance not only word retention, but also text comprehension; the dictionary could serve not only as a reference tool, but also as a learning tool; and technology-enhanced visual glosses could facilitate deeper text comprehension. To verify these claims, this study investigates the multimodal representations’ effects on Japanese students learning L2 locative prepositions by developing two online dictionaries, one with static pictures and one with animations. The findings show the advantage of such dictionaries in explicit learning; however, no significant differences are found between the two types of visual glosses, either in the vocabulary or in the listening tests. This study confirms the effectiveness of multimodal L2 materials, but also emphasizes the need for further research into making the technologically enhanced materials more effective.

The article is devoted to the consideration of a polyphonic choral composition as a polycode text, in which literary and musical texts as paralinguistic means contain heterogeneous information and add additional shades to the content of the score, i.e., the musical text as a whole. The novelty of the study lies in the fact that for the first time, synthesizing scientific achievements of linguistics and musicology, the polyphonic forms of a cappella choral works are analyzed as polycode texts. Due to the specifics of the choral art form as a musical and performing art, the nature of the perception of a musical text is multimodal. For performers who ‘decipher’ and ‘voice’ a musical notation, a musical text has one visual mode. For listeners, multimodality characterizes the practice of communication in terms of auditory, linguistic, spatial and visual resources, for example, the auditory mode when listening to a work without a visual range, or a polymodus complex when listening with a visual range. This refers to listening to music while simultaneously viewing the musical text of a work, observing the process of public performance, which in modern practice is often accompanied by a specially selected video sequence. The leading paradigm is the synergy of literary and textual sources and polyphonic form in works for a cappella choir by contemporary Russian composers. Based on the differentiation of the structure of a literary and textual source, the attribution of polyphonic forms of motet, madrigal, fugue and fugato is the subject of the work, while the goal is to form a research picture based on a close ‘polyphonic’ connection between word and music. In polyphonic analysis, it is important to determine the content of choral compositions and the composer’s method of dealing with the structure of a text source. A whole poem can be taken as the basis of a musical work (an example is the text-musical forms of motets and madrigals), one strophe, one line, one word (the analysis of fugato and fugue becomes the evidence base). An interesting case is the use as a text base of a polyphonic composition of individual syllables and phonemes (preludes and fugue-vocalizes) and a ‘silent’ performance - with a closed mouth. Thus, it is proved that the musical text is a complex multimodal complex in which the main information is conveyed by semiotically heterogeneous components. It is concluded that, on the one hand, a literary text influences the choice of a polyphonic form, on the other hand, it is often a static text that does not have an external plot development in the context of polyphonic dramaturgy and form and acquires internal dynamics of development to expand its semantic field.

The objective of this study was to use virtual reality as a validation method of a new multimodal warning for use in situations of risk and danger. This warning is intended to be more efficient than the static warnings as regards their ability to convey clear, objective information and securely. The virtual environment used was developed with immersive virtual reality simulating a risk and danger to the user. This virtual environment allows situations are simulated in real life would be impossible for putting at risk the lives of people. For the warning efficiency were evaluated, we used two warnings, static and multimodal, which consisted of harmonization between the ISO and ANSI standards. As innovation factor used was the explanation of the consequences of non-compliance. Multimodal elements used in the notice were a file with a recorded human voice and a flashing red light. These results demonstrated that the virtual environment used, and the multimodal warning were efficient in their goals. The results of the variables used were positive and the hypotheses was validated with the use of statistical tests.

According to the latest data published by the WHO, 1.71 billion people suffer from musculoskeletal disorders and 568 million are affected by back pain, making these the most significant occupational health problems. The aim of this study was to analyze the effects of a newly developed Multimodal Workplace Training Program implemented among young sedentary employees in order to treat and prevent these problems. The 20-week Training Program was conducted at the National Instruments Corporations’ Hungarian subsidiary in Debrecen between January and June, 2019. Pre- and post-intervention questionnaires were used to assess subjective parameters. Baseline and follow-up physical examinations were performed using the SpinalMouse, Y-Balance, Sit and Reach, Prone and Side Plank, Timed Abdominal Curl, and Biering-Sorensen tests. The results for 76 subjects were eligible for statistical analysis. Our Training Program was effective in several aspects, including a reduction in musculoskeletal symptoms and improvements in posture (p < 0.001), in dynamic (p < 0.01) and static-isometric (p < 0.001) core strength, in flexibility (p < 0.001), in spinal inclination in the sagittal (p < 0.001) and frontal (p < 0.01) plane, and in balance and coordination (p < 0.05). The Multimodal Progressive Functional–Proprioceptive Training was highly effective, and the application of such a complex training program can be recommended in workplace settings.

Introduction: Women with breast cancer have an increasing chance of survival for many years. Multimodal, extremely effective but also aggressive treatment, often leads to disorders of neuromuscular excitability and physical fitness of the patients. Therefore, when planning the physiotherapy process of women treated for breast cancer, one should look for the most effective methods of improvement with broad neurostimulatory and neuromodulatory effects. In recent years, more and more attention has been paid to the possibilities of using virtual reality exercises in therapy. Aim: The study was to understand the impact of medical resort treatment extended with modern feedback exercises using virtual reality to improve postural control in breast cancer survivors. M aterial and Methods: A clinical, pilot, non-controlled study was conducted at the Solanki Medical Resort in Inowroclaw. 46 women aged 36 to 63 completed the study (mean 51.67 ± 6.62 years). The patients participated in spa therapy for 3 weeks. For basic medical treatment, to improve postural control, physical exercises using feedback based on virtual reality were introduced. Postural control tests performed on the stabilometric platform were used to assess the progress of therapy. Results: In the assessment of dynamic postural control, the length of the center of foot pressure (COP) movement path before the treatment was on average 278.28 cm (± 147.13) and after treatment shortened to 209.60 cm (± 86.49) which was statistically significant (p = 0.0083). In the assessment of static postural control, no statistically significant differences were found between the length of the COP pathway before treatment compared to the condition before treatment (p> 0.05). Conclusions: Medical treatment enriched with physical exercises using feedback based on virtual reality did not affect static postural control but contributed to the improvement of dynamic postural control. The results of the study should be confirmed in high-quality therapeutic experiments, including control groups.

Введение. Проведен анализ особенностей структуры и смыслового содержания виртуальных порталов Пенсион ного фонда Российской Федерации (ПФ РФ), всероссийской общественной организа ции «Союз пенсионеров России» (СПР), сайта регионального социального центра как разновидностей институционального виртуального ресурса, осуществляющего типовую коммуникацию государства с населением разного возраста, в первую очередь пожилого. Цель статьи – описать дискурсивные, коммуникативные, структурные особенности официальных порталов государственных и общественных организаций, обращенных к пожилой части населения страны и региона, выявить способы организации коммуникации, характер общения с адресатом. Материал и методы. Общая методология исследования базируется на исследованиях лингвистов, психологов, психолингвистов в области речевых, психологических, когнитивных особенностей людей пожилого возраста, а также когнитивно-дискурсивных подходах к общению официальных структур и общественных организаций с разными слоями населения в виртуальной среде. Использовались структурный (контент) анализ сайта, коммуникативный анализ отдельных компонентов сайтов, прагмастилистический анализ фрагментов текстов, содержащихся в контенте сайта, жанровый анализ высказываний и фрагментов текстов. Результаты и обсуждение. Обнаружился разный объем гипертекстовых, мультимодальных, поликодовых структурных компонентов на фоне типичных для виртуальных объектов такого рода формы и содержания. Виртуальное пространство портала ПФ РФ имеет черты маркетинговой платформы, содержащей разделы, ориентированные на обратную связь с адресатом: личный кабинет гражданина, центр консультирования, пенсионный калькулятор; контент портала СПР соединяет маркетинговые, информирующие, воздействующие и интерактивные черты. Степень совмещения институционального официального, официально-делового, рекламного, ритуального, обыденного дискурсов также неодинакова, зависит от характера субъекта, функции и правообладателя виртуального объекта. Наибольшим объемом официального и официально-делового дискурсивного компонента, наименьшей величиной визуальных средств отличается портал ПФ РФ. Портал СПР в равной степени сочетает официально-деловой, правовой, публицистический и обыденный типы дискурса, оформленные в том числе с помощью статичных и динамичных инфографических компонентов. Портал регионального социального центра содержит компоненты правового, официально-делового, просветительского, публицистического типов дискурса (последний представлен номерами регионального периодического издания). Заключение. Структура, содержание контента, тип коммуникации порталов указывают на наличие не полностью совпадающих типов адресата. Адресат портала ПФ РФ – гендерно, профессионально, социально не определенное лицо пенсионного, предпенсионного возраста, заинтересованное в концептуально ограниченной информации; мобильное в когнитивном отношении, легко переходящее от обыденной концептуализации действительности к профильной, способное быстро адаптировать большой объем правовой информации, ориентирующееся в виртуальной среде, меняющее стилевые и коммуникативные регистры. Адресат портала СПР – гендерно, социально не определенный пенсионер, активный по отношению к общественной и государственной жизни России, имеющий широкие интересы, вовлеченный в занятия физкультурой и спортом, волонтерское движение. Адресат портала Бюджетного учреждения Омской области «Комплексный центр социального обслуживания населения Шербакульского района» – гендерно не определенный, социально не защищенный (пенсионер в том числе), территориально ограниченный член социума, активный по отношению к общественной жизни Омской области и района, имеющий широкие интересы, вовлеченный в занятия физкультурой и спортом, не сдающийся ни при каких обстоятельствах. Общим является наличие навыков свободного владения компьютером, умение ориентироваться в виртуальной среде либо осознание необходимости обучаться компьютерной грамоте. Introduction. The article analyzes the features of the structure and semantic content of the virtual portals of the Pension Fund of the Russian Federation, the All-Russian public organization “Union of Pensioners of Russia”, the portal of the regional social center as a kind of institutional virtual resource that provides typical communication between the state and people of different ages – primarily the elderly. The purpose of the article is to describe the discursive, communicative, structural features of the official portals of state and public organizations, addressed to the elderly population of the country and region, to identify ways of organizing communication, the nature of communication with the addressee. Material and methods. The general research methodology is based on studies of linguists, psychologists, psycholinguists in the field of speech, psychological, cognitive characteristics of elderly people, as well as cognitivediscursive approaches to communication between official structures and public organizations with different layers of the population in a virtual environment. We used structural (content) analysis of the site, communicative analysis of the individual components of the sites, pragma-style analysis of fragments of texts contained in the content of the site, genre analysis of statements and fragments of texts. Results and discussion. Portals have a different volume of hypertext, multimodal, polycode structural components against the background of typical forms and contents typical for virtual objects. The virtual space of the RF PF portal has the features of a marketing platform that contains sections oriented to feedback from the addressee and their implementation – a citizen’s personal account, counseling center, and pension calculator; The content of the portal of the joint venture of the Russian Federation combines marketing, informative, effective and interactive features. The degree of combination of institutional, official, business, advertising, ritual, everyday discourses is also different, depending on the nature of the subject, function and copyright holder of the virtual object. The largest volume of official and official-business discursive component, the smallest amount of visual means is distinguished by the RF PF portal, the portal of the Union of Pensioners of the Russian Federation equally combines officialbusiness, legal, journalistic and everyday types of discourse, designed also using static and dynamic infographic components; the portal of the regional social center contains components of legal, official-business, educational journalistic types of discourse (the latter is represented by the numbers of the regional periodical). Conclusion. The structure, content of website, type of communication of the portals indicate the presence of incompatible types of recipient. The addressee of the Pension Fund of the Russian Federation’s portal is a gender, professional, socially undefined person of retirement, pre-retirement age, interested in conceptually limited information; it’s mobile in a cognitive sense, easily transitioning from an ordinary conceptualization of reality to specialized, able to quickly adapt a large amount of legal information, orientated in a virtual environment, changing style and communicative registers. The addressee of the portal of the Union of Pensioners of the Russian Federation is a gender, socially undefined pensioner, active in relation to public and state life in Russia, having broad interests, involved in physical education and sports, and volunteer movement. The addressee of the portal of the Public Institution “Public Center for Social Policy of the Sherbakul Region” is a gender-undefined, socially unprotected (including pensioner), a geographically limited member of society, active in relation to the public life of the Omsk region, having broad interests, involved in physical education and sports not giving up under any circumstances. Common is the command of computer skills, the ability to navigate in a virtual environment or the awareness of the need to learn computer literacy. Common is the availability of computer skills, the ability to navigate in a virtual environment or the awareness of the need to acquire computer literacy.

Aim. To study the effect of high-dose combined lipid-lowering therapy (statins + ezetimibe vs statins + PCSK9 inhibitors) on plaque vulnerability assessed using multimodal imaging (coronary computed tomography angiography (CCTA) and optical coherence tomography, as well as biomarkers in patients with acute coronary syndrome (ACS).Material and methods. This open, prospective, randomized, single-center study will include 120 patients admitted urgently with an ACS. All patients will undergo percutaneous coronary intervention of the infarct-related artery, as well as intracoronary imaging using optical coherence tomography of one or two noninfarct-related arteries. During hospitalization, patients will receive standard therapy for ACS according to clinical guidelines, while statins will initially be prescribed at a maximum dosage of atorvastatin 80 mg/rosuvastatin 40 mg.Patients who showed high compliance and did not reach the target low-density lipoprotein cholesterol (LDL-C) values (≤1,4 mmol/l) 1 month after myocardial infarction/unstable angina at the second visit will be randomized into two groups. Patients of group 1 will receive PCSK9 inhibitors (alirocumab 150 mg by subcutaneous injection once every 2 weeks or evolocumab 140 mg by subcutaneous injection once every 2 weeks) in addition to maximum statin therapy (atorvastatin 80 mg/rosuvastatin 40 mg), while group 2 participants will take ezetimibe at a dose of 10 mg in combination with the maximum dose of statins. In addition, at the second visit, patients will undergo CCTA, assess the cardio-ankle vascular index (CAVI) index and laboratory tests (complete blood count (neutrophil-to-lymphocyte ratio NLR), lipid profile, alanine aminotransferase (ALT), aspartate aminotransferase (AST), Troponin I, Galectin-3, high-sensitivity C-reactive protein (hs-CRP), metalloproteinase-9 (MMP-9), tissue inhibitor of metalloproteinase 1 (TIMP-1), neutrophil gelatinase-associated lipocalin (NGAL). Total follow-up will last 52 weeks. At the final visit, patients will undergo CCTA, assessment of the CAVI index and laboratory status (NLR, lipid profile, ALT, AST), Troponin I, Galectin-3, hs-CRP, MMP-9, TIMP-1, NGAL).Primary endpoint: reduction in plaque vulnerability according CCTA in non-infarct-related coronary arteries Secondary endpoints: death, stent thrombosis/restenosis, non-fatal myocardial infarction, readmissions with progressive angina, repeat revascularization; changes of the lipid profile (total cholesterol, LDL-C, high-density lipoprotein cholesterol, triglycerides) against the background of maximum combination therapy with statin + PCSK9 inhibitors or statin + ezetimibe; changes of the biomarkers of cardiac injury (Troponin I), inflammation (NLR, hs-CRP, NGAL, Galectin-3) and matrix remodeling (MMP-9, TIMP-1).Conclusion. Our study will allow for the first time to compare and evaluate the effect of both PCSK9 inhibitors and ezetimibe in combination with high-dose statin therapy on reducing the plaque vulnerability according to CCTA in non-infarction-related coronary arteries in patients with ACS undergoing percutaneous coronary intervention, as well as to evaluate the diagnostic value of inflammatory biomarkers (NLR, hs-CRP, NGAL, Galectin-3) and matrix remodeling (MMP-9, TIMP-1).

12075 Background: Women treated for cancer are more likely to fall than women without a cancer history. Exercise is a fall prevention strategy for older adults that we are testing in the GET FIT trial as a fall prevention approach in women cancer survivors. Increasing physical activity, though, could acutely increase the risk of falls in inactive survivors with known fall risk related to treatment. Knowing who might be at risk prior to beginning an exercise program would inform additional safety precautions during exercise. Methods: We conducted a secondary analysis of baseline data from the GET FIT trial that enrolled inactive, older women who had completed chemotherapy for cancer. Women completed objective (muscle strength, static postural control, range of motion, physical functioning) and self-report (fall history, comorbidities, presence of neuropathy symptoms, pain severity, depressive symptoms, cognitive functioning, perceptions of lower extremity functioning, disability, fear of falling, demographic, and clinical characteristics) measures at baseline. Falls were prospectively collected during the 6 month intervention using monthly self report. Potential predictors of falls were included if univariate tests revealed significant differences between fallers and non-fallers. To identify the strongest predictors of falls, we used an automated model selection and multimodel inference approach to perform an exhaustive model search. Results: Baseline data were available for 415 participants with known faller status at the end of the intervention, of whom 31.3% (n = 130) reported at least one fall. The average age of the sample was 62.1±6.4 years and consisted mostly of non-Hispanic white, married, highly educated, overweight or obese women treated for breast cancer. Fallers (1+ falls) and non-fallers significantly differed on measures of fall history, comorbidities, pain, neuropathy, fear of falling, disability, perceived lower extremity functioning, cognitive functioning, depression, and postural control. The best model of faller status (per BIC) included postural control (p = 0.004), perceived lower extremity functioning (p = 0.072), and fear of falling (p = 0.030). Odds of ≥1 fall during the intervention increased by 1.72 (95% CI: 1.05-2.83) times for a 0.1-point decrease in postural control, 1.11 (1.04-1.19) times for a 0.1-point increase in fear of falling, and 1.02 (1.00-1.03) times for a 1-point decrease in perceived lower extremity functioning. Conclusions: Women cancer survivors with poor balance, poor self-rated functioning, and a fear of falling may need to take additional fall precautions when starting an exercise program. Clinical trial information: NCT01635413.

Multimodal studies motivated by Systemic Functional Linguistics have grown in interest and reach in the millennium, with contributions at the theoretical and methodological level extending across an increasing array of semiotic modes. This thesis drew on developments in tools for multimodal analysis applied across ‘multi’ modes in the broad field of advertising. Specifically, the advertising in the study refers to university brand marketing, more specifically the brand marketing products of posters and short films published by the three public universities in South Australia, The University of Adelaide (UofA) Flinders University (Flinders) and The University of South Australia (UniSA). The primary tools for analysis were Baldry and Thibault’s (2006) Multimodal Transcription and Text Analysis, and O’Halloran and colleagues’ (2013) Multimodal Analysis for Critical Thinking software package. These analytic tools were supplemented by developments in the study of other modes of meanings, including the work of Van Leeuwen (2011) on colour and Machin (2010) on music. The study also used the notion of intermodality, to consider how different modes work together in complementary ways to enhance the meaning making potential available to them separately. A detailed description, analysis and interpretation of the contribution of each semiotic mode used in the posters and films was undertaken, namely of the written language, spoken language, static images, moving images, static typography, kinetic typography, sound and colour, including how they were integrated intermodally. The study aimed to understand how the meanings in the posters and films were created from a multimodal perspective. It highlighted the vast range of meaning making resources at the disposal of the producers of these artefacts, and how the potential was actually realised in a small number of motifs which could be linked to each institution and its identity. The films had more resources to work with and with the use of these additional semiotic modes they had greater interpersonal potential to reach a target audience. There was also evidence of intermodal complementarity, or the relations of meaning between modes. The result of the study provides evidence that university brands are created from a combination of modes in their advertising posters and films. The modes feature consistently in the university brand artefacts to communicate the vision and mission relevant to a current strategic plan. The study also reveals that the university logo is a more permanent identity of a university, from which a brand originates.
Thesis (Ph.D.) -- University of Adelaide, School of Humanities, 2020

The monograph reflects the problems of Russian psycholinguistics from the moment of its inception in Russia to the present day and presents its main directions that are currently developing. In addition, theoretical developments and practical results obtained in the framework of different directions and research centers are described in a concise form. The task of the book is to reflect, as far as it is possible in one edition, firstly, the history of the formation of Russian psycholinguistics; secondly, its methodology and developed methods; thirdly, the results obtained in different research centers and directions in different regions of Russia; fourthly, to outline the main directions of the further development of Russian psycholinguistics. There is no doubt that in the theoretical, methodological and applied aspects, the main problems and the results of their development by Russian psycholinguistics have no analogues in world linguistics and psycholinguistics, or are represented by completely original concepts and methods. We have tried to show this uniqueness of the problematics and the methodological equipment of Russian psycholinguistics in this book. The main role in the formation of Russian psycholinguistics was played by the Moscow psycholinguistic school of A.A. Leontyev. It still defines the main directions of Russian psycholinguistics. Russian psycholinguistics (the theory of speech activity - TSA) is based on the achievements of Russian psychology: a cultural-historical approach to the analysis of mental phenomena L.S. Vygotsky and the system-activity approach of A.N. Leontyev. Moscow is the most "psycholinguistic region" of Russia - INL RAS, Moscow State University, Moscow State Linguistic University, RUDN, Moscow State Pedagogical University, Moscow State Pedagogical University, Sechenov University, Moscow State University and other Moscow universities. Saint Petersburg psycholinguists have significant achievements, especially in the study of neurolinguistic problems, ontolinguistics. The most important feature of Russian psycholinguistics is the widespread development of psycholinguistics in the regions, the emergence of recognized psycholinguistic research centers - St. Petersburg, Tver, Saratov, Perm, Ufa, Omsk, Novosibirsk, Voronezh, Yekaterinburg, Kursk, Chelyabinsk; psycholinguistics is represented in Cherepovets, Ivanovo, Volgograd, Vyatka, Kaluga, Krasnoyarsk, Irkutsk, Vladivostok, Abakan, Maikop, Barnaul, Ulan-Ude, Yakutsk, Syktyvkar, Armavir and other cities; in Belarus - Minsk, in Ukraine - Lvov, Chernivtsi, Kharkov, in the DPR - Donetsk, in Kazakhstan - Alma-Ata, Chimkent. Our researchers work in Bulgaria, Hungary, Vietnam, China, France, Switzerland. There are Russian psycholinguists in Canada, USA, Israel, Austria and a number of other countries. All scientists from these regions and countries have contributed to the development of Russian psycholinguistics, to the development of psycholinguistic theory and methods of psycholinguistic research. Their participation has not been forgotten. We tried to present the main Russian psycholinguists in the Appendix - in the sections "Scientometrics", "Monographs and Manuals" and "Dissertations", even if there is no information about them in the Electronic Library and RSCI. The principles of including scientists in the scientometric list are presented in the Appendix. Our analysis of the content of the resulting monograph on psycholinguistic research in Russia allows us to draw preliminary conclusions about some of the distinctive features of Russian psycholinguistics: 1. cultural-historical approach to the analysis of mental phenomena of L.S.Vygotsky and the system-activity approach of A.N. Leontiev as methodological basis of Russian psycholinguistics; 2. theoretical nature of psycholinguistic research as a characteristic feature of Russian psycholinguistics. Our psycholinguistics has always built a general theory of the generation and perception of speech, mental vocabulary, linked specific research with the problems of ontogenesis, the relationship between language and thinking; 3. psycholinguistic studies of speech communication as an important subject of psycholinguistics; 4. attention to the psycholinguistic analysis of the text and the development of methods for such analysis; 5. active research into the ontogenesis of linguistic ability; 6. investigation of linguistic consciousness as one of the important subjects of psycholinguistics; 7. understanding the need to create associative dictionaries of different types as the most important practical task of psycholinguistics; 8. widespread use of psycholinguistic methods for applied purposes, active development of applied psycholinguistics. The review of the main directions of development of Russian psycholinguistics, carried out in this monograph, clearly shows that the direction associated with the study of linguistic consciousness is currently being most intensively developed in modern Russian psycholinguistics. As the practice of many years of psycholinguistic research in our country shows, the subject of study of psycholinguists is precisely linguistic consciousness - this is a part of human consciousness that is responsible for generating, understanding speech and keeping language in consciousness. Associative experiments are the core of most psycholinguistic techniques and are important both theoretically and practically. The following main areas of practical application of the results of associative experiments can be outlined. 1. Education. Associative experiments are the basis for constructing Mind Maps, one of the most promising tools for systematizing knowledge, assessing the quality, volume and nature of declarative knowledge (and using special techniques and skills). Methods based on smart maps are already widely used in teaching foreign languages, fast and deep immersion in various subject areas. 2. Information search, search optimization. The results of associative experiments can significantly improve the quality of information retrieval, its efficiency, as well as adaptability for a specific person (social group). When promoting sites (promoting them in search results), an associative experiment allows you to increase and improve the quality of the audience reached. 3. Translation studies, translation automation. An associative experiment can significantly improve the quality of translation, take into account intercultural and other social characteristics of native speakers. 4. Computational linguistics and automatic word processing. The results of associative experiments make it possible to reveal the features of a person's linguistic consciousness and contribute to the development of automatic text processing systems in a wide range of applications of natural language interfaces of computer programs and robotic solutions. 5. Advertising. The use of data on associations for specific words, slogans and texts allows you to predict and improve advertising texts. 6. Social relationships. The analysis of texts using the data of associative experiments makes it possible to assess the tonality of messages (negative / positive moods, aggression and other characteristics) based on user comments on the Internet and social networks, in the press in various projections (by individuals, events, organizations, etc.) from various social angles, to diagnose the formation of extremist ideas. 7. Content control and protection of personal data. Associative experiments improve the quality of content detection and filtering by identifying associative fields in areas subject to age restrictions, personal information, tobacco and alcohol advertising, incitement to ethnic hatred, etc. 8. Gender and individual differences. The data of associative experiments can be used to compare the reactions (and, in general, other features of thinking) between men and women, different social and age groups, representatives of different regions. The directions for the further development of Russian psycholinguistics from the standpoint of the current state of psycholinguistic science in the country are seen by us, first of all:  in the development of research in various areas of linguistic consciousness, which will contribute to the development of an important concept of speech as a verbal model of non-linguistic consciousness, in which knowledge revealed by social practice and assigned by each member of society during its inculturation is consolidated for society and on its behalf;  in the expansion of the problematics, which is formed under the influence of the growing intercultural communication in the world community, which inevitably involves the speech behavior of natural and artificial bilinguals in the new object area of psycholinguistics;  in using the capabilities of national linguistic corpora in the interests of researchers studying the functioning of non-linguistic and linguistic consciousness in speech processes;  in expanding research on the semantic perception of multimodal texts, the scope of which has greatly expanded in connection with the spread of the Internet as a means of communication in the life of modern society;  in the inclusion of the problems of professional communication and professional activity in the object area of psycholinguistics in connection with the introduction of information technologies into public practice, entailing the emergence of new professions and new features of the professional ethos;  in the further development of the theory of the mental lexicon (identifying the role of different types of knowledge in its formation and functioning, the role of the word as a unit of the mental lexicon in the formation of the image of the world, as well as the role of the natural / internal metalanguage and its specificity in speech activity);  in the broad development of associative lexicography, which will meet the most diverse needs of society and cognitive sciences. The development of associative lexicography may lead to the emergence of such disciplines as associative typology, associative variantology, associative axiology;  in expanding the spheres of applied use of psycholinguistics in social sciences, sociology, semasiology, lexicography, in the study of the brain, linguodidactics, medicine, etc. This book is a kind of summarizing result of the development of Russian psycholinguistics today. Each section provides a bibliography of studies on the relevant issue. The Appendix contains the scientometrics of leading Russian psycholinguists, basic monographs, psycholinguistic textbooks and dissertations defended in psycholinguistics. The content of the publications presented here is convincing evidence of the relevance of psycholinguistic topics and the effectiveness of the development of psycholinguistic problems in Russia.

AbstractIn Sweden, English is a language with high status, and digitization in particular has made English easily available so that many children learn English outside of school, what is called ‘extramural English’ (Sundqvist and Sylvén 2016), through commercials, music, and different digital media, including online games, YouTube clips, etc.

This chapter asks in what ways recent international developments around the notion of interculturality might enrich English language teaching (ELT) in Norway in tandem with the country’s Core Curriculum and English curriculum. To understand the recent trends in intercultural research and their relevance to ELT, an historical background on the teaching of cultural content in the subject of English is provided. The role of interculturality in the Norwegian Core Curriculum and English curriculum is first considered through a textual analysis, then compared and contrasted to the curricula of 1974 and 2006. Next, issues currently under debate and further exploration in the field of interculturality are outlined, focusing particularly on static and dynamic perceptions of culture. Finally, implications for ELT are discussed and activities inspired by an intercultural pedagogy are suggested. In alignment with the focus on multimodal texts in the English subject curriculum and building on research into the affordances of picturebooks for language and intercultural learning, the author proposes that critical analysis of picturebooks and factual texts about topical issues can address the issues under debate. Through such activities, teachers can provide English language students with opportunities to engage the critical perspectives and symbolic competence required to navigate in the 21st century.

Middle level and secondary students' understanding of social justice can be cultivated through educators' inclusion of multimodal texts in the curriculum. By engaging in critical literacy through ongoing analyses of music lyrics, poetry, and prose related to social justice, students can develop a deeper understanding of the presence/lack of social justice in previous historical eras as well as its role today. Educators can ensure that formal explorations of issues surrounding social justice, such as race and socioeconomic status, become part of the curriculum through the inclusion of relevant multimodal texts. This chapter presents a variety of multimodal pop culture texts—including novels and song lyrics—that can be included in a middle school or high school curriculum focused on social justice education.

John Adams is a biographical miniseries produced and broadcasted by the American satellite network HBO, which ran between March 16 and April 27, 2008. It illustrates the life of the United States' second president, John Adams, from 1770 to his death in 1826. Some of the key scenes deal with the Tea Party of Boston, the process of independence and the signing of the Declaration. This series is a major example of how to use a media source to get the student involved in the lesson while acquiring skills and knowledge belonging to different areas. The development of the American Revolution (for history and geography), the ideals of Liberalism (for philosophy), and the early pamphlets and the Declaration of Independence itself (for literature) are some examples of how the student can get acquainted with a multidisciplinary learning process. The experience has shown how this miniseries helps the student to learn English while watching it (with or without subtitles, regarding the subject's skills), and through several workshops afterwards.

This chapter is based on the Multimodal theory of translation. Although the practice of translation is long-established, the study developed into an academic discipline much later as of the second half of the twentieth century. Before that translation had normally been the element of language learning which was dominated by the Grammar translation method centered on the role study of the grammatical rules and structures of foreign language. The Romantic approach of originality of work has always denied the study of translation as a discipline. The original character of the text has tampered with when it is translated. The idea of Mimesis given by Plato and Aristotle stating all arts as imitative clearly would deny the systematic study of translation. Translation was considered a part of comparative literature but it gained recognition as a separate discipline of study only after the mid-twentieth century along with the emergence of various other disciplines like cultural studies, gender studies, postcolonial studies etc. Since translation studies emerged as an academic discipline, there have been questions about the equivalence of translation from one language to another. But there are also instances in which translation according to the culture is said to be an art in itself. Looking from another perspective, translation from one text to another is entirely dependent on the semantic side of the text which is why a broader study of translation studies can be done in the form of Multi-modality of translation or Inter-medial translation. This inter-medial translation may include the source text in any art form such as films, adaptation, music, dance, sculptures, dubbing, subtitles, paintings and many more. This chapter would focus briefly on translation studies as a discipline in itself, the issues of equivalence and untranslatability and challenge these issues in the form of studying and analyzing various modes in translation.

Emoticons are string of symbols representing body language in text-based communication. For a long time they have been considered as unnatural language entities. This chapter argues that, in over 40-year-long history of text-based communication, emoticons have gained a status of an indispensable means of support for text-based messages. This makes them fully a part of Natural Language Processing. The fact the emoticons have been considered as unnatural language expressions has two causes. Firstly, emoticons represent body language, which by definition is nonverbal. Secondly, there has been a lack of sufficient methods for the analysis of emoticons. Emoticons represent a multimodal (bimodal in particular) type of information. Although they are embedded in lexical form, they convey non-linguistic information. To prove this argument the authors propose that the analysis of emoticons was based on a theory designed for the analysis of body language. In particular, the authors apply the theory of kinesics to develop a state of the art system for extraction and analysis of kaomoji, Japanese emoticons. The system performance is verified in comparison with other emoticon analysis systems. Experiments showed that the presented approach provides nearly ideal results in different aspects of emoticon analysis, thus proving that emoticons possess features of multimodal expressions.

This chapter discusses how humor is generated in Oga at the Top series (OATT), a puppet political satire program featuring prominent actors on the Nigerian political scene. The question of how multimodal phenomena in humor bearing texts combine to create a humorous political commentary has not been addressed within the Nigerian context. This chapter therefore explores how different semiotic resources are combined to create humor in OATT. From the 25 videos selected from Season One, the humor creation mechanisms in OATT were found to include caricature of national leaders, re-interpretation of contemporary happenings, musical parody, script opposition in conversation, inter-texuality and physical violence. Though the stated function of the series was to exploit the Nigerian political climate for humor, the analysis shows that the audience has appropriated the videos for their own ends based on the functions they felt they could serve. The chapter concludes with the significance of the online distribution of the videos.

The Hiawatha Service is an Amtrak intercity passenger rail service operating a 90-mile route between Milwaukee, Wisconsin and Chicago, Illinois. The route has experienced a steady growth in ridership in recent years, carrying more than 815,000 passengers during the 12-month period ending September 2011. Owing to the route’s trip-time competitiveness with the automobile, frequent daily service, an intermodal connection with the airport in Milwaukee, and the multi-state funding partnership between the states of Wisconsin and Illinois, the Hiawatha Service is a model of how passenger rail can be an integral part of the multimodal transportation system in an intercity corridor. In January 2011, researchers from the Texas Transportation Institute (TTI) passenger rail research group, with financial support from the University Transportation Center for Mobility (UTCM) and in partnership with the Wisconsin Department of Transportation (WisDOT), initiated a research project to examine the mobility impacts of the Hiawatha Service intercity passenger rail route. One of the major elements of this research project was an on-board survey of Hiawatha Service passengers, implemented in Spring 2011. This paper reports a summary of selected findings from the 2011 TTI/WisDOT Hiawatha Service passenger survey. The survey obtained valuable information about the current passengers, including data on passenger trip purpose, activities before and after the rail trip, travel alternatives to the Hiawatha Service if the route was not available, motivations for choosing rail for the trip, the impact of potential service changes on increasing ridership, and demographic profile data. A majority of passengers traveling on weekdays were regular commuters or business travelers while personal trips are dominant on weekends. Nearly 70 percent of passengers would drive if the rail service was not available, suggesting that the Hiawatha Service plays a critical role in relieving highway congestion in the region. The results of this study can be used by public agency planning staff and policymakers to guide the development of new intercity passenger rail services in similar corridors across the U.S.

This paper offers insights about the otherwise limited NLM-driven methodologies, supporting an examination of design creativity following the ‘process’ approach. [Abraham 2018] Recent application of AI models which rely on natural language processing (semantic references) is increasingly popular because of their directness and ease-of-use. Neural Language Models (NLMs) like VQGAN+CLIP, DALL-E, MidJourney) offer promising results, [Rodrigues, et al. 2021] seemingly bypassing the need for expensive datasets and technical expertise. Naturally, such models are limited because they cannot capture the multimodal complexity of architectural thinking and human cognition in general [Penrose 1989]. Alternative approaches propose the combination of NLMs with other artificial neural networks (ANNs) i.e. StyleGAN; CycleGAN which are custom-trained on domain-specific data. [Bolojan, Vermisso and Yousif 2022] Architects seek to expand their agency within such AI-assisted processes by controling the input encoding, so they can subsequently convert the generated outcomes to 3D models fairly directly. Still, AI models of computer vision like NLMs and GANs offer 2-dimensional output, which requires extensive decoding into 3-dimensional format. While this may seem severely constraining, it presents a silver lining when it comes to furthering design creativity. Designers are asked to scrutinize their methods from a cognitive standpoint, because these methodologies not only encourage, but demand thorough interrogation of the design intentionality, the design decision making factors and qualification criteria. Text-to-image correlation, on which NLMs rely, and their 2-dimensional output, ensure that certain important considerations are not circumvented. Instead of obtaining a 3D model, multiple possible -fragmented- versions of it are separately implied. Often, ‘fake’ images generated by the ANNs promote contradictory inferences of space, which require further examination. The hidden opportunity within the limited format of AI models echo Neil Spiller’s comments about the advantage of drawing over animation techniques twenty years ago: “Enigma is a creative tool that allows designers to see bifurcated outcomes in their sketches and drawings; it plays on the inability of drawings to faithfully record the distinct placement and extent of architectural elements”. [Spiller 2001] Comparing animations to static drawings, Spiller praised the drawing’s ability to hold “…an imagined past and an imagined future”. ‘Reading’ these results involves the (human) disentanglement of high and low-level features and consciously allocating their corresponding qualities for curation. The process of evaluating ‘parts-to-whole’ visual relationships is noteworthy because it depends on shifting our attention away from certain features, and an unconscious binding of visual elements. [Dehaene 2014] The philosopher Alain wrote that “The art of paying attention, the great art,…supposes the art of not paying attention…the royal art”. [Dehaene 2021]. According to neuroscientists, the brain uses attention as an amplifier and selective filter, during one of the three major attention systems (Alerting; Orienting; Executive Attention). [Dehaene 2021] Orienting our attention addresses what we focus on and what we don’t. Suppressing the unwanted information, through interfering electrical waves, is useful for processing the object of attention. Considering the ANNs’ results at ‘Gestalt’ level, we can structure the AI-assisted process to ensure low-level features (composition) is retained while enhancing high-level (detail) features (Fig.1a).