Academic literature on the topic 'Automotive 3D HMI'

Research has developed various solutions in order for computers to recognize hand gestures in the context of human machine interface (HMI). The design of a successful hand gesture recognition system must address functionality and usability. The gesture recognition market has evolved from touchpads to touchless sensors, which do not need direct contact. Their application in textiles ranges from the field of medical environments to smart home applications and the automotive industry. In this paper, a textile capacitive touchless sensor has been developed by using screen-printing technology. Two different designs were developed to obtain the best configuration, obtaining good results in both cases. Finally, as a real application, a complete solution of the sensor with wireless communications is presented to be used as an interface for a mobile phone.

It is possible to employ printed capacitive sensors in car bezel applications because of its lower cost and higher detecting capabilities. In this paper, a flexible sensor for automotive entertainment applications has been developed using an electrode flexible sensor with an interdigitated pattern printed on it using screen printing and 3D printing fabrication processes. Design concerns such as electrode overlap, electrode gap and width on capacitance changes, and production costs were studied. In addition, a new generation of flexible printed sensors has been developed that can outperform conventional human–machine interface (HMI) sensors. The capacitance of the design pattern may be optimized by using a 15mm overlap and 0.5mm electrode line width. Due to the precision of interpolation, overlap has a larger effect on sensor performance than it would have without it.

With the development of human–computer interaction(s) (HCI), hand gestures are playing increasingly important roles in our daily lives. With hand gesture recognition (HGR), users can play virtual games together, control the smart equipment, etc. As a result, this paper presents a multi-hand gesture recognition system using automotive frequency modulated continuous wave (FMCW) radar. Specifically, we first constructed the range-Doppler map (RDM) and range-angle map (RAM), and then suppressed the spectral leakage, and dynamic and static interferences. Since the received echo signals with multi-hand gestures are mixed together, we propose a spatiotemporal path selection algorithm to separate the mixed multi-hand gestures. A dual 3D convolutional neural network-based feature fusion network is proposed for feature extraction and classification. We developed the FMCW radar-based platform to evaluate the performance of the proposed multi-hand gesture recognition method; the experimental results show that the proposed method can achieve an average recognition accuracy of 93.12% when eight gestures with two hands are performed simultaneously.

The intermittent nature of many renewable energy sources, such as solar and wind, presents the need to acquire on-demand renewable energy either through energy storage or energy production methods. The polymer electrolyte membrane (PEM) fuel cell is quickly becoming an attractive solution as it can produce high power densities under a rapid change in load while producing zero local carbon emissions [1] and is ideal for large-scale applications, such as automotive [2]. However, barriers to their widespread implementation are attributed to the high costs associated with mass transport losses at high current density operation due to inefficiencies in liquid water management in the gas diffusion layer (GDL) [3][4]. Understanding the relationship between liquid water distributions in the cathode GDL and transport properties of PEM fuel cells under varying operating conditions can lead to improved GDL configurations for improved performance. Previously, studies have been conducted to characterize the effect of operating temperature on liquid water pathways in GDLs by using 3D imaging techniques on operando PEM fuel cells [5]. High-speed, high-resolution 3D imaging techniques, such as computed tomography (CT), enable the visualization of dynamic pore-scale effects and are advantageous in elucidating transport mechanisms in the GDL. In this work, the effect of operating relative humidity on the formation of liquid water pathways in the GDL will be explored by imaging an operando PEM fuel cell with synchrotron X-ray CT. To date, a custom PEM fuel cell has been developed in-house which features a novel design with two rotary unions on either side of the cell. The rotary unions enable continuous rotation of the cell during imaging, and thus are central to achieving high temporal resolution for visualizing the development of preferential water pathways. High spatial resolution (pixel resolution of 1.44 microns per pixel [6]) is also obtained with the synchrotron beam, which allows for the visualization of liquid water in individual pores at the microscale in the GDL. Visualizing water in the micropores of the GDL can help us further understand water transport mechanisms within the complex structure of the GDL to ultimately develop methods to expel excess water efficiently. In the next steps of this research, we will use the results from electrochemical testing and the reconstructed images of the fuel cell to draw important conclusions about the relationship between liquid water distributions in the GDL and fuel cell performance. As well, the effect that operating relative humidity has on this relationship will be determined. The aim of this work is to inform optimal design for GDL materials for improved PEM fuel cell performance, which will ultimately accelerate their utilization on a global scale as a reliable and sustainable energy source. [1] P. Shrestha, CH. Lee, K. F. Fahy, M. Balakrishnan, N. Ge, and A. Bazylak, “Formation of Liquid Water Pathways in PEM Fuel Cells: A 3-D Pore-Scale Perspective,” Journal of The Electrochemical Society, vol. 167, no. 5, p. 054516, Jan. 2020, doi: 10.1149/1945-7111/ab7a0b. [2] S. Park, J. W. Lee, and B. N. Popov, “A review of gas diffusion layer in PEM fuel cells: Materials and designs,” International Journal of Hydrogen Energy, vol. 37, no. 7, pp. 5850– 5865, Apr. 2012, doi: 10.1016/J.IJHYDENE.2011.12.148. [3] Y. Nagai et al., “Improving water management in fuel cells through microporous layer modifications: Fast operando tomographic imaging of liquid water,” Journal of Power Sources, vol. 435, p. 226809, Sep. 2019, doi: 10.1016/J.JPOWSOUR.2019.226809. [4] U. U. Ince et al., “3D classification of polymer electrolyte membrane fuel cell materials from in situ X-ray tomographic datasets,” International Journal of Hydrogen Energy, vol. 45, no. 21, pp. 12161–12169, Apr. 2020, doi: 10.1016/J.IJHYDENE.2020.02.136. [5] Hong Xu, Shinya Nagashima, Hai P. Nguyen, Keisuke Kishita, Federica Marone, Felix N. Büchi, Jens Eller, Temperature dependent water transport mechanism in gas diffusion layers revealed by subsecond operando X-ray tomographic microscopy, Journal of Power Sources, Volume 490, 2021, 229492, ISSN 0378-7753, https://doi.org/10.1016/j.jpowsour.2021.229492. [6] Canadian Light Source, “Detectors,” BMIT. [Online]. Available: https://bmit.lightsource.ca/tech-info/detectors/. [Accessed: 05-Apr-2022].

In the new issue, our scientific journal offers you nine scientific articles. As always, we try to offer a wide variety of topics and areas and follow current trends in the history of science and technology. The issue of the journal opens with an article dedicated to the formation and development of natural history museology in Europe in the 15th–19th centuries. The development of scientific knowledge at that time affects the idea of the world order and the place of man in it, and the combination of knowledge with practical experience leads to the birth of true science. It is shown that one of the most important components of the development of natural sciences, in particular biological sciences, was the collection of naturalia (i.e. objects of natural origin), the rapid surge of interest in which contributed to the Great Geographical Discoveries. In chronological order, the further historical development of museum work from private collections in Italy to the formation of a prototype of a genuine museum, which performs the main museum functions such as amassment, storage and demonstration of collections, is considered. The article by Leonid Griffen and co-authors considers the object and subject of the history of science and technology, its place in the system of sciences. Today, more and more people are turning to the factors that determine the interaction of the society with the environment (productive forces of the society), to study which in the historical aspect and called a special scientific discipline the history of science and technology. The composition and development of the technosphere and noosphere are considered in the article. It is shown that the functioning of the technosphere is based on its interaction with the noosphere, which provides information about the environment and controls the effectiveness of interaction with it. It is formed by combining the mental structures of individuals through sign systems. The production process that ensures the functioning of the society begins with the noosphere, which through individual consciousness controls the actions of each individual, who through the means of production (technosphere) interacts with the natural environment. However, the gradual development of productive forces leads at some point to the fact that the information needed by the individual to perform all necessary actions for the benefit of the society, ceases to fit in his individual consciousness. As a result, there is a new social phenomenon the social division of labor. The cardinal solution to the problem is the prospect of humanity entering infinite space. The article by Jun-Young Oh and Hyesook Han is devoted to the study of what Understanding mathematical abstraction in the formularization of Galileo's law. Galileo's revolution in science introduced an analytical method to science that typifies the overall modern thinking of extracting, abstracting, and grasping only critical aspects of the target phenomena and focusing on “how”, which is a quantitative relationship between variables, instead of “why”. For example, to him, the question of 'why does an object fall' is of no significance; instead, only the quantitative relationship between distance from the falling object and time is important. Yet, the most fundamental aspect of his idea is that he introduced a quantified time t. Because, according to atomic theory, vacuum exists between an atom and an object composed of atoms or between objects – ignoring factors that interfere with motion, such as friction – the space for absolute time, which is a mathematical time, can be geometrically defined. In order to justify this mathematical abstraction strategy, thought experiments were conducted rather than laboratory experiments, which at that time were difficult to perform. The article by Vasyl Andriiashko and co-authors provides a thorough overview of the evolutionary process of the emergence, establishment, and development of the Kyiv school of artistic textiles. It reveals the influence of various factors (ideological, political, economic, and aesthetic) on this process. The historical and factual method allowed us to study socio-economic, as well as historical and cultural factors that contributed to the emergence, establishment, and development of the Kyiv textile school in a chronological sequence. It is established that the very fact of emergence of the Kyiv school of artistic textile, as a community of style, unity of forms, preservation, and continuity of traditions, had unbiased backgrounds since Ukrainian decorative weaving, a part of which is Kyiv weaving, inherited the abundant artistic traditions that were created over the centuries and most vividly manifested through the art of Kyivan Rus. In the next article, the authors Artemii Bernatskyi and Mykola Sokolovskyi is devoted to the study history of military laser technology development in military applications. For better understanding and systematization of knowledge about development of historical applications in the military field, an analysis of publicly known knowledge about their historical applications in the leading world countries was conducted. The study focuses on development that was carried out by the superpowers of the Cold War and the present era, namely the United States, the Soviet Union and the Peoples Republic of China, and were built in metal. Multiple avenues of various applications of laser technology in military applications were studied, namely: military laser rangefinders; ground and aviation target designators; precision ammunition guidance systems; non-lethal anti-personnel systems; systems, designed to disable optoelectronics of military vehicles; as well as strategic and tactical anti-air and missile defense systems. The issues of ethical use of laser weapons and the risks of their use in armed conflicts, which led to an international consensus in the form of conventions of the United Nations and the International Committee of the Red Cross, were also considered. As a result of the analysis, a systematic approach to the classification of applications of laser technology in military products by three main areas of development was proposed: ancillary applications, non-lethal direct action on the human body and optical devices of military equipment, and anti-aircraft and anti-missile defensive systems. The author of the following article considered the front line transporter as the embodiment of the USSR military doctrine in the middle of the 20th century. The paper based on a source analysis of the history of creation, design, and production of LuAZ-967, LuAZ-967M, against the background of the processes of implementing projects of small tactical high mobility wheeled vehicles for the armies of European countries, shows that the developing, testing, and commissioning a front line transporter became a deepening of the process of motorization of the Soviet army. The designs of similar vehicles have been analyzed. An attempt to assess the degree of uniqueness of the front line transporter design and its place in the history of technology, as well as its potential as a reminder of science and technology has been made. An analysis of the front line transporter design, its systems, compared with its foreign counterparts, suggests that it is a Soviet refinement of the concept of a small army vehicle, a more specific means directly for the battlefield. At the same time, it was developed taking into account foreign developments and similar designs, imitating individual designs, adapting to the capabilities of the USSR automotive industry. The next article is devoted to the study, generalization and systematization of scientific knowledge about the history of the establishment, development and operation of the regional railway system in Bukovyna in the second half of XIX – early XX centuries. The authors attempted to analyze the process of creation and operation of railways in Bukovyna during the reign of the Austro-Hungarian Empire based on a wide range of previously unpublished archival documents, periodicals, statistical literature and memoirs. The article studies the development of organizational bases for the construction of railways, the activity of the communication network management, lists a whole range of requirements and tasks set for railway transport in Bukovyna, the progress of their implementation, considers successes and difficulties in this work. The purpose of the article by authors Sana Simou, Khadija Baba and Abderrahman Nounah is to reveal, recreate as accurately as possible the characteristics of an archaeological site or part of it. The restoration and conservation of monuments and archaeological sites is a delicate operation. It requires fidelity, delicacy, precision and archaeological authenticity. Research during the last two decades has proved that 3D modeling, or the digital documentation and visualization of archaeological objects in 3D, is valuable for archaeological research. The study has opted for the technique of terrestrial and aerial photogrammetry by 3D surveys of architectural elements, to develop an archetype of the deteriorated Islamic Marinid site (a dynasty between the 13th and 15th centuries), and the Roman site (25 BC), located at the Chellah archaeological site in Rabat and Salé cities. The data acquired build an architectural database to archive and retrieve the entire existing architecture of monuments. This study has been completed by photogrammetrists, architects, and restorers. The issue of the journal ends with an article devoted to the analyzing the prerequisites and conditions for the foundation of an aircraft engine enterprise in Ukraine. Based on the retrospective analysis, the prerequisites and conditions of the foundation of the aircraft engine enterprise in Aleksandrovsk, Ukraine, were considered. There was a severe gap between the Russian Empire and European countries in the development pace of the aviation industry during World War I. This prompted the Russian Empire to raise foreign capital, as well as attract technologies and specialists to develop aircraft engineering and other industries. By 1917, the plant had gained the status of Russia’s largest engine-building enterprise in terms of building area and one of the best in equipment. It is evident that the beginning of aircraft engine production in Aleksandrovsk relates to the establishment of a branch of Petrograd Joint Stock Company of Electromechanical Structures and the plant’s purchase from the Moznaim brothers. We hope that everyone will find interesting useful information in the new issue. And, of course, we welcome your new submissions.

Prosthetic limbs present a highly unique research challenge, requiring intense customization for optimal use cases. These challenges are heightened for athletes, who engage with their prosthetics in highly competitive environments, placing them under tremendous stress. Thomas Normandeau, a champion Para Athlete, approached Camosun Innovates to develop such a prosthetic, able to aid him in his training regimens and reduce the risk of injury. Camosun Innovates undertook a human-centered design approach that foregrounded Normandeau’s needs and observations. Through a mixture of digital scanning and 3D-printed parts constructed using Nylon 12, a unique carbon-reinforced nylon traditionally used in the aerospace and automotive industries, the Camosun team was able to rapidly iterate a customized, properly-fitted prosthetic with unique, lightweight joint pieces precisely calibrated to Normandeau’s arm length, and without sacrificing the prosthetic’s ability to hold up under tension. The success of this prototype holds potential for other prosthetics both within and without the athletic sphere, with the potential to help users with exercise routines and common lifting and carrying tasks, from grocery shopping to household chores.

This paper outlines the forensic procedure and techniques used in the reconstruction and safety assessment of a fatal overhead crane accident. The decedent (a subcontractor) was working as a pipe fitter at a manufacturing plant. At the time of the accident, the decedent had climbed up onto an overhead crane rail to move existing pipework when the crane struck and killed him. This paper presents the application of various techniques/methodologies to reconstruct the complex accident, including 3D HD scanning, drone video imaging, and 3D modeling/principles of photogrammetry to understand how the incident occurred and provide visualizations of the construction project. Safety analysis was conducted by analyzing crane maintenance and operation as well as the duties/responsibilities of the different employers and comparing industrial standards and practices such as OSHA, ANSI, and safety principles.

Afin d’améliorer l’expérience utilisateur de leurs véhicules, les constructeurs automobiles recherchent des systèmes d’affichage et de contrôles innovants, tels des dispositifs permettant de produire des images 3D. Pour ceci, l’holographie est une solution a priori très performante car elle permet de générer une scène 3D incluant la majorité des indices de perception de la 3D nécessaire au cerveau humain. Si la production en série d’hologrammes « classiques » (i.e. à enregistrement optique) est trop contraignante pour les applications automobiles, les hologrammes synthétiques en relief de surface sont compatibles avec la technique de nano-imprint et peuvent donc aisément être produits en grande série. Mais le milieu automobile impose de plus de fortes contraintes de coût, de compacité du système et de sécurité oculaire. Le recours à une illumination LED des hologrammes est donc largement préférable à l’illumination laser généralement utilisée. Une solution holographique illuminé par LED et générant la perception d’un objet flottant, dans le cadre d’une application d’IHM intérieure au véhicule est démontrée. La réalisation d’une étude statistique confirmant que la grande majorité des observateurs perçoivent la scène 3D flottante correctement est détaillée et discutée. Enfin, la démonstration d’une extension de l’approche encore plus compacte en permettant l’illumination par de multiples sources LED distinctes d’un hologramme synthétique générant une image flottante perçue en 3D est présentée
To improve the user experience in their vehicles, automotive manufacturers are searching for innovative display and control systems, such as devices producing 3D images. Holography is an attractive solution as it can generate 3D scenes incorporating most of the perceptual cues necessary for the human brain. While mass production of "classic" holograms (i.e., optically recorded) for automotive applications has strong constraints, surface relief synthetic holograms are compatible with nano-imprint technology, allowing easy large-scale production. However, the automotive environment imposes additional constraints of cost, system compactness, and eye safety. In this automotive context, the use of LED illumination for holograms is therefore highly preferable to the commonly used laser illumination. We demonstrate an LED illuminated holographic solution that creates the perception of a floating object, targeting an in-vehicle human-machine interface (HMI) application. We also present a statistical study confirming that a large majority of observers perceive the floating 3D scene correctly. Finally, we demonstrate an even more compact extension of the approach enabling simultaneous illumination by multiple distinct LED sources of a single synthetic hologram, generating the perception of floating 3D image

This paper presents a novel approach for the configuration and runtime usage of user interfaces or Human Machine Interface (HMI) systems based on research being conducted at the Distributed Systems Group, Loughborough University. This research is investigating the replacement of conventional PLC/PC systems with a Component Based control approach suitable for the automotive engine manufacturing industry. HMI (operator interface) systems for production machines must effectively fully support an increasingly complex machine lifecycle involving engineering input from many globally distributed engineering partners. Current HMI Systems are standalone offering poor connectivity and requiring highly specialist skilled personnel to develop and maintain the systems. The goal of Component Based (C-B) systems is to compose machines from modular units with embedded intelligence. The “intelligence” has different functional domains, e.g. sequencing and interlocking logic, 3D virtual modeling, visualization, diagnostics, service and operating interfaces, etc. The underlying framework of the C-B paradigm is a common model system repository where all components are stored. This facilitates visibility of the system common model to all the globally distributed engineering partners involved in a given project. Within the C-B framework, HMI systems are composed from instances of reusable software templates that are targeted at specific user types. User targeted operator interfaces offer a common look and feel that improves usability. The machine’s configuration is achieved by populating a series of HMI templates to produce a complete machine HMI system. A thin-client architecture is used based on server/ client internet technologies that allow the machine HMI to be executed on any internet enabled computer using a standard web browser. It is possible to drive both the real machine and a simulated 3D virtual machine model via the HMI, enabling engineers to be trained on the operation of the HMI prior to the real machine being completed.

Human Machine Interactions Systems (HMI) are decisive for acceptance and safety of new cockpits in the automotive as well as in the aerospace industries. A new design and simulation platform called INSIDES will be presented where virtual cockpit prototypes are being built based on 3D CAD geometry e.g. from CATIA and integrated with logical interaction data derived from UML specifications. This new development platform enables the continuous validation and check of new interaction concepts by involving usability engineers in the very early stage of the development cycle. Since the simulation work is being done in the context of the entire aircraft cockpit / car interior with all instruments, control commands as well as displays devices a better validation of HMI systems can be achieved.

Although automation and robotics are widely implemented in manufacturing industry nowadays, assembly tasks and rework processes are still carried out manually by human operators because of their complexity and the need for a level of adaptability and flexibility greater than automation solutions can provide. However, manual operations exhibit variability and are subject to human errors, which could lead to unexpected delays or quality issues. Enabling traceability of manual operations is also intrinsically more challenging than for automated processes as it typically relies on the operator consistently providing direct input (e.g. HMI/operator interaction).Research suggests that augmented reality (AR) technology can contribute to enhance human-machine interaction by providing operators with a seamless digital bi-directional interface with physical systems (e.g. product or production systems), thus improving manual operations’ overall effectiveness. Existing research related to the development of AR-based solutions for manufacturing focus essentially on training and maintenance use cases, while there is limited development of applications aiming at supporting in-production operations. In addition, while AR technologies are used to provide information to the operator, the development of capabilities allowing manual process and operators to be monitored during operations, are lacking. The research presented in this paper adopt a holistic approach combining manual operation monitoring and operator feedback capabilities. The DAMPO (Digitally Augmented Manual Process Optimisation) system implements a) computer vision technologies to provide continuous operator and manual operations monitoring capabilities b) content rich and highly interactive user interfaces using screen-based 3D and AR-based information display, and c) near real-time data capture, management and processing pipelines that provide both real-time system/user interaction and collection of historical process data. The use case for this research focuses on specific manual assembly operations of safety critical components of seating systems for the automotive industry, which require precise sequence of operations and full traceability of the assembly process for audit purposes (safety critical operations). The DAMPO system is implemented in the Automation Systems Group's Digital Automation Laboratory at the University of Warwick, WMG department, UK, and is used to support both low TRL level research and direct engagement with industry on developing human centric manufacturing solutions. The DAMPO systems implement both process monitoring capabilities (i.e. data capture) and Electronic Work Instruction functions (information feedback and presentation of the operator) in view of improving process traceability and implementing no-fault forward capabilities. The DAMPO solutions combines a wide range of a) visual computing methods (fiducial, IR marker and 3D object based pose estimation), and b) information display and operator interface technologies (e.g. projected, screen-based and head-mounted AR layer display, HMI and work instruction screens with interactive 3D content, haptic feedback), which can be combined differently depending on the use case, and use case requirements such as hand free operations, complexity of work instructions or operator feedback and interactions, etc. This production-ready solution is tested and evaluated on a replicable production cell using real product and real assembly process.