Статті в журналах з теми "Mobile robotic telepresence"

Mobile robotic telepresence (MRP) systems incorporate video conferencing equipment onto mobile robot devices which can be steered from remote locations. These systems, which are primarily used in the context of promoting social interaction between people, are becoming increasingly popular within certain application domains such as health care environments, independent living for the elderly, and office environments. In this paper, an overview of the various systems, application areas, and challenges found in the literature concerning mobile robotic telepresence is provided. The survey also proposes a set terminology for the field as there is currently a lack of standard terms for the different concepts related to MRP systems. Further, this paper provides an outlook on the various research directions for developing and enhancing mobile robotic telepresence systems per se, as well as evaluating the interaction in laboratory and field settings. Finally, the survey outlines a number of design implications for the future of mobile robotic telepresence systems for social interaction.

In this paper, we focus on spatial formations when interacting via mobile robotic telepresence (MRP) systems. Previous research has found that those who used a MRP system to make a remote visit (pilot users) tended to use different spatial formations from what is typical in human-human interaction. In this paper, we present the results of a study where a pilot user interacted with ten elderly via a MRP system. Intentional deviations from known accepted spatial formations were made in order to study their effect on interaction quality from the local user perspective. Using a retrospective interviews technique, the elderly commented on the interaction and confirmed the importance of adhering to acceptable spatial configurations. The results show that there is a mismatch between pilot user behaviour and local user preference and that it is important to evaluate a MRP system from two perspectives, the pilot user’s and the local user’s. Keywords: F-formations; Mobile Robotic Telepresence; MRP systems; Quality of Interaction; Retrospective Interview; Spatial Formations; Spatial Configurations

Social robots have an enormous potential for educational applications and allow for cognitive outcomes that are similar to those with human involvement. Remotely controlling a social robot to interact with students and peers in an immersive fashion opens up new possibilities for instructors and learners alike. Using immersive approaches can promote engagement and have beneficial effects on remote lesson delivery and participation. However, the performance and power consumption associated with the involved devices are often not sufficiently contemplated, despite being particularly important in light of sustainability considerations. The contributions of this research are thus twofold. On the one hand, we present telepresence solutions for a social robot’s location-independent operation using (a) a virtual reality headset with controllers and (b) a mobile augmented reality application. On the other hand, we perform a thorough analysis of their power consumption and system performance, discussing the impact of employing the various technologies. Using the QTrobot as a platform, direct and immersive control via different interaction modes, including motion, emotion, and voice output, is possible. By not focusing on individual subsystems or motor chains, but the cumulative energy consumption of an unaltered robot performing remote tasks, this research provides orientation regarding the actual cost of deploying immersive robotic telepresence solutions.

F-formations are a set of possible patterns in which groups of people tend to spatially organize themselves while engaging in social interactions. In this paper, we study the behavior of teleoperators of mobile robotic telepresence systems to determine whether they adhere to spatial formations when navigating to groups. This work uses a simulated environment in which teleoperators are requested to navigate to different groups of virtual agents. The simulated environment represents a conference lobby scenario where multiple groups of Virtual Agents with varying group sizes are placed in different spatial formations. The task requires teleoperators to navigate a robot to join each group using an egocentric-perspective camera. In a second phase, teleoperators are allowed to evaluate their own performance by reviewing how they navigated the robot from an exocentric perspective. The two important outcomes from this study are, firstly, teleoperators inherently respect F-formations even when operating a mobile robotic telepresence system. Secondly, teleoperators prefer additional support in order to correctly navigate the robot into a preferred position that adheres to F-formations.

Caregivers in eldercare can benefit from telepresence robots that allow them to perform a variety of tasks remotely. In order for such robots to be operated effectively and efficiently by non-technical users, it is important to examine if and how the robotic system’s level of automation (LOA) impacts their performance. The objective of this work was to develop suitable LOA modes for a mobile robotic telepresence (MRP) system for eldercare and assess their influence on users’ performance, workload, awareness of the environment, and usability at two different levels of task complexity. For this purpose, two LOA modes were implemented on the MRP platform: assisted teleoperation (low LOA mode) and autonomous navigation (high LOA mode). The system was evaluated in a user study with 20 participants, who, in the role of the caregiver, navigated the robot through a home-like environment to perform control and perception tasks. Results revealed that performance improved in the high LOA when task complexity was low. However, when task complexity increased, lower LOA improved performance. This opposite trend was also observed in the results for workload and situation awareness. We discuss the results in terms of the LOAs’ impact on users’ attitude towards automation and implications on usability.

This article reports on the EU project ExCITE with specific focus on the technical development of the telepresence platform over a period of 42 months. The aim of the project was to assess the robustness and validity of the mobile robotic telepresence (MRP) system Giraff as a means to support elderly people and to foster their social interaction and participation. Embracing the idea of user-centered product refinement, the robot was tested over long periods of time in real homes. As such, the system development was driven by a strong involvement of elderly people and their caregivers but also by technical challenges associated with deploying the robot in real-world contexts. The results of the 42-months’ long evaluation is a system suitable for use in homes rather than a generic system suitable, for example, in office environments.

Mobile robotic telepresence (MRP) systems feature a video conferencing interface on a mobile robot, enabling pilot users to remotely control the robot while communicating with a local user. For older adults in an assisted living facility, the operators are mostly caregivers or remote family members. This small-sample usability testing aimed to evaluate the use of MRP by the older adult. Participants navigated the robot to locations in the home, e.g., to check if the front-door is closed. Two levels of automation were introduced; assisted teleoperation and autonomous. Observations revealed that the older adults enjoyed the dexterity with which the robot could be teleoperated in the assisted teleoperation mode. Yet, they preferred the operation of the MRP at the autonomous mode where the robot navigated autonomously towards the locations the user indicated. Usability, preference and objective findings raise awareness regarding elder care assistive robot developmental factors. Future experimental plans are discussed.

Web-based guide robot as an example of Internet of Robotic Things is controlled through web and share guide information on web within a network. Using web browser, any device connected to the Internet can control this robot and get the data provided. Robot in the form of Telepresence Bot has a web server hosting webpages for user interface and guide information. Therefore, a users both distant and near the robot can access guide information via web using their mobile devices. In this paper, we present how to design web-based guide robot and implement university campus guide robot as one of its applications.

This paper presents a framework enabling navigational autonomy for a mobile platform with application scenarios specifically requiring a humanoid telepresence system. The proposal promises a reduced operator workload and safety during robot motion. In addition, the framework enables the inhabitor (human controlling the platform) to provide inputs for head and arm gesticulation. This allows the inhabitor to focus on interactions at the remote environment, rather than being engrossed in controlling robot navigation. This paper discusses the development of higher-level, human-like navigational behaviors such as following, accompanying, and guiding a person autonomously. A color histogram comparison and position matching algorithm has been developed to track the person using the Kinect sensors. In addition to providing a safe and easy-to-use system, the high-level behaviors are also required to be human-like in that the mobile platform obeys the laws of proxemics and other human interaction norms such as walking speed. This facilitates a higher level of experience for other humans interacting with the robotic platform. An obstacle avoidance function has also been implemented using the virtual potential field method. A preliminary evaluation was also conducted to validate the algorithm and to support the claim of reducing operator cognitive load due to navigation. In general, it was shown that navigation over a given route was accomplished at a faster pace with no instances of collision with the environment.

Brain-computer interfaces represent a range of acknowledged technologies that translate brain activity into computer commands. The aim of our research is to develop and evaluate a BCI control application for certain assistive technologies that can be used for remote telepresence or remote driving. The communication channel to the target device is based on the steady-state visual evoked potentials. In order to test the control application, a mobile robotic car (MRC) was introduced and a four-class BCI graphical user interface (with live video feedback and stimulation boxes on the same screen) for piloting the MRC was designed. For the purpose of evaluating a potential real-life scenario for such assistive technology, we present a study where 61 subjects steered the MRC through a predetermined route. All 61 subjects were able to control the MRC and finish the experiment (mean time 207.08 s, SD 50.25) with a mean (SD) accuracy and ITR of 93.03% (5.73) and 14.07 bits/min (4.44), respectively. The results show that our proposed SSVEP-based BCI control application is suitable for mobile robots with a shared-control approach. We also did not observe any negative influence of the simultaneous live video feedback and SSVEP stimulation on the performance of the BCI system.

With the increased aging population, and declined support from the families, societies will need new tools to ensure the well-being of the elderly. Many of them would prefer living at home, but they will need help and assistance from someone. Technological innovations in the field of robotic systems can be used to enable independent living, to prolong the life of the elderly in their familiar home environments, to maintain the social connections by reducing social isolation and to improve the quality of life in general. In this paper, we present the design and validation of a low-cost mobile robot system that can assist elderly and professional caregivers in everyday activities. The robot structure and its control objectives are described in detail. The developed assistive telepresence robot was tested in simulation and experimentally. On field experiments were conducted in real environment, with potential end users, which is a major advantage of this study. The results of the evaluation were very satisfactory and have shown that participants can operate the robot safely and efficiently. The participants were very satisfied with the performance and features of the robot.

BackgroundWhile an explosion in technological sophistication has revolutionised surgery within the operating theatre, delivery of surgical ward-based care has seen little innovation. Use of telepresence allowing offsite clinicians communicate with patients has been largely restricted to outpatient settings or use of complex, expensive and static devices. We designed a prospective study ascertaining feasibility and face validity of a remotely controlled mobile audiovisual drone (LUCY) to access inpatients. This device is, uniquely, lightweight, freely mobile and emulates ‘human’ interaction by swiveling and adjusting height to patients’ eye-level.MethodsRobot-assisted ward rounds (RASWRs) were conducted over 3 months. A remotely located consultant surgeon communicated with patients/bedside teams via encrypted audiovisual telepresence robot (DoubleRobotics, Burlingame, CA). Likert-scale satisfaction questionnaires, incorporating free-text sections for mixed-methods data collection, were disseminated to patient and staff volunteers following RASWRs. The same cohort completed a linked questionnaire following conventional (gold-standard) rounds, acting as a control group. Data were paired and non-parametric analysis was performed.ResultsRASWRs are feasible (>90% completed without technical difficulty). The RASWR (n = 52 observations) demonstrated face validity with strong correlations (r > 0.7; Spearman, p-value < 0.05) between robotic and conventional ward rounds among patients and staff on core themes, including dignity/confidentiality/communication/satisfaction with management plan. Patients (96.08%, n = 25) agreed RASWR were a satisfactory alternative when consultant physical presence was not possible. There was acceptance of nursing/non-consultant hospital doctor cohort [100% (n = 11) willing to regularly partake in RASWR].ConclusionRASWRs receive high levels of patient and staff acceptance, and offer a valid alternative to conventional ward rounds when a consultant cannot be physically present.

Doctors are usually needed to work at every hospital and emergency center every now and then. But it is not feasible for every doctor to be available at every place at desired time. The problem with video calling is that video calls need to be done from a PC or laptop on a desk. This limits the doctor’s capacity to view patient or around operation theatre at will or even move through hospital rooms as needed. To help solve this issue we here develop a virtual doctor robot that allows a doctor to virtually move around at a remote location at will and even talk to people at remote location as desired. This robot provides a whole lot of advantages for doctors: Doctors’ ability to be at anyplace anytime, Doctors can move around in operation theatres, Doctors can move around the patient with ease, Doctors can see medical reports remotely via video calls, Doctors can move around in other rooms at will. The system makes use of a robotic vehicle with 4-wheel drive for easy navigation. The robot also includes a controller box for circuitry and a mounting to hold a mobile phone or tablet. The mobile or tablet is used to hold live video calls. The doctor can use an IOT based panel to control the robot. The control commands sent online are received by the robot controller. The robot controller operates over Wi-Fi internet. The commands are received in real time andthe robot motors are operated to achieve the desired movement commands. Keywords – Telemedicine, Telepresence robot, IoT healthcare, Remote patient monitoring Medical robotics

Abstract Robot-based service platforms are currently establishing themselves as new and affordable variants for supporting care in elderly, retirement and nursing homes. Many are open multifunctional platforms, which can potentially be integrated into such environments, if the necessary infrastructure is available. Furthermore, many services can be realized on these platforms, which can be used to foster distant interactions between inhabitants and care-providers, while simultaneously keeping up the quality of life of the inhabitants. Open mobile robotic platforms allow the extension with adequate new sensors. To detect infectious diseases of residents and healthcare-professionals, optical sensors can be used for the assessment of vital data such as heartrate and heartrate variability, respiratory rate, SpO2 or temperature. Additionally, you can consider demographic data (age, gender, constitution) of the observed person for the optical assessment, i.e. obtained by facial image analysis. As these mobile platforms are also equipped for telepresence, in case of detecting an infected person, these systems support video conferencing with their built-in cameras and microphones. Finally, the interaction with the electronic care record is necessary to upload all acquired vital data and further relevant information. All the named technologies have been under investigation in the past years and are currently moving from laboratory settings to real-world scenarios. Nevertheless, the smooth integration of all components into one system architecture in combination with (AI-based) data analysis are still open issues.

According to existing forecasts, after 2030, an intelligent, three-dimensional, ultra-dense, integrated, terabyte, terahertz, tactile, and touch-scanning wireless communication system of the sixth generation (6G) will be deployed. Spatial features will be very significant for it, which necessitates geographical research. Therefore, an attempt has been made to determine the future directions of the geographical study of 6G networks based on a comparison of network parameters with the existing experience of knowing the spatial and temporal features of the deployment of information and communication networks. The main attention is paid to the infrastructure and the telecommunication services. The infrastructure includes cloud data centers, stationary and mobile base stations, subscriber and robotic devices, radiating surfaces, sensors, and other network elements. Future services will be represented by ubiquitously connected artificial intelligence, sensory scanning of the environment, holographic telepresence, augmented reality, tactile communication, three-dimensional positioning, and other services. It is proposed to develop geographical research in the following areas: deployment of a spatially distributed network; info-communication-network development of space; identification of “smart” agglomerations and regions; spatial diffusion of telecommunications services; center-peripheral digital inequality; and artificial intelligence specialization of regions. Applied work is proposed to be carried out on the geographical expertise of network projects, optimization of the linear-node structure and recommendations of the 7G network parameters. For each of the nine directions, general characteristics and possible division into particular directions are given. Within the framework of the selected directions, the proposed periodization of the main research tasks is shown from the development of a methodology for geographical cognition of 6G networks in the 2020s to obtaining empirical results in the 2030s and their subsequent discussion for the transition to 7G in the 2040s.

Mobile clients for telepresence robots are cluttered with interactive elements that either leave a little room for the camera feeds or occlude them. Many do not provide meaningful feedback on the robot's state and most require the use of both hands. These make maneuvering telepresence robots difficult with mobile devices. TiltWalker enables controlling a telepresence robot with one hand using tilt gestures with a smartphone. In a series of studies, we first justify the use of a Web platform, determine how far and fast users can tilt without compromising the comfort and the legibility of the display content, and identify a velocity-based function well-suited for control-display mapping. We refine TiltWalker based on the findings of these studies, then compare it with a default method in the final study. Results revealed that TiltWalker is significantly faster and more accurate than the default method. Besides, participants preferred TiltWalker's interaction methods and graphical feedback significantly more than those of the default method.

Due to an increase in the number of disabled people around the world, inclusive solutions are becoming a priority. People with disabilities may encounter many problems and may not be able to easily participate in various activities due to physical barriers, which may sometimes cause them to be frustrated and embarrassed. Recently, the emerging telepresence robot technology has been proposed to enable people with disabilities to increase their presence by incorporating information and communications technology (ICT) into robotics platforms. Therefore, in this paper we conduct a comprehensive analysis using comparative and elicitation studies to understand the current state of mobile telepresence robot systems and to identify the gaps that must be filled. This paper further contributes to the literature by proposing a novel telepresence robot system that adapts text-to-speech (TTS) and ICT technologies with robotics for its use as an assistant. To the authors’ knowledge, the proposed system is the first MRP system that supports speech impairment and introduces emotion components into its communication function. It includes an operator site (mobile) and a remote site (robot) to allow users to control the robot from a distance and communicate with others in remote locations. It allows the user to physically interact with people and show certain emotions through the robot in remote locations, or it can accompany them to speak on their behalf. It can provide agency for both remote and in-class users through emoji-based communication and audio–video streaming with recording functionality. As shown at the end of this paper, the system was tested with 30 people, some of whom had mobility or speech disabilities, showing that the user acceptance score was above 95% and that people with disabilities liked to interact with other people using the proposed system. The users appreciated having the ability to control the robot from a distance and praised the capability to show their emotions through the robot emoji motions and to control the audio–video streaming. From this study, we conclude that the proposed telepresence system could be an asset to people with speech and mobility disabilities and could help them feel physically present in various places.

It is not always feasible or practical to be present at a location of interest. Telepresence makes such possible. This paper presents the design and implementation of a telepresence system in which a mobile manipulator robot is utilized to explore a museum at a remote site, sending live video and audio on demand to a user at the local site. The user's sense of presence is also enhanced through the capability to manipulate objects remotely via the robot's gripper. The display system is a slightly modified, off-the-shelf mediascope, a television display system that can be worn like a pair of glasses. The head movements of the user are monitored using color tracking, and the displayed images are updated according to the motions of the head. This is achieved by interpreting the human head movements and transforming them into control signals for appropriate movements of the robot and its mounted color camera. Novel features of the presented system include utilization of human implicit commands, availability and cost-effectiveness of the system, feeling of presence, and intelligence fusion of the human user (where to go and what to do) with the robot's intelligence (local obstacle avoidance and navigation). The multimedia interface and control of the system are described in detail. Additionally, a number of research issues that require further investigation in order to realize attainable, high fidelity telepresence systems are discussed in this paper.

Abstract Evidence that loneliness and isolation are precursors to myriad negative health issues is accumulating. For older adults, social engagement may be particularly important due to life-changing events that can accompany older adulthood, including retirement, disease, or mobility limitations. Individuals vary in their levels of social engagement, and these differences may have consequential effects on quality of life. Technology has the potential to create and enhance social engagement opportunities for older adults at risk for social isolation. For such technology innovations to be effective and widely adopted, designers must consider the unique needs, capabilities, limitations, and preferences of older adults. I will describe technologies that currently exist (e.g., apps, mobile devices, social networking) or are being developed (e.g., robotics, telepresence, virtual reality) to support social engagement, connectedness, and community participation. I will discuss the potential of these technologies as well as the design and training challenges unique to older adults.

Abstract Data show that seven out of every ten adults, over the age of 50, own a smartphone, with one out of ten owning a tablet. While traditional activities dictate the use of technology among this cohort, there is growing evidence that adults similarly use devices to also manage their medical care and to learn online. This increase has guided scholars in recognizing the utility of technology from designing interventions to understanding how technology may serve as a barrier and/or facilitator to one’s general well-being. This symposium features four presentations from nationally recognized scholars that will expand traditional perspectives on technology use, and how it influences social ties among older adults. Dr. Charness will examine the population-level trends in social network use by aging adults and discuss a recent CREATE intervention study (PRISM), that used a computer-based platform to reduce social isolation and loneliness among older adults. Dr. Czaja will similarly present findings from CREATE, and other trials, on the access to and use of email, social media sites, and online support groups among older adults, and the resultant impact on social connectivity, loneliness and social support. Dr. Rogers will discuss technologies that currently exist (e.g., apps, mobile devices, social networking) or are being developed (e.g., robotics, telepresence, virtual reality) to support social engagement. Dr. Antonucci will examine aspects of new technologies and their influence on health and well-being, while underscoring the perspective that new and emerging technologies hold great promise in overcoming traditional barriers to maintaining social contact and exchange.

Purpose The purpose of this paper is to study the impact of mobile robotic telepresence systems on face time – which refers to people “seeing and being seen” – and analyse whether they allow overcoming the challenges associated with telecommuting. Design/methodology/approach This research is based on a qualitative methodology in two French high-tech companies using interviews to better understand how the use of a telepresence robot is experienced by teleworkers, co-workers and their managers. Findings The results demonstrate that telepresence robots do offset the absence of teleworkers by allowing them to engage in face time, even remotely. It shows how the telepresence robot's affordances impact the different dimensions of face time and examine the processes through which teleworkers and co-workers anthropomorphize the robot and manage their privacy needs. Originality/value This article further elaborates the concept of face time and offers six dimensions to study in a digitally driven environment, including two newly identified dimensions. It also discusses the surveillance and privacy needs issues raised by the use of mobile robotic telepresence (MRP) systems.

AbstractThe field of mobile robotic telepresence for social communication is in rapid expansion and it is of interest to understand what promotes good interaction. In this paper, we present the results of an experiment where novice users working in health care were given a guided tour while maneuvering a mobile robotic telepresence system for the first time. In a previous study, it was found that subjective presence questionnaires and observations of spatial configurations based on Kendon’s F-formations were useful to evaluate quality of interaction in mobile robotic telepresence. In an effort to find more automated methods to assess the quality of interaction, the study in this paper used the same measures, with the addition of objective sociometric measures. Experimental results show that the quantitative analysis of the sociometric data correlates with a number of parameters gathered via qualitative analysis, e.g. different dimensions of presence and observed problems in maneuvering the robot.

Background/Objectives: Mobile robotic telepresence could be used to remotely supervise physical activity programs. Our study aims to explore the feasibility, acceptance, and usability of a physical activity program offered synchronously via a mobile robotic telepresence platform. Methods: For this interventional study, five Cutii robots were made available in two residences for older adults in Quebec. Participants received the exercise program, two sessions per week for 4–6 weeks, delivered remotely via the robot. The following feasibility indicators were collected during the study, as recommended by Thabane et al.: process, resources, management, and intervention. Acceptance and usability of the technology were measured using the extended version of the Unified Theory of Acceptance and Use of Technology-based questionnaire and the System Usability Scale, respectively. Results: Eighty percent of participants completed the protocol, and 58% of participants attended 80% of the sessions. Various technical problems (internet connection and technology issues) limited the usability and acceptance of the technology. Conclusion: The results revealed that the program was feasible according to the process, management, and intervention indicators but unsatisfactory in terms of resources. For some participants, minor modifications were needed to improve technology support and facilitate connection to the mobile robotic telepresence. Further studies will need to focus on the evaluation of the effectiveness of this type of intervention. Implications: These results emphasize the importance of continuing research evaluating the opportunities provided by new technologies to enhance older adults’ engagement in physical activity and inform clinicians and policymakers to improve future services in this domain.

The last decade has seen a flowering of applications driven by brain–machine interfaces (BMIs), particularly brain-actuated robotic devices designed to restore the independence of people suffering from severe motor disabilities. This review provides an overview of the state of the art of noninvasive BMI-driven devices based on 86 studies published in the last 15 years, with an emphasis on the interactions among the user, the BMI system, and the robot. We found that BMIs are used mostly to drive devices for navigation (e.g., telepresence mobile robots), with BMI paradigms based mainly on exogenous stimulation, and the majority of brain-actuated robots adopt a discrete control strategy. Most critically, in only a few works have disabled people evaluated a brain-actuated robot. The review highlights the most urgent challenges in the field, from the integration between BMI and robotics to the need for a user-centered design to boost the translational impact of BMIs. Expected final online publication date for the Annual Review of Control, Robotics, and Autonomous Systems, Volume 4 is May 3, 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

AbstractAvatar robots enable the teleoperation and telepresence of an operator with a rich and meaningful sense of existence in another location. Robotic avatar systems rely on intuitive interactions to afford operators comfortable and accurate robot control to perform various tasks. The ability of operators to feel immersed within a robot has drawn interest in multiple research fields to explore the future capabilities of such systems. This paper presents a robotic avatar system based on a custom humanoid robot, TOCABI, with a mobile base. Its teleoperation system was developed in response to the ANA Avatar XPRIZE. Combining the life-size humanoid robot and the mobile base allows for improved mobility and dexterous manipulation. The robotic avatar system comprises the robot/base and an operator station that incorporates haptic feedback devices, trackers, a head-mounted display, gloves, and pedals. These devices connect the robot-environment interaction and operator-avatar robot experience through visual, auditory, tactile, haptic, and kinesthetic feedback. Combining the untethered battery-operated and Wi-Fi-enabled robot with these sensory experiences enables intuitive control through the operator’s body movement. The performance of the robotic avatar system was evaluated through user studies and demonstrated in the ANA Avatar XPRIZE Finals, represented by Team SNU, where it completed 8 of the 10 missions, placing the team eighth among the 17 finalists.

AbstractThe number of robots that are in use worldwide is increasing, and they are starting to be used in new areas, where a use of robotics was impossible in the past, such as nursing care. This brings about new challenges that need to be addressed, one of them is the challenge of privacy preservation. Privacy in robotics is still a very new field that has not been studied deeply yet, even though some studies show that it is a crucial factor. In this article, we investigate how users feel about their privacy when interacting in a telepresence scenario with three different technical means: a laptop computer with a built-in camera, the mobile robot Temi and the humanoid robot Ameca. Behaviors from human interaction were implemented for the humanoid robot, which are not aimed directly at deactivating the sensors, but symbolize this deactivation. We conducted a user study with 21 participants. We did not find out any statistical significant difference between the elements, which shows that the robotic solutions are also popular and people feel comfortable around them. In addition, we also found out that the best way for a humanoid robot to indicate privacy to the participants is to perform actions where it closes the eyes and gives a sense of deactivation. Lastly, the results show that even though the acceptance of a humanoid robot is quite good, further work is needed to increase the control feeling in order to increase the trust of the user over it.

IntroductionCognitive psychology posits that thinking about the future relies on memory such that those with memory impairment may have trouble imaging their future technology and other needs.MethodsWe conducted a content analysis of qualitative data from interviews with six patients with MCI or early dementia regarding potential adaptations to a mobile telepresence robot. Using a matrix analysis approach, we explored perceptions of (1) what technology could help with day-to-day functioning in the present and future and (2) what technology may help people with memory problems or dementia stay home alone safely.ResultsVery few participants could identify any technology to assist themselves or other people with memory problems and could not provide suggestions on what technology may help them stay home alone safely. Most perceived that they would never need robotic assistance.DiscussionThese findings suggest individuals with MCI or early dementia have limited perspectives on their own functional abilities now and in the future. Consideration of the individuals’ diminished understanding of their own future illness trajectory is crucial when engaging in research or considering novel technological management solutions and may have implications for other aspects of advanced care planning.

Introduction Almost all industries in Australia today have adopted digital media in some way. However, uses in large scale activities such as mining may seem to be different from others. This article looks at mining practices with a media studies approach, and concludes that, just as many other industries, mining and media have converged. Many Australian mine sites are adopting new media for communication and control to manage communication, explore for ore bodies, simulate forces, automate drilling, keep records, and make transport and command robotic. Beyond sharing similar digital devices for communication and computation, new media in mining employ characteristic digital media operations, such as numerical operation, automation and managed variability. This article examines the implications of finding that some of the most material practices have become mediated by new media. Mining has become increasingly mediated through new media technologies similar to GPS, visualisation, game remote operation, similar to those adopted in consumer home and mobile digital media. The growing and diversified adoption of digital media championed by companies like Rio Tinto aims not only ‘improve’ mining, but to change it. Through remediating practices of digital mining, new media have become integral powerful tools in prospective, real time and analytical environments. This paper draws on two well-known case studies of mines in the Pilbara and Western NSW. These have been documented in press releases and media reports as representing changes in media and mining. First, the West Angelas mines in the Pilbara is an open cut iron ore mine introducing automation and remote operation. This mine is located in the remote Pilbara, and is notable for being operated remotely from a control centre 2000km away, near Perth Airport, WA. A growing fleet of Komatsu 930E haul trucks, which can drive autonomously, traverses the site. Fitted with radars, lasers and GPS, these enormous vehicles navigate through the open pit mine with no direct human control. Introducing these innovations to mine sites become more viable after iron ore mining became increasingly profitable in the mid-2000s. A boom in steel building in China drove unprecedented demand. This growing income coincided with a change in public rhetoric from companies like Rio Tinto. They pointed towards substantial investments in research, infrastructure, and accelerated introduction of new media technologies into mining practices. Rio Tinto trademarked the term ‘Mine of the future’ (US Federal News Service 1), and publicised their ambitious project for renewal of mining practice, including digital media. More recently, prices have been more volatile. The second case study site is a copper and gold underground mine at Northparkes in Western NSW. Northparkes uses substantial sensing and control, as well as hybrid autonomous and remote operated vehicles. The use of digital media begins with prospecting, and through to logistics of transportation. Engineers place explosives in optimal positions using computer modelling of the underground rock formations. They make heavy use of software to coordinate layer-by-layer use of explosives in this advanced ‘box cut’ mine. After explosives disrupt the rock layer a kilometre underground, another specialised vehicle collects and carries the ore to the surface. The Sandvik loader-hauler-dumper (LHD) can be driven conventionally by a driver, but it can also travel autonomously in and out of the mine without a direct operator. Once it reaches a collection point, where the broken up ore has accumulated, a user of the surface can change the media mode to telepresence. The human operator then takes control using something like a games controller and multiple screens. The remote operator controls the LHD to fill the scoop with ore. The fully-loaded LHD backs up, and returns autonomously using laser senses to follow a trail to the next drop off point. The LHD has become a powerful mediator, reconfiguring technical, material and social practices throughout the mine. The Meanings of Mining and Media Are Converging Until recently, mining and media typically operated ontologically separately. The media, such as newspapers and television, often tell stories about mining, following regular narrative scripts. There are controversies and conflicts, narratives of ecological crises, and the economics of national benefit. There are heroic and tragic stories such as the Beaconsfield mine collapse (Clark). There are new industry policies (Middelbeek), which are politically fraught because of the lobbying power of miners. Almost completely separately, workers in mines were consumers of media, from news to entertainment. These media practices, while important in their own right, tell nothing of the approaching changes in many other sectors of work and everyday life. It is somewhat unusual for a media studies scholar to study mine sites. Mine sites are most commonly studied by Engineering (Bellamy & Pravica), Business and labour and cultural histories (McDonald, Mayes & Pini). Until recently, media scholarship on mining has related to media institutions, such as newspapers, broadcasters and websites, and their audiences. As digital media have proliferated, the phenomena that can be considered as media phenomena has changed. This article, pointing to the growing roles of media technologies, observes the growing importance that media, in these terms, have in the rapidly changing domain of mining. Another meaning for ‘media’ studies, from cybernetics, is that a medium is any technology that translates perception, makes interpretations, and performs expressions. This meaning is more abstract, operating with a broader definition of media — not only those institutionalised as newspapers or radio stations. It is well known that computer-based media have become ubiquitous in culture. This is true in particular within the mining company’s higher ranks. Rio Tinto’s ambitious 2010 ‘Mine of the Future’ (Fisher & Schnittger, 2) program was premised on an awareness that engineers, middle managers and senior staff were already highly computer literate. It is worth remembering that such competency was relatively uncommon until the late 1980s. The meanings of digital media have been shifting for many years, as computers become experienced more as everyday personal artefacts, and less as remote information systems. Their value has always been held with some ambivalence. Zuboff’s (387-414) picture of loss, intimidation and resistance to new information technologies in the 1980s seems to have dissipated by 2011. More than simply being accepted begrudgingly, the PC platform (and variants) has become a ubiquitous platform, a lingua franca for information workers. It became an intimate companion for many professions, and in many homes. It was an inexpensive, versatile and generalised convergent medium for communication and control. And yet, writers such as Gregg observe, the flexibility of networked digital work imposes upon many workers ‘unlimited work’. The office boundaries of the office wall break down, for better or worse. Emails, utility and other work-related behaviours increasingly encroach onto domestic and public space and time. Its very attractiveness to users has tied them to these artefacts. The trail that leads the media studies discipline down the digital mine shaft has been cleared by recent work in media archaeology (Parikka), platform studies (Middelbeek; Montfort & Bogost; Maher) and new media (Manovich). Each of these redefined Media Studies practices addresses the need to diversify the field’s attention and methods. It must look at more specific, less conventional and more complex media formations. Mobile media and games (both computer-based) have turned out to be quite different from traditional media (Hjorth; Goggin). Kirschenbaum’s literary study of hard drives and digital fiction moves from materiality to aesthetics. In my study of digital mining, I present a reconfigured media studies, after the authors, that reveals heterogeneous media configurations, deserving new attention to materiality. This article also draws from the actor network theory approach and terminology (Latour). The uses of media / control / communications in the mining industry are very complex, and remain under constant development. Media such as robotics, computer modelling, remote operation and so on are bound together into complex practices. Each mine site is different — geologically, politically, and economically. Mines are subject to local and remote disasters. Mine tunnels and global prices can collapse, rendering active sites uneconomical overnight. Many technologies are still under development — including Northparkes and West Angelas. Both these sites are notable for their significant use of autonomous vehicles and remote operated vehicles. There is no doubt that the digital technologies modulate all manner of the mining processes: from rocks and mechanical devices to human actors. Each of these actors present different forms of collusion and opposition. Within a mining operation, the budgets for computerised and even robotic systems are relatively modest for their expected return. Deep in a mine, we can still see media convergence at work. Convergence refers to processes whereby previously diverse practices in media have taken on similar devices and techniques. While high-end PCs in mining, running simulators; control data systems; visualisation; telepresence, and so on may be high performance, ruggedised devices, they still share a common platform to the desktop PC. Conceptual resources developed in Media Ecology, New Media Studies, and the Digital Humanities can now inform readings of mining practices, even if their applications differ dramatically in size, reliability and cost. It is not entirely surprising that some observations by new media theorists about entertainment and media applications can also relate to features of mining technologies. Manovich argues that numerical representation is a distinctive feature of new media. Numbers have always already been key to mining engineering. However, computers visualise numerical fields in simulations that extend out of the minds of the calculators, and into visual and even haptic spaces. Specialists in geology, explosives, mechanical apparatuses, and so on, can use plaftorms that are common to everyday media. As the significance of numbers is extended by computers in the field, more and more diverse sources of data provide apparently consistent and seamless images of multiple fields of knowledge. Another feature that Manovich identifies in new media is the capacity for automation of media operations. Automation of many processes in mechanical domains clearly occurred long before industrial technologies were ported into new media. The difference with new media in mine sites is that robotic systems must vary their performance according to feedback from their extra-system environments. For our purposes, the haul trucks in WA are software-controlled devices that already qualify as robots. They sense, interpret and act in the world based on their surroundings. They evaluate multiple factors, including the sensors, GPS signals, operator instructions and so on. They can repeat the path, by sensing the differences, day after day, even if the weather changes, the track wears away or the instructions from base change. Automation compensates for differences within complex and changing environments. Automation of an open-pit mine haulage system… provides more consistent and efficient operation of mining equipment, it removes workers from potential danger, it reduces fuel consumption significantly reducing greenhouse gas (GHG) emissions, and it can help optimize vehicle repairs and equipment replacement because of more-predictable and better-controlled maintenance. (Parreire and Meech 1-13) Material components in physical mines tend to become modular and variable, as their physical shape lines up with the logic of another of Manovich’s new media themes, variability. Automatic systems also make obsolete human drivers, who previously handled those environmental variations, for better or for worse, through the dangerous, dull and dirty spaces of the mine. Drivers’ capacity to control repeat trips is no longer needed. The Komatsu driverless truck, introduced to the WA iron ore mines from 2008, proved itself to be almost as quick as human drivers at many tasks. But the driverless trucks have deeper advantages: they can run 23 hours each day with no shift breaks; they drive more cautiously and wear the equipment less than human drivers. There is no need to put up workers and their families up in town. The benefit most often mentioned is safety: even the worst accident won’t produce injuries to drivers. The other advantage less mentioned is that autonomous trucks don’t strike. Meanwhile, managers of human labour also need to adopt certain strategies of modulation to support the needs and expectations of their workers. Mobile phones, televisions and radio are popular modes of connecting workers to their loved ones, particularly in the remote and harsh West Angelas site. One solution — regular fly-in-fly out shifts — tends also to be alienating for workers and locals (Cheshire; Storey; Tonts). As with any operations, the cost of maintaining a safe and comfortable environment for workers requires trade-offs. Companies face risks from mobile phones, leaking computer networks, and espionage that expose the site to security risks. Because of such risks, miners tend be subject to disciplinary regimes. It is common to test alcohol and drug levels. There was some resistance from workers, who refused to change to saliva testing from urine testing (Latimer). Contesting these machines places the medium, in a different sense, at the centre of regulation of the workers’ bodies. In Northparkes, the solution of hybrid autonomous and remote operation is also a solution for modulating labour. It is safer and more comfortable, while also being more efficient, as one experienced driver can control three trucks at a time. This more complex mode of mediation is necessary because underground mines are more complex in geology, and working environments to suit full autonomy. These variations provide different relationships between operators and machines. The operator uses a games controller, and watches four video views from the cabin to make the vehicle fill the bucket with ore (Northparkes Mines, 9). Again, media have become a pivotal element in the mining assemblage. This combines the safety and comfort of autonomous operation (helping to retain staff) with the required use of human sensorimotor dexterity. Mine systems deserve attention from media studies because sites are combining large scale physical complexity with increasingly sophisticated computing. The conventional pictures of mining and media rarely address the specificity of subjective and artefactual encounters in and around mine sites. Any research on mining communication is typically within the instrumental frames of engineering (Duff et al.). Some of the developments in mechanical systems have contributed to efficiency and safety of many mines: larger trucks, more rock crushers, and so on. However, the single most powerful influence on mining has been adopting digital media to control, integrate and mining systems. Rio Tinto’s transformative agenda document is outlined in its high profile ‘Mine of the Future’ agenda (US Federal News Service). The media to which I refer are not only those in popular culture, but also those with digital control and communications systems used internally within mines and supply chains. The global mining industry began adopting digital communication automation (somewhat) systematically only in the 1980s. Mining companies hesitated to adopt digital media because the fundamentals of mining are so risky and bound to standard procedures. Large scale material operations, extracting and processing minerals from under the ground: hardly to be an appropriate space for delicate digital electronics. Mining is also exposed to volatile economic conditions, so investing in anything major can be unattractive. High technology perhaps contradicts an industry ethos of risk-taking and masculinity. Digital media became domesticated, and familiar to a new generation of formally educated engineers for whom databases and algorithms (Manovich) were second nature. Digital systems become simultaneously controllers of objects, and mediators of meanings and relationships. They control movements, and express communications. Computers slide from using meanings to invoking direct actions over objects in the world. Even on an everyday scale, computer operations often control physical processes. Anti-lock Braking Systems regulate a vehicle’s braking pressure to avoid the danger when wheels lock-up. Or another example, is the ATM, which involves both symbolic interactions, and also exchange of physical objects. These operations are examples of the ‘asignifying semiotic’ (Guattari), in which meanings and non-meanings interact. There is no operation essential distinction between media- and non-media digital operations. Which are symbolic, attached or non-consequential is not clear. This trend towards using computation for both meanings and actions has accelerated since 2000. Mines of the Future Beyond a relatively standard set of office and communications software, many fields, including mining, have adopted specialised packages for their domains. In 3D design, it is AutoCAD. In hard sciences, it is custom modelling. In audiovisual production, it may be Apple and Adobe products. Some platforms define their subjectivity, professional identity and practices around these platforms. This platform orientation is apparent in areas of mining, so that applications such as the Gemcom, Rockware, Geological Database and Resource Estimation Modelling from Micromine; geology/mine design software from Runge, Minemap; and mine production data management software from Corvus. However, software is only a small proportion of overall costs in the industry. Agents in mining demand solutions to peculiar problems and requirements. They are bound by their enormous scale; physical risks of environments, explosive and moving elements; need to negotiate constant change, as mining literally takes the ground from under itself; the need to incorporate geological patterns; and the importance of logistics. When digital media are the solution, there can be what is perceived as rapid gains, including greater capacities for surveillance and control. Digital media do not provide more force. Instead, they modulate the direction, speed and timing of activities. It is not a complete solution, because too many uncontrolled elements are at play. Instead, there are moment and situations when the degree of control refigures the work that can be done. Conclusions In this article I have proposed a new conception of media change, by reading digital innovations in mining practices themselves as media changes. This involved developing an initial reading of the operations of mining as digital media. With this approach, the array of media components extends far beyond the conventional ‘mass media’ of newspapers and television. It offers a more molecular media environment which is increasingly heterogeneous. It sometimes involves materiality on a huge scale, and is sometimes apparently virtual. The mining media event can be a semiotic, a signal, a material entity and so on. It can be a command to a human. It can be a measurement of location, a rock formation, a pressure or an explosion. The mining media event, as discussed above, is subject to Manovich’s principles of media, being numerical, variable and automated. In the mining media event, these principles move from the aesthetic to the instrumental and physical domains of the mine site. The role of new media operates at many levels — from the bottom of the mine site to the cruising altitude of the fly-in-fly out aeroplanes — has motivated significant changes in the Australian industry. When digital media and robotics come into play, they do not so much introduce change, but reintroduce similarity. This inversion of media is less about meaning, and more about local mastery. Media modulation extends the kinds of influence that can be exerted by the actors in control. In these situations, the degrees of control, and of resistance, are yet to be seen. Acknowledgments Thanks to Mining IQ for a researcher's pass at Mining Automation and Communication Conference, Perth in August 2012. References Bellamy, D., and L. Pravica. “Assessing the Impact of Driverless Haul Trucks in Australian Surface Mining.” Resources Policy 2011. Cheshire, L. “A Corporate Responsibility? The Constitution of Fly-In, Fly-Out Mining Companies as Governance Partners in Remote, Mine-Affected Localities.” Journal of Rural Studies 26.1 (2010): 12–20. Clark, N. “Todd and Brant Show PM Beaconsfield's Cage of Hell.” The Mercury, 6 Nov. 2008. Duff, E., C. Caris, A. Bonchis, K. Taylor, C. Gunn, and M. Adcock. “The Development of a Telerobotic Rock Breaker.” CSIRO 2009: 1–10. Fisher, B.S. and S. Schnittger. Autonomous and Remote Operation Technologies in the Mining Industry: Benefits and Costs. BAE Report 12.1 (2012). Goggin, G. Global Mobile Media. London: Routledge, 2010. Gregg, M. Work’s Intimacy. Cambridge: Polity, 2011. Guattari, F. Chaosmosis: An Ethico-Aesthetic Paradigm. Trans. Paul Bains and Julian Pefanis. Bloomington: Indiana UP, 1992. Hjorth, L. Mobile Media in the Asia-Pacific: Gender and the Art of Being Mobile. Taylor & Francis, 2008. Kirschenbaum, M.G. Mechanisms: New Media and the Forensic Imagination. Campridge, Mass.: MIT Press, 2008. Latimer, Cole. “Fair Work Appeal May Change Drug Testing on Site.” Mining Australia 2012. 3 May 2013 ‹http://www.miningaustralia.com.au/news/fair-work-appeal-may-change-drug-testing-on-site›. Latour, B. Reassembling the Social: An Introduction to Actor-Network-Theory. Oxford: Oxford University Press, 2007. Maher, J. The Future Was Here: The Commodore Amiga. Cambridge, Mass.: MIT Press, 2012. Manovich, Lev. The Language of New Media. Cambridge, Mass.: MIT Press, 2001. McDonald, P., R. Mayes, and B. Pini. “Mining Work, Family and Community: A Spatially-Oriented Approach to the Impact of the Ravensthorpe Nickel Mine Closure in Remote Australia.” Journal of Industrial Relations 2012. Middelbeek, E. “Australia Mining Tax Set to Slam Iron Ore Profits.” Metal Bulletin Weekly 2012. Montfort, N., and I. Bogost. Racing the Beam: The Atari Video Computer System. Cambridge, Mass.: MIT Press, 2009. Parikka, J. What Is Media Archaeology? London: Polity Press, 2012. Parreira, J., and J. Meech. “Autonomous vs Manual Haulage Trucks — How Mine Simulation Contributes to Future Haulage System Developments.” Paper presented at the CIM Meeting, Vancouver, 2010. 3 May 2013 ‹http://www.infomine.com/library/publications/docs/parreira2010.pdf›. Storey, K. “Fly-In/Fly-Out and Fly-Over: Mining and Regional Development in Western Australia.” Australian Geographer 32.2 (2010): 133–148. Storey, K. “Fly-In/Fly-Out: Implications for Community Sustainability.” Sustainability 2.5 (2010): 1161–1181. 3 May 2013 ‹http://www.mdpi.com/2071-1050/2/5/1161›. Takayama, L., W. Ju, and C. Nas. “Beyond Dirty, Dangerous and Dull: What Everyday People Think Robots Should Do.” Paper presented at HRI '08, Amsterdam, 2008. 3 May 2013 ‹http://www-cdr.stanford.edu/~wendyju/publications/hri114-takayama.pdf›. Tonts, M. “Labour Market Dynamics in Resource Dependent Regions: An Examination of the Western Australian Goldfields.” Geographical Research 48.2 (2010): 148-165. 3 May 2013 ‹http://onlinelibrary.wiley.com/doi/10.1111/j.1745-5871.2009.00624.x/abstract›. US Federal News Service, Including US State News. “USPTO Issues Trademark: Mine of the Future.” 31 Aug. 2011. Wu, S., H. Han, X. Liu, H. Wang, F. Xue. “Highly Effective Use of Australian Pilbara Blend Lump Ore in a Blast Furnace.” Revue de Métallurgie 107.5 (2010): 187-193. doi:10.1051/metal/2010021. Zuboff, S. In the Age of the Smart Machine: The Future of Work and Power. Heinemann Professional, 1988.