Academic literature on the topic 'HCI, Large Displays, Multitouch'

Large high-resolution displays combine high pixel density with ample physical dimensions. The combination of these factors creates a multiscale workspace where interactive targeting of on-screen objects requires both high speed for distant targets and high accuracy for small targets. Modern operating systems support implicit dynamic control-display gain adjustment (i.e., a pointer acceleration curve) that helps to maintain both speed and accuracy. However, large high-resolution displays require a broader range of control-display gains than a single acceleration curve can usably enable. Some interaction techniques attempt to solve the problem by utilizing multiple explicit modes of interaction, where different modes provide different levels of pointer precision. Here, we investigate the alternative hypothesis of using asingle modeof interaction for continuous pointing that enables both (1) standardimplicitgranularity control via an acceleration curve and (2)explicitswitching between multiple acceleration curves in an efficient and dynamic way. We evaluate a sample solution that augments standard touchpad accelerated pointer manipulation with multitouch capability, where the choice of acceleration curve dynamically changes depending on the number of fingers in contact with the touchpad. Specifically, users can dynamically switch among three different acceleration curves by using one, two, or three fingers on the touchpad.

Well, you couldn't control the situation to that extent. The world just comes in on top of you. It creeps under the door. It falls out of the sky. It's all around. (Leunig) Like the world that cartoonist Michael Leunig describes, ambience is all around. Everywhere you go. You cannot get away from it. You cannot hide from it. You cannot be without it. For ambience is that which surrounds us, that which pervades. Always-on. Always by-your-side. Always already. Here, there and everywhere. Super-surround-sound. Immersive. Networked and cloudy. Ubiquitous. Although you cannot avoid ambience, you may ignore it. In fact, ambience is almost as ignored as it is pervasive. For the most part, our attention is given over to what’s in front of us, what we pick up, what we handle, what is in focus. Instead of ambience, our phenomenal existence is governed by what we bring into the foreground of our lives. Our attention is, almost by definition, occupied not by what is ambient, but what is salient (Jaaniste, Approaching Ch. 1). So, when Brian Eno coined the term Ambient Music in the 1970s (see Burns; Radywyl; and Ensminger in this issue), he was doing something strange. He was bringing ambience, as an idea and in its palpable sonic dimension, into salience. The term, and the penchant for attuning and re-thinking our connections to our surroundings, caught on. By the end of the twentieth century, it was deemed by one book author worthy of being called the ambient century (Prendergast). Eno is undoubtedly the great populariser of the term, but there’s a backstory to ambience. If Spitzer’s detailed semantic analysis of ‘ambience’ and its counterpart ‘milieu’ published back in the 1940s is anything to go by, then Newtonian physics had a lot to do with how ambience entered into our Modern vernacular. Isaac Newton’s laws and theories of gravity and the cosmos offered up a quandary for science back then: vast amounts of empty space. Just like we now know that most of an atom is empty space, within which a few miserly electrons, protons, neutrons and other particle fly about (and doesn’t that seem weird given how solid everything feels?) so too it is with planets, stars, galaxies whose orbits traverse through the great vacuum of the universe. And that vacuum Newton called ambience. But maybe outer-space, and ambience, is not actually empty. There could be dark matter everywhere. Or other things not yet known, observed or accounted for. Certainly, the history of our thinking around ambience since its birth in physics has seen a shift from vacuity to great density and polyphony. Over time, several ‘spaces’ became associated with ambience, which we might think of as the great scapes of our contemporary lives: the natural environment, the built environment, the social world, the aesthetic worlds encountered ‘within’ artefacts, and the data-cloud. Now is not the time or place to give a detailed history of these discursive manoeuvres (although some key clues are given in Spizter; and also Jaaniste, Approaching). But a list of how the term has been taken up after Eno–across the arts, design, media and culture–reveals the broad tenets of ambience or, perhaps, the ambience of ambience. Nowadays we find talk of (in alphabetical order): ambient advertising (Quinion), aesthetics (Foster), architecture (CNRS; Sample), art (Desmarias; Heynen et al.), calculus (Cardelli), displays (Ambient Displays Reserch Group; Lund and Mikael; Vogel and Balakrishnan), fears (Papastergiadis), findability (Morville), informatics (Morville), intelligence (Weber et al.), media (Meeks), narratives (Levin), news (Hagreaves and Thomas), poetics (Morton), television (McCarthy), and video (Bizzocchi). There’s probably more. Time, then, to introduce the authors assembled for this special ‘ambient’ issue of M/C Journal. Writing from the globe, in Spain, Ukraine, Canada, United Sates, and New Zealand, and from cities across Australia, in Melbourne, Canberra and Perth, they draw on and update the ambience of ambience. Alison Bartlett, in our feature article, begins with bodies of flesh (and sweat and squinting) and bodies of thought (including Continental theory). She draws us into a personal, present tense and tensely present account of the way writing and thinking intertwine with our physical locality. The heat, light and weathered conditions of her place of writing, now Perth and previously Townsville, are evoked, as is some sort of teased out relation with Europe. If we are always immersed in our ambient conditions, does this effect and affect everything we do, and think? Bruce Arnold and Margalit Levin then shift gear, from the rural and natural to the densely mediated contemporary urban locale. Urban ambience, as they say, is no longer about learning to avoid (or love?) harsh industrial noises, but it’s about interactivity, surveillance and signalling. They ambivalently present the ambient city as a dialectic, where feeling connected and estranged go hand-in-hand. Next we explore one outcome or application of the highly mediated, iPhone and Twitter-populated city. Alfred Hermida has previously advanced the idea of ‘ambient journalism’ (Hermida, Twittering), and in his M/C Journal piece he outlines the shift from ambient news (which relies on multiple distribution points, but which relays news from a few professional sources) to a journalism that is ambiently distributed across citizens and non-professional para-journalists. Alex Burns takes up Hermida’s framework, but seeks to show how professional journalism might engage in complex ways with Twitter and other always-on, socially-networked data sources that make up the ‘awareness system’ of ambient journalism. Burns ends his provocative paper by suggesting that the creative processes of Brian Eno might be a model for flexible approaches to working with the ambient data fields of the Internet and social grid. Enter the data artist, the marginal doodler and the darkened museum. Pau Waelder examines the way artists have worked with data fields, helping us to listen, observe and embody what is normally ignored. David Ensminger gives a folklorist-inspired account of the way doodles occupy the ambient margins of our minds, personalities and book pages. And Natalia Radywyl navigates the experiences of those who encountered the darkened and ambiguously ambient Screen Gallery of the Australian Centre for Moving Image, and ponders on what this mean for the ‘new museum’. If the experience of doodles and darkened galleries is mainly an individual thing, the final two papers delve into the highly social forms of ambience. Pauline Cheong explores how one particular type of community, Christian churches in the United States, has embraced (and sometimes critiqued) the use of Twitter to facilitate the communal ambience, 140 characters at a time. Then Christine Teague with Lelia Green and David Leith report on the working lives of transit officers on duty on trains in Perth. This is a tough ambience, where issues of safety, fear, confusion and control impact on these workers as much as they try to influence the ambience of a public transport network. The final paper gives us something to pause on: ambience might be an interesting topic, but the ambience of some people and some places might be unpalatable or despairing. Ambience is morally ambivalent (it can be good, bad or otherwise), and this is something threading through many of the papers before us. Who gets to control our ambient surrounds? Who gets to influence them? Who gets to enjoy them, take advantage of them, ignore them? For better or worse. The way we live with, connect to and attune to the ambience of our lives might be crucially important. It might change us. And it might do so on many levels. As is now evident, all the great scapes, as I called them, have been taken up in this issue. We begin with the natural environment (Bartlett’s weather) and the urban built environment (Arnold and Levin; and also Radywyl). Then we enter the data-cloud (Herminda; Burns; Waelder, and also Cheong), shifting into the aesthetic artefact (Waelder; Ensminger; Radywyl), and then into the social sphere (Cheong; Teague, Green and Leith). Of course, all these scapes, and the authors’ concerns, overlap. Ambience is a multitude, and presses into us and through us in many ways. References Ambient Displays Research Group. “Ambient Displays Research Group.” 25 July 2006 ‹http://www.eecs.berkeley.edu/Research/Projects/CS/io/ambient/›. Bizzocchi, Jim. “Ambient Video: The Transformation of the Domestic Cinematic Experience.” Media Environments and the Liberal Arts Conference, 10-13 June 2004, Rochester Institute of Technology, New York. 26 July 2006 ‹http://www.dadaprocessing.com› [third version of this essay]. Cardelli, Luca. “Mobility and Security.” Lecture notes for Marktoberdorf Summer School 1999, summarising several Ambient Calculus papers by Luca Cardelli & Andrew Gordon. Foundations of Secure Computation. Eds. Friedrich L. Bauer and Ralf Steinbrüggen. NATO Science Series. Proceedings of the NATO Advanced Study Institute on Foundations of Secure Computation, Marktoberdorf, Germany, 27 July - 8 Aug. 1999. 3-37. ‹http://lucacardelli.name/Papers/Mobility%20and%20Security.A4.pdf›. CNRS. “UMR CNRS 1563: Ambiances architecturales et urbaines”. 2007. 9 Feb. 2007 ‹http://www.archi.fr/RECHERCHE/annuaireg/pdf/UMR1563.pdf›. Desmarias, Charles. “Nothing Compared to This: Ambient, Incidental and New Minimal Tendencies in Contemporary Art.” Catalogue essay for exhibition curated by Charles Desmarais at Cincinnati Contemporary Arts Center, 25 Sep. - 28 Nov. 2004. Foster, Cheryl. “The Narrative and the Ambient in Environmental Aesthetics.” Journal of Aesthetics & Art Criticism 56.2 (Spring 1998): 127-137. Hargreaves, Ian, and James Thomas. “New News, Old News.” ITC/BSC (October 2002). 3 May 2010 ‹http://legacy.caerdydd.ac.uk/jomec/resources/news.pdf›. Herminda, Alfred. “Twittering the News: The Emergence of Ambient Journalism.” Journalism Practice (11 March 2010). 3 May 2010 ‹http://www.informaworld.com/smpp/content~content=a919807525›. Heynen, Julian, Kasper Konig, and Stefani Jansen. Ambiance: Des deux cơtes du Rhin. To accompany an exhibition of the same name at K21 Kuntstsammlung NRW, Düsseldorf, 15 Oct. 2005 – 12 Feb. 2006. Köln: Snoeck. Jaaniste, Luke. Approaching the Ambient: Creative Practice and the Ambient Mode of Being. Doctoral thesis, Queensland University of Technology, 2007. 3 May 2010 ‹http://www.lukejaaniste.com/writings/phd›. Leunig, Michael. “Michael Leunig”. Enough Rope with Andrew Denton. ABC Television, 8 May 2006. 3 May 2010 ‹http://www.abc.net.au/tv/enoughrope/transcripts/s1632918.htm›. Lund, Andreas, and Mikael Wiberg. “Ambient Displays beyond Convention.” HCI 2004, The 18th British HCI Group Annual Conference, Leeds Metropolitan University, UK, 6-10 Sep. 2004. 18 Oct. 2005 ‹http://www.informatik.umu.se/~mwiberg/designingforattention_workshop_lund_wiberg.pdf›. Manovich, Lev. “Soft Cinema: Ambient Narratives.” Catalogue for the Soft Cinema Project presented at Future Cinema: The Cinemtic Imaginary after Film at ZKM Center for Art and Media in Karlsruhe, Germany, 16 Nov. 2002 - 30 March 2003. McCarthy, Anna. Ambient Television: Visual Culture and Public Space. Durham and London: Duke University Press, 2001. Meeks, Cyan. Ambient Media: Meanings and Implications. Masters of Fine Arts thesis, Graduate School of the State University of New York, Department of Media Study, August 2005. Morton, Timothy. “Why Ambient Poetics?: Outline for a Depthless Ecology.” The Wordsworth Circle 33.1 (Winter 2002): 52-56. Morville, Peter. Ambient Findability: What We Find Changes Who We Become. O’Reilly Media, 2005. Papastergiadis, Nikos. “Ambient Fears.” Artlink 32.1 (2003): 28-34. Prendergast, Mark. The Ambient Century: From Mahler to Trance, the Evolution of Sound in the Electronic Age. London: Bloomsbury, 2000. Quinion, Michael. “Ambient Advertising.” World Wide Words 5 Sep. 1998. 3 Aug. 2006 ‹http://www.worldwidewords.org/turnsofphrase/tp-amb1.htm›. Sample, Hilary. “Ambient Architecture: An Environmental Monitoring Station for Pasadena, California.” 306090 07: Landscape with Architecture. 306090 Architecture Journal 7 (Sep. 2004): 200-210. Spitzer, Leo. “Milieu and Ambiance: An Essay in Historical Semantics (Part 2).” Philosophy and Phenomenological Research 3.2 (Dec. 1942): 169–218. Vogel, Daniel, and Ravin Balakrishnan. “Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users.” Proceedings of the 18th ACM Symposium on User Interface Software and Technology. Large Public Displays session, Santa Fe. New York: ACM Press. 137-146. Weber, W., J.M. Rabaey, and E. Aarts. Eds. Ambient Intelligence. Berlin: Springer, 2005.

Advances in display technology are increasing screen size and reducing their costs. Large, wall sized screens can be found in malls, public squares and office buildings displaying photos, videos, advertising, news and announcements. The audience of large displays in public, urban environments can be constantly changing and in this thesis we investigate applying automated layout algorithms to large displays to adapt layouts to changing audiences. Abstract We review current automated layouts, discuss new challenges when applying automated layouts to large screens and present our design space for automated layouts. We investigate the human factors (such as attention, vision, and perception) and the system factors (such as display space and input devices) involved in automated layout for large displays. Abstract This thesis presents the Viewer Aware Layout (VAL) system. VAL is a system that automates the layout of images on a large display and is designed to allow many users to collectively view images. VAL, and features of VAL, are tested for engagement and it is found that there is a significant increase in agreement by users with statements describing an engaging experience when VAL is applied to an image layout. This thesis concludes with a summary of the research contributions and proposes future areas of work.

In this thesis we report on remote interaction techniques for horizontal and vertical large displays. For vertical large displays, we present MultiPoint, a set of perspective-based remote pointing techniques that allows users to perform bimanual and multi-finger remote manipulation of graphical objects on large displays. We conducted two empirical studies that compared remote pointing techniques performed using fingers and laser pointers, in single and multi-finger pointing interactions. The MultiPoint techniques were found suitable for interacting with vertical large displays. We explore techniques that are well suited for exclusively single-point use cases as well as for multipoint scenarios. With Pointable, we also explored perspective-based pointing with in-air gestures, but in a tabletop scenario. We conducted 3 experiments; the first showed that pointing at a distance using Pointable has a Fitts’ law throughput comparable to that of a mouse. In the second experiment, we found that Pointable had the same performance as multi-touch input in a resize, rotate and drag task. In a third study, we observed that when given the choice, over 75% of participants preferred to use Pointable over multi-touch for target manipulation. In general, Pointable allowed users to manipulate out-of-reach targets, without loss of performance, while minimizing the need to lean, stand up, or involve collocated collaborators.
Thesis (Master, Computing) -- Queen's University, 2012-06-08 11:59:53.418

Audio editing environments, geared towards touch screens and mobile computing form factors, are prevalent, predominant and continue to gain in popularity. However, touch-based gestures on mobile devices are typically singlehanded tasks and limited to 2D interaction space, which is less intuitive and efficient for music manipulation. Also, with the constraint of limited screen assets, a user has to frequently switch between different audio sample contexts while editing. We present PaperMusic, a novel audio manipulation interface, for enabling simple and intuitive audio manipulation for novice musicians. PaperMusic uses multiple flexible displays, 3D tracking system, bend sensors, and a set of tangible audio interaction techniques, which take advantage of Organic User Interface and bimanual interactions, to enable users to tangibly and collaboratively create and edit audio. PaperMusic draws from both the traditional music editing environment and novel audio interfaces. During making our first prototype, we consider the following design goals: (1) Low learning Curve; (2) Consistent Metaphor; (3) Lightweight & portability; (4) Spatial awareness; (5) Multimodal with richer forms of tactile and visual feedback; (6) Bimanual tasking and multi- display interaction; (7) Collaborative music editing. Based on this, we have designed and explored five interaction techniques: (1) Layering; (2) Collocation; (3) Pointing; (4) 3D spatial awareness; (5) Bending & discrete touching. We performed a qualitative user experiment to obtain feedback from participants who were amateur musicians. Our user study indicates that, compared with traditional music editing software, our tangible prototype had a lower mental demand and facilitates bimanual asymmetric tasks.
Thesis (Master, Computing) -- Queen's University, 2014-04-25 17:17:15.747