A Proxemity-Based Media Player for a Surface
In the everyday world, much of what we do is dictated by how we interpret spatial relationships. This is called proxemics. What is surprising is how little spatial relationships are used in interaction design, i.e., in terms of mediating people’s interactions with surrounding digital devices such as digital surfaces, mobile phones, and computers. Our interest is in proxemic interaction, which imagines a world of devices that has fine-grained knowledge of nearby people and other devices (including surfaces) – how they move into range, their precise distance, and even their orientation – and how such knowledge can be exploited to design interaction techniques. We are also interested in how we use proxemic information to regulate implicit and explicit interaction technique and how they can be triggered by continuous movement, or by movement in and out of discrete proxemic regions. We explore these concepts with the design of an interactive vertical display surface that recognizes the proximity of surrounding people, digital devices, and non-digital artefacts – all in relation to the surface but also the surrounding environment.
Our example application is an interactive media player on a surface that implicitly reacts to the approach and orientation of people and their personal devices, and that tailors explicit interaction methods to fit.
Images and Videos
- Nicolai Marquardt, Proxemic Interactions in Ubiquitous Computing Ecologies, ACM Proceedings CHI Extended Abstracts: ACM CHI Doctoral Symposium, Vancouver, British Columbia, Canada, 2011.
- Till Ballendat, Visualization of and Interaction with Digital Devices around Large Surfaces as a Function of Proximity, Master’s Thesis, Dept Institut fur Informatik, Ludwig-Maximilians-Universitat Munchen, Munich, Germany, 2011. Supervisors: Nicolai Marquardt and Saul Greenberg, Professor in charge: Andreas Butz.
- Saul Greenberg, Nicolai Marquardt, Till Ballendat, Robert Diaz-Marino, Miaosen Wang, Proxemic Interactions : The New Ubicomp? ACM Interaction, 18(1):42-50, January-February, 2011. Invited Cover Story.
- Till Ballendat, Nicolai Marquardt, Saul Greenberg, Proxemic Interaction: Designing for a Proximity and Orientation-Aware Environment. Proceedings of ACM Conference on Interactive Tabletops and Surfaces 2010, Saarbruecken, Germany, ACM Press, 2010. Best Paper Award.
- Nicolai Marquardt, Saul Greenberg, Applying Proxemics to Mediate People’s Interaction with Devices in Ubiquitous Computing Ecologies, ACM Proceeding Interactive Tabletops and Surfaces: ACM ITS Doctoral Symposium, Saarbruecken, Germany, 2010.
- Till Ballendat, Nicolai Marquardt, Saul Greenberg, Proxemic Interaction: The Video, Research Report 2010-963-12, Department of Computer Science, University of Calgary, Calgary, Alberta, Canada, 2010.
Demos and Software Components
iCORE – NSERC – SMART Technologies – Alberta Innovates Technology Futures
- 1.1.2 Surface Social Interaction Fundamentals
- 1.1.3 Expanding the Interaction Design Palette
- 3.4.1 Interface Requirements for Surface Applications
- Saul Greenberg (Supervisor)
- Nicolai Marquardt (PhD Student)
- Till Ballendat (Research Intern)