Expanding tangible tabletop interfaces beyond the display

TitleExpanding tangible tabletop interfaces beyond the display
Publication TypePhD Thesis
Year of Publication2015
UniversityUniversitat Pompeu Fabra
AuthorsGallardo, D.
AdvisorJordà, S.
Academic DepartmentInformation and Communication Technologies
Number of Pages194
Date Published11/2014
CityBarcelona
Keywords3D, air gestures, interaction, light, secondlight, tabletop
AbstractThe rising popularity of interactive tabletops and surfaces is spawning research and innovation in a wide variety of areas, including hardware and software technologies, interaction design and novel interaction techniques, all of which seek to promote richer, more powerful and more natural interaction modalities. Among these modalities, combined interaction on and above the surface, both with gestures and with tangible objects, is a very promising area. This dissertation is about expanding tangible and tabletops surfaces beyond the display by exploring and developing a system from the three different perspectives: hardware, software, and interaction design. This dissertation, studies and summarizes the distinctive affordances of conventional 2D tabletop devices, with a vast literature review and some additional use cases developed by the author for supporting these findings, and subsequently explores the novel and not yet unveiled potential affordances of 3D-augmented tabletops. It overviews the existing hardware solutions for conceiving such a device, and applies the needed hardware modifications to an existing prototype developed and rendered to us by Microsoft Research Cambridge. For accomplishing the interaction purposes, it is developed a vision system for 3D interaction that extends conventional 2D tabletop tracking for the tracking of hand gestures, 6DoF markers and on-surface finger interaction. It finishes by conceiving a complete software framework solution, for the development and implementation of such type of applications that can benefit from these novel 3D interaction techniques, and implements and test several software prototypes as proof of concepts, using this framework. With these findings, it concludes presenting continuous tangible interaction gestures and proposing a novel classification for 3D tangible and tabletop gestures.
preprint/postprint documenthttp://mtg.upf.edu/system/files/publications/Thesis_dgallardo.pdf
intranet