An Improved Modular Framework for Developing Multi-Surface Interaction

Abstract

Advances in multi-touch capabilities have led to their use in a vast array of devices, but usable interactions that span across devices are less frequently encountered. To address this concern, a framework was created for the development of interaction spaces which gave developers the tools to write applications which united tabletop and handheld devices, allowing each device to utilize its inherent interaction style yet still communicate effectively. However, while this framework provided proof that such interactions were possible, it failed to prove itself as easily reusable by subsequent developers. To address this concern, we have created an improved framework to both fulfill the goals of the original framework and confront its shortcomings. Our improved framework features a new intra-component communication system, mobile device independence, configurable user interfaces, and automatic exposure of available interactions. All of these features coalesce to fulfill the goals of the original framework while improving its reusability.