Since multi-touch technique has been used widely for personal device, such as smartphone, personal computer and tabletop, many forms of interaction are developed and served for user’s daily usage. But forms of interaction can be barely found between tabletop and smartphone. Therefore, we propose a general framework for facilitating developers and users to develop multi-surface applications. Our general framework uses the smartphone as input and output device to overcome limits and extends features of tabletop. We provide some applications based on treating smartphones as both input and output devices to demonstrate the implementation of our framework for smartphone on the tabletop.