A framework for device capability on demand and virtual device user experience

IBM Journal of Research and Development, Sep-Nov 2004 by Fu, R Y, Su, H, Fletcher, J C, Li, W, Et al

The proliferation of mobile devices is gradually making it possible to access information anywhere at any time. However, the physical capabilities of the mobile device still greatly limit the experience of users because functionality has usually been traded off for ubiquity. Nonetheless, the enormous growth rate of new information appliances heralds the dawning of a device-rich era. In this paper, we propose a framework for augmenting mobile device capabilities with surrounding devices. We then discuss a possible approach to represent an augmented device as one single virtual device.

Introduction

All of the promises of the Internet rely on fast and convenient access to information. While certain benefits have already been realized by connecting desktop-class personal computer (PC) users, the full potential can only be exploited by connecting the broadest number of people via the widest range of mobile devices. Existing ubiquitous computing middleware has significantly extended the reach of the computing infrastructure to mobile users, but satisfactory user experiences and profitable business models have not yet been exhibited. Research momentum is shifting toward using server power more efficiently and seeking ways for multiple client devices to collaborate.

User acceptance largely determines the success of any system. In many parts of the world, users have primarily experienced desktop systems. Compared with desktop solutions, the restrictions on user experience and capabilities brought about by smaller devices are key inhibitors to an enterprise-ubiquitous computing adoption. Current trends for improving user experience largely focus on the development of powerful, multifunctional, but still handy and mobile devices. Enterprises are accustomed to the single-device model, where the capability of one device largely determines the overall user experience and quality of service for the enterprise applications. Meanwhile, middleware today must accommodate a vast variety of devices, which, because they continue to be resource-constrained, limit the possibilities of the middleware. A solution would be to shift the model to one that allows us to distribute the single application across multiple devices, leveraging the strengths of each physical device for the application.

Over the past few years, significant progress has been made in improving mobile device capability. These activities have leveraged both single-device and multidevice approaches.

The single-device approach emphasizes improving inherent device capability (e.g., continual hardware and software upgrades and multiple functions all in one). This approach entails costly solutions that usually cannot be replicated, are not at all flexible, and do not solve the essential problem-the limitations of single-device capability. In addition, while many future devices will carry faster processors and larger memories, the human-computer interaction will remain a problem because mobile devices, by their nature, will not become physically large enough to provide typical PC-level interactions. In a study of everyday appliance examples, Buxton questioned the value of super-appliances [1]. He suggested breaking away from the one-size-fits-all approach und evolving to tools built for specific purposes. The study conducted by Buxton concludes that devices will become sufficiently inexpensive to accomplish this, and they will be distributed around certain locations appropriate for certain activities.

Meanwhile, new wireless technologies such as Bluetooth** [2] have emerged to improve short-range communication between devices. This simplifies the task of providing distributed application capability that can enhance user experiences by overcoming single-device limitations. The Universal Plug and Play (UPnP**) Forum [3] is an industry initiative to enable simple and robust connectivity among standalone devices and PCs from different vendors. UPnP architecture offers ubiquitous peer-to-peer network connectivity for devices, but without specifying how two connected devices interact together with server-side applications. Other similar activities, such as Jini** [4] and Salutation** [5], have similarly addressed the requirements for interdevice communication.

Myers [6] describes the Pebbles project, which aimed at collaboration between personal digital assistants (PDAs) and PCs. A toolset has been developed for the PDA user to manipulate remote desktop applications. Pebbles also provides a simple method for a group of users to take turns controlling applications running on a PC. In this application, PDAs are used as remote controls and as additional input devices for the PC.

Several researchers have also focused on methodologies for building multimodal interaction systems. The QuickSet project [7] involved a collaborative multimodal system that employed a distributed, multiagent architecture to integrate not only various user interface components, but also a collection of distributed applications. Current multimodal technologies duplicate interactive content on different channels (usually graphics and voice) in order to provide interaction alternatives. Johanson et al. [8] describe a multibrowser system that provides a framework for exploring multiple heterogeneous displays to view and browse information simultaneously. The UbicompBrowser project [9] explored the use of a handheld device to access and control surrounding output devices so that devices such as a standard television can be used to display Web pages.