Computer Science

Towards a multi-camera mouse-replacement interface

Document Type

Conference Paper


We present our efforts towards a multi-camera mouse-replacement system for computer users with severe motion impairments. We have worked with individuals with cerebral palsy or multiple sclerosis who use a publicly-available interface that tracks the user's head movements with a single video camera and translates them into mouse pointer coordinates on the screen. To address the problem that the interface can lose track of the user's facial feature due to occlusion or spastic movements, we started to develop a multi-camera interface. Our multi-camera capture system can record synchronized images from multiple cameras and automatically analyze the camera arrangement. We recorded 15 subjects while they were conducting a hands-free interaction experiment. We reconstructed via stereoscopy the three-dimensional movement trajectories of various facial features. Our analysis shows that single-camera interfaces based on two-dimensional feature tracking neglect to take into account the substantial feature movement in the third dimension.

Publication Title

Proceedings of the 10th International Workshop on Pattern Recognition in Information Systems, PRIS 2010, in Conjunction with ICEIS 2010

Publication Date


First Page


Last Page






APA Citation

Magee, J., Wu, Z., Chennamaneni, H., Epstein, S., Theriault, D. H., & Betke, M. (2010, June). Towards a multi-camera mouse-replacement interface. In International Workshop on Pattern Recognition in Information Systems (Vol. 2, pp. 33-42). SCITEPRESS.