Computer Science

Control yourself: A mixed-reality natural user interface

Document Type

Conference Paper

Abstract

Control Yourself is a natural user interaction system with a camera and depth sensor, a processor and a display. The user’s image is separated from the background of a camera’s output and rendered in the program in real-time. The result is that a display shows a video of a person inside the application. The software also recognizes various types of movement such as gestures, changing positions, moving in frame and multiplayer interaction. The technology utilizes the obtained gestures and movements for GUI transformations and creation and for positioning the image or mesh of a user with the background removed. Users of the system can manipulate virtual objects and various features of the program by using gestures and movements while seeing themselves as if they were viewing a mirror with an augmented reality around them. This approach allows users to interact with software by natural movements via intuitive gestures.

Publication Title

Communications in Computer and Information Science

Publication Date

2015

Volume

528

First Page

238

Last Page

242

ISSN

1865-0929

ISBN

9783319213798

DOI

10.1007/978-3-319-21380-4_42

Keywords

augmented reality, computer vision, control yourself, depth camera, interactive games, interactive games, kinect, mixed reality, project-based learning

APA Citation

Zhizhimontova, E., & Magee, J. (2015). Control Yourself: A Mixed-Reality Natural User Interface. In HCI International 2015-Posters’ Extended Abstracts: International Conference, HCI International 2015, Los Angeles, CA, USA, August 2–7, 2015. Proceedings, Part I (pp. 238-242). Springer International Publishing.

Link to Full Text

Share

COinS