Computer Science

Conversation aid for people with low vision using head mounted display and computer vision emotion detection

Document Type

Conference Paper

Abstract

People with central vision loss may become unable to see facial expressions during face-to-face conversations. Nuances in interpersonal communication conveyed by those expressions can be captured by computer vision systems and conveyed via an alternative input to the user. We present a low-cost system using commodity hardware that serves as a communication aid for people with central vision loss. Our system uses a smartphone in a head-mounted-display to capture images of a conversation partner’s face, analyze the face expressions, and display a detected emotion in the corner of the display where the user retains vision senses. In contrast to purpose-built devices that are expensive, this system could be made available to a wider group of potential users, including those in developing countries.

Publication Title

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Publication Date

2018

Volume

10897 LNCS

First Page

44

Last Page

50

ISSN

0302-9743

ISBN

9783319942735

DOI

10.1007/978-3-319-94274-2_7

Keywords

accessibility, computer vision, head-mounted-display, low-vision

APA Citation

Zuniga, R., & Magee, J. (2018). Conversation aid for people with low vision using head mounted display and computer vision emotion detection. In Computers Helping People with Special Needs: 16th International Conference, ICCHP 2018, Linz, Austria, July 11-13, 2018, Proceedings, Part II 16 (pp. 44-50). Springer International Publishing.

Link to Full Text

Share

COinS