A Reader of Gesture-Based Accessibility User Interface Design for Visually Impaired Children

Abstract

A mobile application, called READ, is developed in this paper to provide visually impaired children more friendly way of reading. This system includes an accessible mobile app and a book library in the cloud. In Taiwan, there is a special kind of books designed for children, which contains both braille and print characters on the same page in the book. This kind of books is very useful for visually impaired children who just start learning braille and their sighted parents or teachers can read with them. The proposed app is designed to assist visually impaired child in reading this kind of books. When visually impaired children get a book on the bookshelf, at home or in a library, they can scan the barcode on the book by the camera of the smart phone. Subsequently the proposed app READ will download the book content from the database and then start reading the book to children with text-to-speech (TTS) technology. A non-directional barcode scanning technology is designed in the proposed app for fast recognition, and thus the barcode does not have to be focused and straight in the camera screen. Furthermore, unlike the common design concept in an app that is based on buttons, gestures become the mainly user interface for visually impaired people. Users do not need to find the positions of the buttons. Using gesture-based design the whole touch screen is the sensing area, which is more convenient and friendly for visually impaired children.



Author Information
Tzu-Fang Sheu, Providence University, Taiwan
Hsiao Ping Lee, Chung Shan Medical University, Taiwan
Jin-Ting Jheng, Providence University, Taiwan

Paper Information
Conference: ACSET2016
Stream: Education and Technology: Teaching, Learning, Technology & Education Support

This paper is part of the ACSET2016 Conference Proceedings (View)
Full Paper
View / Download the full paper in a new tab/window

Posted by amp21