Development of Visual Scene Display-based Augmentative and Alternative Communication System

Abstract

Augmentative and Alternative Communication (AAC) refers to various strategies and tools used to enhance communication for individuals with limited speech or language abilities. Visual Scene Displays (VSDs) have emerged as a promising approach within AAC, leveraging visual cues and contextualized scenes to support communication and language development. This project presents the development of a Visual Scene Display system designed in English and Kannada to empower individuals with communication challenges. The development process involved several key steps. Firstly, extensive research was conducted to understand the needs and preferences of individuals using AAC, as well as the underlying principles and best practices in AAC intervention. This knowledge guided the design of the VSD system, ensuring its effectiveness and usability. The VSD system was implemented as a webpage application, compatible with all the devices through which the internet can be accessed. The system offers a user-friendly interface that allows individuals to create and customize their own scenes by uploading images or capturing real-life scenes using the device's camera. The system incorporates a robust symbol library, including pictograms, icons, and audio to support comprehension and expression. The development process involved iterative design, usability testing, and feedback from AAC professionals, individuals with communication challenges, and their caregivers. This collaborative approach ensured that the VSD system addressed the diverse needs and abilities of its target users. Preliminary evaluations of the VSD system have shown promising results, indicating its potential to enhance communication and language development among individuals with limited speech or language abilities. Future work includes further refinement of the system based on user feedback, integration of advanced features such as conversion of audio and images into videos, and large-scale field trials to assess its long-term effectiveness and impact. The development of the VSD system represents a significant contribution to the field of AAC by providing individuals with a versatile and intuitive communication tool in two languages (English and Kannada), this system has the potential to empower and improve the quality of life for individuals with communication challenges.