A Systematic Mapping of Computer Vision-Based Sign Language Recognition

Jimmy Jimenez-Salas, Mario Chacon-Rivas

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Sign languages are the primary mean of communication for the majority of deaf people. Unfortunately, there are multiple barriers due to the lack of assistive technologies, this causes problems in the communication between the Deaf and their environment, access to services, education, information, and employment. Automatic sign language recognition using machine learning techniques has gained special attention in the last years to help reduce such barriers. Different lines of investigation are being followed for isolated and continuous sign language recognition, and multiple models exist that attempt to translate from sign language to a written one. We present a systematic mapping of the papers that have been published relevant to this area between January 2019 and March 2022. The main focus of the study is on technologies used to recognize isolated signs and sentences in different sign languages from RGB videos and without specialized hardware or sensors. A total of 1061 articles are reviewed and classified showing that: (1) There is a majority of publications which use external hardware or recognize alphabet signs from static images, (2) LSTM and different variants of CNNs are the main methods used for isolated sign language recognition and Transformer models are predominant for continuous sign language recognition, (3) Different types of CNNs are the primary feature extraction methods followed by skeleton representations. Finally, we highlight the use of negative vocabulary and labels in research papers to refer to the Deaf community and call for the eradication of this practice.1

Original languageEnglish
Title of host publicationCONTIE 2022 - 5th International Conference on Inclusive Technologies and Education and the 2nd International Conference of the Project Promoting Accessibility of Students with Disability to Higher Education in Cuba, Costa Rica and Dominican Republic
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665455350
DOIs
StatePublished - 2022
Event5th International Conference on Inclusive Technologies and Education, CONTIE 2022 - Cartago, Costa Rica
Duration: 25 Oct 202228 Oct 2022

Publication series

NameCONTIE 2022 - 5th International Conference on Inclusive Technologies and Education and the 2nd International Conference of the Project Promoting Accessibility of Students with Disability to Higher Education in Cuba, Costa Rica and Dominican Republic

Conference

Conference5th International Conference on Inclusive Technologies and Education, CONTIE 2022
Country/TerritoryCosta Rica
CityCartago
Period25/10/2228/10/22

Keywords

  • Computer Vision
  • Machine Learning
  • Sign Language Recognition
  • Sign Language Translation

Fingerprint

Dive into the research topics of 'A Systematic Mapping of Computer Vision-Based Sign Language Recognition'. Together they form a unique fingerprint.

Cite this