Research Article Open Access

Arabic Sign Language Translator

Abdelmoty M. Ahmed1, Reda Abo Alez2, Gamal Tharwat2, Muhammad Taha2, B. Belgacem1, Ahmad M.J. Al Moustafa1 and Wade Ghribi1
  • 1 King Khalid University Abha, Saudi Arabia
  • 2 Al Azhar University, Egypt

Abstract

Development of systems that can recognize the gestures of Arabic Sign language (ArSL) provides a method for hearing impaired to easily integrate into society. This paper aims to develop a computational structure for an intelligent translator to recognize the isolated dynamic gestures of the ArSL. In our proposed system we build a datasets for ArSL from scratch of, we used 100-sign vocabulary from ArSL, we have applied 1500 video files for these signs. These signs were divided into five types of signs, recognizing a sign language gestures from dynamic gestures could be a difficult analysis issue. This paper solves the problem using gradient based key frame extraction technique. These key frames are useful for splitting continuous language gestures into sequence of signs for removing uninformative frames. After splitting of gestures every sign has been treated as isolated gesture. Then features of pre-processed gestures are extracted using Intensity Histogram by integrating with Gray Level Co-occurrence Matrix (GLCM) features. Experiments are performed on our own ArSL dataset and the matching between the ArSL and Arabic text is tested by Euclidian distance. The evaluation of the proposed system for the automatic recognition and translation for isolated dynamic ArSL gestures has proven to be effective and highly accurate. The experimental results show that the proposed system recognizes signs with a precision of 95.8%.

Journal of Computer Science
Volume 15 No. 10, 2019, 1522-1537

DOI: https://doi.org/10.3844/jcssp.2019.1522.1537

Submitted On: 30 March 2019 Published On: 26 October 2019

How to Cite: Ahmed, A. M., Alez, R. A., Tharwat, G., Taha, M., Belgacem, B., Al Moustafa, A. M. & Ghribi, W. (2019). Arabic Sign Language Translator. Journal of Computer Science, 15(10), 1522-1537. https://doi.org/10.3844/jcssp.2019.1522.1537

  • 3,225 Views
  • 1,426 Downloads
  • 4 Citations

Download

Keywords

  • Arabic Sign Language
  • Intelligent Translator
  • Isolated Gestures
  • Dynamic Gestures