Research Article Open Access

Static Hand Gestures: Fingertips Detection Based on Segmented Images

Ahmad Yahya Dawod1, Md Jan Nordin2 and Junaidi Abdullah3
  • 1 Centre for Artificial Intelligence Technology (CAIT), Malaysia
  • 2 Universiti Kebangsaan Malaysia (UKM), Malaysia
  • 3 Multimedia University (MMU), Malaysia

Abstract

Fingertips detection is important for recognition of static gesture in sign language. This paper presents a new method that is based on YCbCr colour space and skeletonization for fingertips detection towards gesture segmentation and recognition. The method begins with the conversion of an image in RGB colour space into YCbCr colour space. Then, the chrominance Cb and Cr are extracted from the YCbCr colour space. A thresholding technique, which is based on a pre-defined range for Cb and Cr components representing the skin colour value is used to extract the hand from the background and to achieve the binary image. A morphological processing is performed on the obtained binary image to remove noise and unwanted image pixels. The candidate fingertips position is then calculated based on skeletonization algorithm and tracing process. The centroid is subsequently found, after which the Euclidean distances between the pixels’ coordinates that belong to the candidate fingertips and the centroid are calculated towards validating their representation of the actual fingertips. Based on the proposed method, the fingertips of twenty-six American Sign Language (ASL) alphabets hand sign samples were detected successfully and the gesture was correctly recognized with an accuracy of 96.3% during the conducted experiments.

Journal of Computer Science
Volume 11 No. 12, 2015, 1090-1098

DOI: https://doi.org/10.3844/jcssp.2015.1090.1098

Submitted On: 17 November 2015 Published On: 4 February 2016

How to Cite: Dawod, A. Y., Nordin, M. J. & Abdullah, J. (2015). Static Hand Gestures: Fingertips Detection Based on Segmented Images. Journal of Computer Science, 11(12), 1090-1098. https://doi.org/10.3844/jcssp.2015.1090.1098

  • 2,598 Views
  • 2,041 Downloads
  • 2 Citations

Download

Keywords

  • Static Gesture
  • YCbCr Colour Space
  • Morphological Processing
  • Hand Centroid
  • Skin Colour Segmentation