Publication Search

Sign language recognition is one of the areas of image recognition and image processing technology that is developing rapidly in human-computer interaction. This technology really helps the deaf and speech impaired in communicating with non-disabled people. This research aims to examine the optimization of an object tracking system in sign language using the Gaussian Mixture Model (GMM) and Kalman Filter by including the Region of Interest (ROI). The proposed system consists of three main components, namely hand detection, object extraction, and classification. Hand detection is done using the Kalman Filter to track hand movements accurately. Next, Region of Interest (ROI) features, such as shape, direction and movement features, are extracted from the detected part of the hand. These features are fed into a Gaussian Mixture Model (GMM) classifier, which can recognize sign language based on the extracted features. With the combination of GMM and Kalman Filter in this research, it can increase accuracy in object tracking, reduce interference from the background, and ensure the tracking focus remains on important objects. The dataset used is in the form os SIBI alphabet symbols, namely A-Z with the amount of data for each class, namely 620 images. Based on the research result, model testing using GMM, Kalman Filter and ROI produces higher accuracy of 99%, while model testing using GMM and ROI produces accuracy of 90%.

Gesture  recognition  technology  is  used  to  detect  movements  through  image processing,   enabling  computers  or digital devices to understand and interpret human  body  movements  as  input  or  commands.   This  technology  has  great potential  to bridge communication between the deaf community and individuals without   hearing   impairments,    enhancing  interaction  and  enriching  mutual understanding between the two.  However,  the accuracy ofgesture recognition is often  affected  by variations in the distance between hand landmarks.  Based on this problem,  this research proposes a methodfor stabilizing the measurement of distances between landmark points  in gesture recognition through a polynomial regression  approach.   Specifically,   the  distance  between  hand  landmarks  is calculated and stabilized using polynomial  regression to improve the accuracy of gesture recognition.  This method is implemented using the MediaPipeframework to detect and track hands in real-time,  and the OpenCV library to manage video. The  research  results  show  that  this  approach  can  significantly  improve  the stability  and accuracy  of gesture detection.   The developed system successfully detects gestures for  letters A  through F with a high accuracy  rate,  averaging above 98,3%.  The use ofpolynomial regression helps enhance detection accuracy by reducing noise in the landmark data.

Communication is a fundamental human need for conveying information and ideas. However, individuals who are deaf and mute face difficulties in communicating with the broader community that does not understand sign language. This study aims to design and implement a real-time static sign language translator into speech using five flex sensors, an MPU6050 sensor, a Raspberry Pi Pico, an ADS1115 ADC module, and a DFPlayer Mini module as the audio output medium. Testing results show that the device successfully recognizes finger movements and hand orientation. The system is capable of playing audio output corresponding to recognized gestures, with the shortest latency recorded at 1.1 seconds and the longest at 2.8 seconds, achieving a detection accuracy rate of 75% based on 60 tests across 12 sign words. This device supports the translation of 12 simple sign words. The implementation demonstrates potential as an assistive communication tool, although further development is needed to improve accuracy, expand vocabulary, and conduct trials directly with deaf or mute users.

Parkinson's disease (PD) is a neurodegenerative disorder causing a decline in dopamine levels, impacting the peripheral nervous system and motor functions. Current detection methods often identify PD at advanced stages. This study addresses early-stage detection using handwriting analysis, specifically exploring the PaHaW dataset for pen pressure and stroke movement data. Evaluating online and offline features, the research employs pre-trained CNN models (VGG 19 and AlexNet) for offline datasets, achieving an overall accuracy of 0.53. For online datasets, velocity, and acceleration features are extracted and classified using Gated Recurrent Unit (GRU), Long Short-Term Memory (LSTM), and recurrent neural networks (RNN), with GRU yielding the highest accuracy at 0.57. Notably, the convolution-based model C-Bi-GRU surpasses other architectures with a remarkable 0.75 accuracy, emphasizing its efficacy in early PD detection. These findings underscore the potential of handwriting analysis as a diagnostic tool for PD, contributing valuable insights for further research and development in medical diagnostics.