Dadang Iskandar Mulyana; Sopan Adrianto; Tatinia Arda Rizqi Amalia; Putri Elsa Widiastuti
Sign language recognition is one of the areas of image recognition and image processing technology that is developing rapidly in human-computer interaction. This technology really helps the deaf and speech impaired in communicating with non-disabled people. This research aims to examine the optimization of an object tracking system in sign language using the Gaussian Mixture Model (GMM) and Kalman Filter by including the Region of Interest (ROI). The proposed system consists of three main components, namely hand detection, object extraction, and classification. Hand detection is done using the Kalman Filter to track hand movements accurately. Next, Region of Interest (ROI) features, such as shape, direction and movement features, are extracted from the detected part of the hand. These features are fed into a Gaussian Mixture Model (GMM) classifier, which can recognize sign language based on the extracted features. With the combination of GMM and Kalman Filter in this research, it can increase accuracy in object tracking, reduce interference from the background, and ensure the tracking focus remains on important objects. The dataset used is in the form os SIBI alphabet symbols, namely A-Z with the amount of data for each class, namely 620 images. Based on the research result, model testing using GMM, Kalman Filter and ROI produces higher accuracy of 99%, while model testing using GMM and ROI produces accuracy of 90%.