Publication Search

Gesture  recognition  technology  is  used  to  detect  movements  through  image processing,   enabling  computers  or digital devices to understand and interpret human  body  movements  as  input  or  commands.   This  technology  has  great potential  to bridge communication between the deaf community and individuals without   hearing   impairments,    enhancing  interaction  and  enriching  mutual understanding between the two.  However,  the accuracy ofgesture recognition is often  affected  by variations in the distance between hand landmarks.  Based on this problem,  this research proposes a methodfor stabilizing the measurement of distances between landmark points  in gesture recognition through a polynomial regression  approach.   Specifically,   the  distance  between  hand  landmarks  is calculated and stabilized using polynomial  regression to improve the accuracy of gesture recognition.  This method is implemented using the MediaPipeframework to detect and track hands in real-time,  and the OpenCV library to manage video. The  research  results  show  that  this  approach  can  significantly  improve  the stability  and accuracy  of gesture detection.   The developed system successfully detects gestures for  letters A  through F with a high accuracy  rate,  averaging above 98,3%.  The use ofpolynomial regression helps enhance detection accuracy by reducing noise in the landmark data.

The increasing sedentary lifestyle in the digital era has the potential to cause various health problems due to lack of physical activity. One approach that can be taken to encourage physical activity is through the use of digital games with body movement-based control mechanisms. This study aims to develop a body gesture-based game character control system using a hybrid Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) model. CNN is used to extract spatial features from each video frame, while LSTM serves to model the temporal relationship between frames so that movement patterns can be recognized sequentially. The research method used refers to the Machine Learning Lifecycle stages, starting from data collection, preprocessing, model development, to implementation in the endless runner game genre. Testing results show that the CNN–LSTM model is capable of classifying body gestures and generating outputs that can be used as commands to control game characters. The implementation of this system enables more natural and interactive game interactions without conventional input devices, and has the potential to encourage players to lead a more active lifestyle.

The development of technology with digital image processing is often utilized to solve various problems in image processing, such as facial recognition, object detection, and interaction between users. In this study, we developed an interactive hand gesture-based game titled "Slap Mosquito" that utilizes image processing techniques to control the game through hand gestures. Using Rapid Application Development (RAD), Python, OpenCV, and Pygame methodologies, this game allows users to slap mosquitoes virtually in real-time through hand gesture recognition that is read by the camera and translated into in-game actions. RAD allows rapid development iterations and improvements based on user feedback, which is essential for improving system responsiveness and accuracy. This study focuses on detection precision, system responsiveness, and the impact of lighting on game performance, as measured using frames per second (FPS) and user gameplay results. The test results show that optimal lighting meets high detection accuracy, while low lighting conditions have a negative impact on accuracy and responsiveness. The results of this study provide insights for further development of gesture-based applications, especially regarding the importance of optimizing technical parameters and RAD methodology in improving user experience.