Klasifikasi Arah Pengendali Karakter Permainan Berbasis Gestur Badan Menggunakan Hybrid Convolutional Neural Network dan Long Short-Term Memory

The increasing sedentary lifestyle in the digital era has the potential to cause various health problems due to lack of physical activity. One approach that can be taken to encourage physical activity is through the use of digital games with body movement-based control mechanisms. This study aims to develop a body gesture-based game character control system using a hybrid Convolutional Neural Network (CNN) and Long Short-Term Memory (LSTM) model. CNN is used to extract spatial features from each video frame, while LSTM serves to model the temporal relationship between frames so that movement patterns can be recognized sequentially. The research method used refers to the Machine Learning Lifecycle stages, starting from data collection, preprocessing, model development, to implementation in the endless runner game genre. Testing results show that the CNN–LSTM model is capable of classifying body gestures and generating outputs that can be used as commands to control game characters. The implementation of this system enables more natural and interactive game interactions without conventional input devices, and has the potential to encourage players to lead a more active lifestyle.