As a result of the research, the Surdkorzh mobile application has been developed, capable of recognizing gestures and translating them into text or audio format. This application is implemented on the Android platform using advanced machine learning technologies and gesture recognition algorithms. Experiments and studies have been conducted to evaluate the effectiveness of the application and its ability to correctly recognize the movements of various users.
The implementation of the project is of great practical importance. It allows people with hearing impairments to use Android-based mobile devices as a means of communication, which simplifies their daily lives and increases their chances of communicating with others. Possibilities for further development and improvement of the application are being considered, such as expanding the Widowhood vocabulary, optimizing recognition algorithms, and introducing additional features such as speech synthesis to translate widowhood sound.
The topic is relevant and modern, and has a certain commercial potential. The developed software product provides users with a convenient and simple service for managing a list of tasks available in a web application format.
In the course of the work, the following issues were considered: the study of the main stages of application development, an overview of application development tools for mobile devices and the rationale for choosing design tools, system modeling and application development for Android OS.
BIGALIYEVA A.Z.
PhD, acting docent, Karaganda Technical University named after Abylkas Saginov, Karaganda, Kazakhstan
E-mail: bigalievaalfija@gmail.com, https://orcid.org/0000-0002-0136-5402
TOLEUGALI N.
assistant, Karaganda Technical University named after Abylkas Saginov, Karaganda, Kazakhstan
E-mail: toleugaly@gmail.com, https://orcid.org/0009-0004-4099-8220
- Felzenszwalb P. F., & Huttenlocher D. P. (2004). Efficient graph-based image segmentation. International Journal of Computer Vision, 59(2), 167-181.
- Welch G., & Bishop G. (1995). An introduction to the Kalman filter. University of North Carolina at Chapel Hill.
- Doucet A., de Freitas N., & Gordon N. (2001). An introduction to sequential Monte Carlo methods. Springer.
- Szeliski R. (2010). Computer vision: algorithms and applications. Springer Science & Business Media.
- Boykov Y., & Jolly M. P. (2001). Interactive graph cuts for optimal boundary & region segmentation of objects in ND images. Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, 105-112
- Abbas Q., Ibrahim M., Jaffar A. Video scene analysis: an overview and challenges on deep learning algorithms // Multimedia Tools and Applications, 2018. – Volume 77 Issue 16, pp 20415–20453. doi.org/10.1007/s11042-017-5438-7
- Ramil S., Lavrenov R., Tsoy T., Svinin M. and Magid E., Real-Time Video Server Implementation for a Mobile Robot // 11th International Conference on Developments in eSystems Engineering (DeSE), Cambridge, UK, 2018. – pp. 180-185. doi: 10.1109/DeSE.2018.00042.
- Rosu V., Marcu M. Real Time Adaptive Video Streaming // 2016 IEEE 12th International Conference on Intelligent Computer Communication and Processing (ICCP). Cluj-Napoca, Romania, 2016. – pp. 239-246. doi: 10.1109/ICCP.2016.7737153.