Webcam-Based Finger Detection Using Mediapipe

Fachri Yanuar Rudi, Guntur Syahputra, Umri Erdiansyah, Ilham Safar

Sari


Pengembangan media pembelajaran berbasis multimedia terus berkembang seiring dengan kemajuan teknologi, salah satunya dalam pengenalan bagian tubuh seperti jari tangan. Penelitian ini bertujuan untuk mengembangkan aplikasi pembelajaran interaktif untuk mengenal nama-nama jari tangan dengan memanfaatkan teknologi motion capture menggunakan Mediapipe dan bahasa pemrograman Python. Aplikasi ini menggunakan kamera webcam sebagai alat input untuk mendeteksi posisi dan gerakan tangan secara real-time. Sistem dirancang untuk mengenali jari tangan berdasarkan perbandingan panjang ruas jari dan lebar telapak tangan, yang diambil dari data titik kunci (landmarks) tangan yang dihasilkan oleh modul Mediapipe Hands. Hasil pengujian menunjukkan bahwa aplikasi ini mampu mengidentifikasi nama jari dengan tingkat keberhasilan mencapai 90% dari 50 kali percobaan. Hasil ini menunjukkan bahwa teknologi Mediapipe memiliki potensi besar untuk dimanfaatkan dalam pengembangan media pembelajaran yang interaktif dan edukatif.

Teks Lengkap:

PDF

Referensi


R. E. Mayer, Multimedia Learning, 2nd ed. Cambridge, UK: Cambridge University Press, 2009.

R. Horton, Eâ€Learning by Design. San Francisco, CA: Pfeiffer, 2006.

J. Zhang, H. Shan, and X. Chen, “Real-Time Hand Gesture Recognition Based on MediaPipe and Convolutional Neural Network,†in Proc. IEEE Int. Conf. on Consumer Electronics, Las Vegas, NV, USA, Jan. 2021, pp. 1–4.

Google MediaPipe Team, “MediaPipe Hands: On-device Real-time Hand Tracking,†Google, 2022.

F. Y. Rudi F and E. M. Yuniarno, "Contour to Centroid Distance Graph as Feature in Hand Gesture Recognition," IOP Conference Series: Materials Science and Engineering, vol. 536, no. 1, p. 012150, 2019.

F. Y. Rudi F, " Tacking Pergerakan Tangan Menggunakan Skeleton Tracking Kinect," Journal of Artificial Intelligence and Software Engineering, vol. 1, 2021.

P. Delgadoa, C. Vargasb, R. Ackermanc, and L. Salmerón, “Don’t throw away your printed books: A meta-analysis on the effects of reading media on reading comprehension,†Educ. Res. Rev., vol. 25, pp. 23–38, 2018, doi: 10.1016/j.edurev.2018.09.003.

F. Reichert, D. Lange, and L. Chow, “Educational beliefs matter for classroom instruction: A comparative analysis of teachers’ beliefs about the aims of civic education,†Teach. Teach. Educ., vol. 98, pp. 1–13, 2020, doi: 10.1016/j.tate.2020.103248.

J. Roick and T. Ringeisen, “Students’ math performance in higher education: examining the role of self-regulated learning and self-efficacy,†Learn. Individ. Differ., vol. 65, pp. 148–158, 2018.

G. Ocak and A. Yamaç, “Examination of the relationships between fifth graders’ self-regulated learning strategies, motivational beliefs, attitudes, and achievement,†Educ. Sci. Theory Pract., vol. 13, no. 1, pp. 380–387, 2013.

S. Li and J. Zheng, “The relationship between self-efficacy and self-regulated learning in one-to-one computing environment: The mediated role of task values,†Asia-Pacific Educ. Res., vol. 27, no. 6, pp. 455–463, 2018, doi: 10.1007/s40299-018-0405-2.

B. J. Zimmerman and A. R. Moylan, “Self-regulation: where metacognition and motivation intersect,†in D. J. Hacker, J. Dunlosky, and A. C. Graesser, Eds., Handbook of Metacognition in Education, 2009, pp. 299–315.

P. R. Pintrich, D. A. F. Smith, T. Duncan, and W. Mckeachie, A manual for the use of the motivated strategies for learning questionnaire (MSLQ). Ann Arbor, Michigan, 1991.

M. Pressley and C. B. McCormick, Advanced educational psychology for educators, researchers, and policymakers. New York, USA: HarperCollins College Publishers, 1995.

A. Bandura, Prentice-Hall series in social learning theory. Social foundations of thought and action: A social cognitive theory. Prentice-Hall, Inc., 1985.

A. L. Dent and A. C. Koenka, “The relation between self-regulated learning and academic achievement across childhood and adolescence: a meta-analysis,†Educ. Psychol. Rev., vol. 28, no. 3, pp. 425–474, 2015, doi: 10.1007/s10648-015-9320-8.

T. J. Cleary and A. Kitsantas, “Motivation and self-regulated learning influences on middle school mathematics achievement,†School Psych. Rev., vol. 46, no. 1, pp. 88–107, 2017.

P. R. Pintrich, “Chapter 14 - The Role of Goal Orientation in Self-Regulated Learning,†in in M. Boekaerts, P. Pintrich, M. Zeidner, Eds., Handbook of Self-Regulation, San Diego, California: Academic Press, 2000, pp. 451–502.




DOI: http://dx.doi.org/10.30811/jaise.v5i2.6996

Refbacks

  • Saat ini tidak ada refbacks.


Indexing :

Creative Commons License
Journal of Artificial Intelligence and Software Engineering (JAISE) licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.