The Detection of Objects and Distance for the Visually Impaired by Using Deep Learning ResNet-152 and the Triangulation Method

Muhammad Ichwan, Irma Amelia Dewi, Nadiati Salsabilla

Sari


This research aims to detect objects and determine the distance from the mobile camera to facilitate and assist visually impaired users in recognizing the surrounding environment using several models made with the RetinaNet Method and Residual Network-152 architecture. Three object detection models were generated by ADAM and SGD parameter optimizers. Object recognition was performed using the TensorFlow framework with a dataset of 2,444 images. The first model with training parameters used is ADAM optimizer, epoch 50, batch size 16, and lr 1e-5. The second model has training parameters, such as ADAM optimizer, epoch 100, batch size 16, and lr 1e-5. The third model uses SGD optimizer training parameters, epoch 50, batch size 16, and lr 1e-5. Based on 250 tests on each model, the results show that the best model is the first model, which shows a precision value of 82%, a recall value of 98%, an f1 score value of 89%, and an accuracy value of 86%. The distance from the mobile camera is tested in multiples of 10 at a distance of 100-300 cm with a camera height of 100-130 cm and a camera angle of 80â°-90â° getting reasonable distance detection results at a camera height of 130 cm because it gets the smallest total difference value of 14.3 cm.

Teks Lengkap:

PDF

Referensi


R. R. A. Bourne et al., “Magnitude, temporal trends, and projections of the global prevalence of blindness and distance and near vision impairment: a systematic review and meta-analysis,†Lancet Glob. Heal., vol. 5, no. 9, pp. e888–e897, 2017, doi: 10.1016/S2214-109X(17)30293-0.

E. Elisawati, “Sistem Deteksi Objek Dengan Menggunakan Sensor Ultrasonik Berbasis Fuzzy,†I N F O R M a T I K a, vol. 9, no. 1, p. 10, 2018, doi: 10.36723/juri.v9i1.58.

R. O. Wiyagi and M. Y. Mustar, “Deteksi Jarak Objek Bercahaya Secara Real Time Menggunakan Kamera Tunggal,†3rd Indones. Symp. Robot Soccer Compet., no. January, pp. 1–5, 2015.

I. S. Pratama, Muhammad Rizky; Rizal, Achmad; Sumaryo, “Desain Sistem Deteksi Objek Real Time Dengan Metode Haar Cascade Classifier Real Time Object Detection System Design Using Haar Cascade Classifier Method,†vol. 7, no. 1, pp. 26–34, 2020.

B. Rais, “Alat Bantu Pendeteksi Objek Sekitar Bagi Tuna Netra Menggunakan Stereo Vision Dengan Metode Convolutional Neural Network (CNN),†Undergrad. thesis, 2019.

Rahul and B. B. Nair, “Camera-based object detection, identification and distance estimation,†Proc. - 2nd Int. Conf. Micro-Electronics Telecommun. Eng. ICMETE 2018, pp. 203–205, 2018, doi: 10.1109/ICMETE.2018.00052.

M. I. Arenado, J. M. P. Oria, C. Torre-Ferrero, and L. A. Rentería, “Monovision-based vehicle detection, distance and relative speed measurement in urban traffic,†IET Intell. Transp. Syst., vol. 8, no. 8, pp. 655–664, 2014, doi: 10.1049/iet-its.2013.0098.

A. A. Ali, “2016 Al-Sadeq International Conference on Multidisciplinary in IT and Communication Science and Applications (AIC-MITCSA) ±IRAQ (9-10) May,†no. 1, 2016.

D. Y. Huang, C. H. Chen, T. Y. Chen, W. C. Hu, and K. W. Feng, “Vehicle detection and inter-vehicle distance estimation using single-lens video camera on urban/suburb roads,†J. Vis. Commun. Image Represent., vol. 46, pp. 250–259, 2017, doi: 10.1016/j.jvcir.2017.04.006.

S. R. Dewi, “Deep Learning Object Detection Pada Video,†Deep Learn. Object Detect. Pada Video Menggunakan Tensorflow Dan Convolutional Neural Netw., pp. 1–60, 2018, [Online]. Available: https://dspace.uii.ac.id/bitstream/handle/123456789/7762/14611242_Syarifah Rosita Dewi_Statistika.pdf?sequence=1.

O. Russakovsky et al., “ImageNet Large Scale Visual Recognition Challenge,†Int. J. Comput. Vis., vol. 115, no. 3, pp. 211–252, 2015, doi: 10.1007/s11263-015-0816-y.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,†Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2016-Decem, pp. 770–778, 2016, doi: 10.1109/CVPR.2016.90.

T. Y. Lin, P. Goyal, R. Girshick, K. He, and P. Dollar, “Focal Loss for Dense Object Detection,†IEEE Trans. Pattern Anal. Mach. Intell., vol. 42, no. 2, pp. 318–327, 2020, doi: 10.1109/TPAMI.2018.2858826.

B. Dipper, “Measuring Size from Images: A wrangle with angles and image scale,†Observatory




DOI: http://dx.doi.org/10.30811/jaise.v5i1.6419

Refbacks

  • Saat ini tidak ada refbacks.


Indexing :

Creative Commons License
Journal of Artificial Intelligence and Software Engineering (JAISE) licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.