Nguyen Khac-Nguyen , Chanh-Nghiem Nguyen * , Bui Huu-Danh , Tran Minh-Tuong , Chanh-Nghia Lam , Truong Quoc Bao , Nguyen Hoang Dung and Nguyen Chi Ngon

* Corresponding author (ncnghiem@ctu.edu.vn)

Main Article Content

Abstract

Smart doorbells have become a critical component of smart homes and modern offices. However, a smart doorbell, particularly designed for a leader’s office, has not been introduced. In this study, a smart doorbell is developed for a leader’s office. The system includes an application that allows availability status notification on the doorbell module and voice communication with the visitor from inside the office based on a private Wi-Fi network without an Internet connection to prevent the leader from potential privacy and security issues. It also features a live video capture of the visitor with face recognition by implementing a MobileNet model. In training and testing this model, 1,549 free face images of 125 people were augmented to generate training, validation, and testing datasets of 9,185, 2,500, and 5,000 face images, respectively. An additional authentication testing dataset of 1,068 AI-generated face images was also used to evaluate the system’s False Acceptance Rate (FAR). A high confidence level of 0.945 was selected for the developed MobileNet model to obtain zero FAR and high accuracy, recall, and F-score values of 0.960, 0.960, and 0.978, respectively. Therefore, the proposed doorbell could be used for an office leader, showing potential use for biometric authentication.

Keywords: Audio communication, face recognition, MobileNet, office doorbell

Article Details

References

Afreen, H., & Bajwa, I. S. (2021). An IoT-Based Real-Time Intelligent Monitoring and Notification System of Cold Storage. IEEE Access, 9, 38236–38253. https://doi.org/10.1109/ACCESS.2021.3056672

BKAV SMARTHOME. (2021). Nhận dạng khuôn mặt công nghệ trí tuệ nhân tạo. https://bkavsmarthome.vn/nhan-dang-khuon-mat-cong-nghe-tri-tue-nhan-tao

DeepLizard. (2020). Fine-Tuning MobileNet on Custom Data Set with TensorFlow’s Keras API - deeplizard. https://deeplizard.com/learn/video/Zrt76AIbeh4

Delaney, J. R. (2021, May 18). Ring Video Doorbell Pro 2 Review | PCMag. https://www.pcmag.com/reviews/ring-video-doorbell-pro-2

Devi, R. M., Keerthika, P., Suresh, P., Sarangi, P. P., Sangeetha, M., Sagana, C., & Devendran, K. (2022). Retina biometrics for personal authentication. Machine Learning for Biometrics: Concepts, Algorithms and Applications, 87–104.
https://doi.org/10.1016/B978-0-323-85209-8.00005-5

Howard, A. G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., & Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. CoRR, abs/1704.0. http://arxiv.org/abs/1704.04861

Learned-Miller, G. B. H. E. (2014). Labeled Faces in the Wild: Updates and New Reporting Procedures (Issue UM-CS-2014-003).

Li, S., Wu, J., Long, C., & Lin, Y.-B. (2021). A Full-Process Optimization-Based Background Subtraction for Moving Object Detection on General-Purpose Embedded Devices. IEEE Transactions on Consumer Electronics, 67(2), 129–140. https://doi.org/10.1109/TCE.2021.3077241

Media, G. (2019). Gallery of AI Generated Faces | Generated.photos. https://generated.photos/faces

Omnicore. (2022). The 8 Best Smart Doorbell with Video Camera for Office + Home. https://www.omnicoreagency.com/best-smart-doorbells/

Panasonic. (2022). Video Intercom. https://www.panasonic.com/middleeast/en/business/security/video-intercom.html

Patel, V., Kanani, S., Pathak, T., Patel, P., Ali, M. I., & Breslin, J. (2021). An Intelligent Doorbell Design Using Federated Deep Learning. 8th ACM IKDD CODS and 26th COMAD, 380–384. https://doi.org/10.1145/3430984.3430988

Yaro. (2020, April 16). Best Wireless Doorbells in 2022. https://thehousetech.com/best-wireless-doorbells/

Most read articles by the same author(s)