Cited time in webofscience Cited time in scopus

Multi-Task and Few-Shot Learning-Based Fully Automatic Deep Learning Platform for Mobile Diagnosis of Skin Diseases

Multi-Task and Few-Shot Learning-Based Fully Automatic Deep Learning Platform for Mobile Diagnosis of Skin Diseases
Lee, KyungsuCavalcanti, Thiago CoutinhoKim, SewoongLew, Hah MinSuh, Dae HunLee, Dong HunHwang, Jae Youn
Issued Date
IEEE Journal of Biomedical and Health Informatics, v.27, no.1, pp.176 - 187
Author Keywords
Deep learningfew-shot learningmultimodal systemskin diagnosisfluorescence imaging
Fluorescence imaging-based diagnostic systems have been widely used to diagnose skin diseases due to their ability to provide detailed information related to the molecular composition of the skin compared to conventional RGB imaging. In addition, recent advances in smartphones have made them suitable for application in biomedical imaging, and various smartphone-based optical imaging systems have been developed for mobile healthcare. However, an advanced analysis algorithm is required to improve the diagnosis of skin diseases. Various deep learning-based algorithms have recently been developed for this purpose. However, deep learning-based algorithms using only white-light reflectance RGB images have exhibited limited diagnostic performance. In this study, we developed an auxiliary deep learning network called fluorescence-aided amplifying network (FAA-Net) to diagnose skin diseases using a developed multi-modal smartphone imaging system that offers RGB and fluorescence images. FAA-Net is equipped with a meta-learning-based algorithm to solve problems that may occur due to the insufficient number of images acquired by the developed system. In addition, we devised a new attention-based module that can learn the location of skin diseases by itself and emphasize potential disease regions, and incorporated it into FAA-Net. We conducted a clinical trial in a hospital to evaluate the performance of FAA-Net and to compare various evaluation metrics of our developed model and other state-of-the-art models for the diagnosis of skin diseases using our multi-modal system. Experimental results demonstrated that our developed model exhibited an 8.61% and 9.83% improvement in mean accuracy and area under the curve in classifying skin diseases, respectively, compared with other advanced models. IEEE
Institute of Electrical and Electronics Engineers Inc.
Related Researcher
  • 황재윤 Hwang, Jae Youn 전기전자컴퓨터공학과
  • Research Interests Multimodal Imaging; High-Frequency Ultrasound Microbeam; Ultrasound Imaging and Analysis; 스마트 헬스케어; Biomedical optical system
Files in This Item:

There are no files associated with this item.

Appears in Collections:
Department of Electrical Engineering and Computer Science MBIS(Multimodal Biomedical Imaging and System) Laboratory 1. Journal Articles


  • twitter
  • facebook
  • mendeley

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.