Cited time in webofscience Cited time in scopus

Generative approach for data augmentation for deep learning-based bone surface segmentation from ultrasound images

Generative approach for data augmentation for deep learning-based bone surface segmentation from ultrasound images
Zama, AsaduzPark, Sang HyunBang, HyunheePark, Chul-wooPark, IlhyungJoung, Sanghyun
DGIST Authors
Park, Sang Hyun
Issued Date
Article Type
Article; Early Access
Author Keywords
Cystic bone lesionUltrasound bone segmentationDeep learningGANPix2PixAugmentationOsteolytic bone tumor surgery
Purpose: Precise localization of cystic bone lesions is crucial for osteolytic bone tumor surgery. Recently, there is a move toward ultrasound imaging over plain radiographs (X-rays) for intra-operative navigation due to the radiation-free and cost-effectiveness of the modality. In this process, the intra-operative bone model reconstructed from the segmented ultrasound image is registered with the pre-operative bone model. Deep learning approaches have recently shown remarkable success in bone surface segmentation from ultrasound images. However, to train deep learning models effectively with limited dataset size, data augmentation is essential. This study investigates the applicability of the generative approach for data augmentation as well as identifies standard data augmentation approaches for bone surface segmentation from ultrasound images. Methods: The generative approach we used in our work is based on Pix2Pix image-to-image translation network. We have proposed a multiple-snapshot approach, which mitigates the uni-modal deterministic output issue in the Pix2Pix network without using any complex architecture and training process. We also identified standard data augmentation approaches necessary for ultrasound bone surface segmentation through experiments. Results: We have evaluated our networks using 800 ultrasound images from trained regions (humerus bone) and 1200 ultrasound images from untrained regions (tibia and femur bones) using four different augmentation approaches. The results show that the generative augmentation approach has a positive impact on accuracy in both trained (+ 4.88%) and untrained regions (+ 25.84%) compared to using only standard augmentations. Moreover, compared to standard augmentation approaches, the addition of the generative augmentation approach also showed a similar trend in both trained (+ 8.74%) and untrained (+ 11.55%) regions. Conclusion: Generative approaches are very beneficial for data augmentation, where limited dataset size is prevalent, such as ultrasound bone segmentation. The proposed multiple-snapshot Pix2Pix approach has the potential to generate multimodal images, which enlarges the dataset considerably. © 2020, CARS.
Springer Verlag
Related Researcher
  • 박상현 Park, Sang Hyun 로봇및기계전자공학과
  • Research Interests 컴퓨터비전; 인공지능; 의료영상처리
Files in This Item:

There are no files associated with this item.

Appears in Collections:
Department of Robotics and Mechatronics Engineering Medical Image & Signal Processing Lab 1. Journal Articles


  • twitter
  • facebook
  • mendeley

Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.