Dual Stream Fusion U-Net Transformers for 3D Medical Image Segmentation (IEEE BigComp 2024)

2024년 IEEE에서 주관한 Big Data and Smart Computing(BigComp) 학회의 연구 논문이다.

논문 제목: Dual Stream Fusion U-Net Transformers for 3D Medical Image Segmentation
논문 저자: Seungkyun Hong*, Sunghyun Ahn*, Youngwan Jo, and Sanghyun Park[* co-first]
상태: Accepted (Oral Session)
정보: February 18-21, 2024, The Sukosol Hotel, Bangkok, Thailand
학회 홈페이지: [BigComp 2024]
학술정보 포털: [IEEE Xplore]


요약

Medical image segmentation is a crucial ongoing issue in clinical applications for differentiating lesions and segmenting various organs to extract relevant features. Many recent studies have combined transformers, which enable global context modeling leveraging self-attention, with U-Nets to distinguish organs in complex volumetric medical images such as 3-dimensional(3D) Computed Tomography (CT) and Magnetic Resonance
Imaging (MRI) images. In this study, we propose a Dual Stream fusion U-NEt TRansformers (DS-UNETR) comprising a Dual Stream Attention Encoder (DS-AE) and Bidirectional All Scale Fusion (Bi-ASF) module. We designed the DS-AE that extracts both spatial and channel features in parallel streams to better understand the relation between channels. When transferring the extracted features from the DS-AE to the decoder, we used the Bi-ASF module to fuse all scale features. We achieved an average Dice similarity coefficient (Dice score) improvement of 0.97% and a 95% Hausdorff distance (HD95), indicating an improvement of 7.43% compared to that for a state-of-the-art model on the Synapse dataset. We also demonstrated the efficiency of our model by reducing the space and time complexity with a decrease of 80.73% in parameters and 78.86% in FLoating point
OPerationS (FLOPS). Our proposed model, DS-UNETR, shows superior performance and efficiency in terms of segmentation accuracy and model complexity (both space and time) compared to existing state-of-the-art models on the 3D medical image segmentation benchmark dataset. The approach of our proposed model can be effectively applied in various medical big data analysis applications.


발표 자료

Leave a Reply

Your email address will not be published. Required fields are marked *