Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images | |
Huang, Yingying1,2,3; Si, Yang4,5,6; Hu, Bingliang3![]() ![]() | |
作者部门 | 光谱成像技术研究室 |
2022-11 | |
发表期刊 | COMPUTERS IN BIOLOGY AND MEDICINE
![]() |
ISSN | 0010-4825;1879-0534 |
卷号 | 150 |
产权排序 | 1 |
摘要 | In the past decade, deep learning methods have been implemented in the medical image fields and have achieved good performance. Recently, deep learning algorithms have been successful in the evaluation of diagnosis on lung images. Although chest radiography (CR) is the standard data modality for diagnosing pneumoconiosis, computed tomography (CT) typically provides more details of the lesions in the lung. Thus, a transformer-based factorized encoder (TBFE) was proposed and first applied for the classification of pneumoconiosis depicted on 3D CT images. Specifically, a factorized encoder consists of two transformer encoders. The first transformer encoder enables the interaction of intra-slice by encoding feature maps from the same slice of CT. The second transformer encoder explores the inter-slice interaction by encoding feature maps from different slices. In addition, the lack of grading standards on CT for labeling the pneumoconiosis lesions. Thus, an acknowledged CR-based grading system was applied to mark the corresponding pneumoconiosis CT stage. Then, we pre-trained the 3D convolutional autoencoder on the public LIDC-IDRI dataset and fixed the parameters of the last convolutional layer of the encoder to extract CT feature maps with underlying spatial structural information from our 3D CT dataset. Experimental results demonstrated the superiority of the TBFE over other 3D-CNN networks, achieving an accuracy of 97.06%, a recall of 89.33%, precision of 90%, and an F1-score of 93.33%, using 10-fold cross-validation. |
关键词 | Transformer-based factorized encoder 3D convolutional autoencoder Intra-slice interaction Inter-slice interaction |
DOI | 10.1016/j.compbiomed.2022.106137 |
收录类别 | SCI |
语种 | 英语 |
WOS记录号 | WOS:000878510400003 |
出版者 | PERGAMON-ELSEVIER SCIENCE LTD |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.opt.ac.cn/handle/181661/96235 |
专题 | 光谱成像技术研究室 |
通讯作者 | Wu, Dongsheng; Wang, Quan |
作者单位 | 1.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Key Lab Spectral Imaging Technol, Xian 710119, Shanxi, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Key Lab Biomed Spect, Xian 710119, Shanxi, Peoples R China 4.Sichuan Acad Med Sci, China, Sichuan, Peoples R China 5.Sichuan Prov Peoples Hosp, Dept Neurol, Chengdu, Sichuan, Peoples R China 6.Univ Elect Sci & Technol China, Chengdu, Sichuan, Peoples R China 7.Sichuan Univ, West China Sch Publ Hlth, Dept Radiol, Chengdu, Sichuan, Peoples R China 8.Sichuan Univ, West China Hosp 4, Chengdu, Sichuan, Peoples R China 9.Sichuan Univ, Res Ctr Artificial Intelligence Med, West China PUMC CC Chen Inst Hlth, Chengdu, Sichuan, Peoples R China |
推荐引用方式 GB/T 7714 | Huang, Yingying,Si, Yang,Hu, Bingliang,et al. Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images[J]. COMPUTERS IN BIOLOGY AND MEDICINE,2022,150. |
APA | Huang, Yingying.,Si, Yang.,Hu, Bingliang.,Zhang, Yan.,Wu, Shuang.,...&Wang, Quan.(2022).Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images.COMPUTERS IN BIOLOGY AND MEDICINE,150. |
MLA | Huang, Yingying,et al."Transformer-based factorized encoder for classification of pneumoconiosis on 3D CT images".COMPUTERS IN BIOLOGY AND MEDICINE 150(2022). |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Transformer-based fa(4510KB) | 期刊论文 | 出版稿 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论