Lensless Image Restoration Based on Multi-Stage Deep Neural Networks and Pix2pix Architecture | |
Liu, Muyuan1,2; Su, Xiuqin1,2,3![]() ![]() | |
作者部门 | 光电跟踪与测量技术研究室 |
2023-11 | |
发表期刊 | PHOTONICS
![]() |
ISSN | 2304-6732 |
卷号 | 10期号:11 |
产权排序 | 1 |
摘要 | Lensless imaging represents a significant advancement in imaging technology, offering unique benefits over traditional optical systems due to its compact form factor, ideal for applications within the Internet of Things (IoT) ecosystem. Despite its potential, the intensive computational requirements of current lensless imaging reconstruction algorithms pose a challenge, often exceeding the resource constraints typical of IoT devices. To meet this challenge, a novel approach is introduced, merging multi-level image restoration with the pix2pix generative adversarial network architecture within the lensless imaging sphere. Building on the foundation provided by U-Net, a Multi-level Attention-based Lensless Image Restoration Network (MARN) is introduced to further augment the generator's capabilities. In this methodology, images reconstructed through Tikhonov regularization are perceived as degraded images, forming the foundation for further refinement via the Pix2pix network. This process is enhanced by incorporating an attention-focused mechanism in the encoder--decoder structure and by implementing stage-wise supervised training within the deep convolutional network, contributing markedly to the improvement of the final image quality. Through detailed comparative evaluations, the superiority of the introduced method is affirmed, outperforming existing techniques and underscoring its suitability for addressing the computational challenges in lensless imaging within IoT environments. This method can produce excellent lensless image reconstructions when sufficient computational resources are available, and it consistently delivers optimal results across varying computational resource constraints. This algorithm enhances the applicability of lensless imaging in applications such as the Internet of Things, providing higher-quality image acquisition and processing capabilities for these domains. |
关键词 | monocular depth estimation pseudo-depth net transformer encoder-decoder |
DOI | 10.3390/photonics10111274 |
收录类别 | SCI |
语种 | 英语 |
WOS记录号 | WOS:001118429000001 |
出版者 | MDPI |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.opt.ac.cn/handle/181661/97060 |
专题 | 光电跟踪与测量技术研究室 |
通讯作者 | Su, Xiuqin; Hao, Wei |
作者单位 | 1.Chinese Acad Sci, Xian Inst Opt & Precis Mech, Key Lab Space Precis Measurement Technol, Xian 710119, Peoples R China 2.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 3.Pilot Natl Lab Marine Sci & Technol, Qingdao 266237, Peoples R China 4.Jiujiang Univ, Sch Elect & Informat Engn, Jiujiang 332005, Peoples R China |
推荐引用方式 GB/T 7714 | Liu, Muyuan,Su, Xiuqin,Yao, Xiaopeng,et al. Lensless Image Restoration Based on Multi-Stage Deep Neural Networks and Pix2pix Architecture[J]. PHOTONICS,2023,10(11). |
APA | Liu, Muyuan,Su, Xiuqin,Yao, Xiaopeng,Hao, Wei,&Zhu, Wenhua.(2023).Lensless Image Restoration Based on Multi-Stage Deep Neural Networks and Pix2pix Architecture.PHOTONICS,10(11). |
MLA | Liu, Muyuan,et al."Lensless Image Restoration Based on Multi-Stage Deep Neural Networks and Pix2pix Architecture".PHOTONICS 10.11(2023). |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Lensless Image Resto(2437KB) | 期刊论文 | 出版稿 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论