Full-Stokes Spectro-Polarimetric Camera with Full Spatial Resolution
Junren Wen
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorShuaibo Feng
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorYipeng Chen
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorWeiming Shi
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorHaiqi Gao
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorYu Shao
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorYuchuan Shao
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Search for more papers by this authorYueguang Zhang
State key laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang, China
Search for more papers by this authorCorresponding Author
Weidong Shen
State key laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang, China
E-mail: [email protected]; [email protected]
Search for more papers by this authorCorresponding Author
Chenying Yang
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
State key laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang, China
E-mail: [email protected]; [email protected]
Search for more papers by this authorJunren Wen
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorShuaibo Feng
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorYipeng Chen
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorWeiming Shi
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorHaiqi Gao
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorYu Shao
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing, 100049 China
Search for more papers by this authorYuchuan Shao
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences, Shanghai, 201800 China
Search for more papers by this authorYueguang Zhang
State key laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang, China
Search for more papers by this authorCorresponding Author
Weidong Shen
State key laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang, China
E-mail: [email protected]; [email protected]
Search for more papers by this authorCorresponding Author
Chenying Yang
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou, 310024 Zhejiang, China
State key laboratory of Modern Optical Instrumentation, Department of Optical Engineering, Zhejiang University, Hangzhou, 310027 Zhejiang, China
E-mail: [email protected]; [email protected]
Search for more papers by this authorAbstract
In recent years, intelligent optical sensing has seen rapid advancements driven by innovations in optoelectronics and AI-based algorithms. Specifically, spectro-polarimetric imaging (SPI) provides comprehensive insights by capturing both spectral and polarization information. In this paper, a spectro-polarimetric camera is presented that combines full-Stokes polarimetric imaging with multi-spectral imaging, achieving full spatial resolution across the visible wavelength range. Utilizing a CMOS-compatible micro-filter array and a deep unfolding network (GAP-net), the camera achieves a spatial resolution of 2016 × 2016 pixels, and successfully resolves 14.30 lines per millimeter, as verified by the USAF 1951 test chart. The camera achieves video-rate snapshot spectral imaging for polarization-insensitive scenarios and delivers exceptional spectral reconstruction fidelity for both static and dynamic scenes, with a remarkable fidelity of 99.53% for the standard color checker. For polarization-sensitive scenes, the full-Stokes parameters (S0, S1, S2, S3) are successfully restored, while maintaining the spectral precision. The proposed spectro-polarimetric camera holds significant importance for high-dimensional intelligent optical sensing and demonstrates considerable potential in remote sensing, autonomous driving, and surveillance.
Conflict of Interest
The authors declare no conflict of interest.
Open Research
Data Availability Statement
The data that support the findings of this study are available from the corresponding author upon reasonable request.
Supporting Information
| Filename | Description |
|---|---|
| lpor202401983-sup-0001-SuppMat.pdf5.8 MB | Supporting Information |
| lpor202401983-sup-0002-VideoS1.avi9 MB | Supplemental Video 1 |
| lpor202401983-sup-0003-VideoS2.avi36.8 MB | Supplemental Video 2 |
Please note: The publisher is not responsible for the content or functionality of any supporting information supplied by the authors. Any queries (other than missing content) should be directed to the corresponding author for the article.
References
- 1S. Yuan, C. Ma, E. Fetaya, T. Mueller, D. Naveh, F. Zhang, F. Xia, Science 2023, 379, eade1220.
- 2Z. Wang, T. Wan, S. Ma, Y. Chai, Nat. Nanotechnol. 2024, 19, 919.
- 3Y. Cao, H. Tang, B. Lou, F. Du, G. Gao, M. Zhang, X. Ni, A. Yacoby, S. Fan, E. Mazur, (Preprint) https://doi.org/10.21203/rs.3.rs-4248044/v1, submitted: May 2024.
10.21203/rs.3.rs?4248044/v1 Google Scholar
- 4Z. Shen, F. Zhao, C. Jin, S. Wang, L. Cao, Y. Yang, Nat. Commun. 2023, 14, 1035.
- 5Z. Wang, L. Li, Y. Shi, J. Chen, J. Yao, Z. Li, ACS Photonics 2024, 11, 3898.
- 6H. Jiang, Y. Chen, W. Guo, Y. Zhang, R. Zhou, M. Gu, F. Zhong, Z. Ni, J. Lu, C.-W. Qiu, W. Gao, Nat. Commun. 2024, 15, 8347.
- 7N. A. Rubin, G. D'Aversa, P. Chevalier, Z. Shi, W. T. Chen, F. Capasso, Science 2019, 365, eaax1839.
- 8J. Wei, C. Xu, B. Dong, C.-W. Qiu, C. Lee, Nat. Photon. 2021, 15, 614.
- 9I. Song, J. Ahn, H. Ahn, S. H. Lee, J. Mei, N. A. Kotov, J. H. Oh, Nature 2023, 617, 92.
- 10J. Bao, M. G. Bawendi, Nature 2015, 523, 67.
- 11Z. Yang, T. Albrow-Owen, H. Cui, J. Alexander-Webber, F. Gu, X. Wang, T.-C. Wu, M. Zhuge, C. Williams, P. Wang, A. V. Zayats, W. Cai, L. Dai, S. Hofmann, M. Overend, L. Tong, Q. Yang, Z. Sun, T. Hasan, Science 2019, 365, 1017.
- 12Z. Wang, S. Yi, A. Chen, M. Zhou, T. S. Luk, A. James, J. Nogan, W. Ross, G. Joe, A. Shahsafi, K. X. Wang, M. A. Kats, Z. Yu, Nat. Commun. 2019, 10, 1020.
- 13H. H. Yoon, H. A. Fernandez, F. Nigmatulin, W. Cai, Z. Yang, H. Cui, F. Ahmed, X. Cui, M. G. Uddin, E. D. Minot, H. Lipsanen, K. Kim, P. Hakonen, T. Hasan, Z. Sun, Science 2022, 378, 296.
- 14J. Wen, L. Hao, C. Gao, H. Wang, K. Mo, W. Yuan, X. Chen, Y. Wang, Y. Zhang, Y. Shao, C. Yang, W. Shen, ACS Photonics 2023, 10, 225.
- 15Z. Yang, T. Albrow-Owen, W. Cai, T. Hasan, Science 2021, 371, eabe0722.
- 16K. Shinoda, Y. Ohtera, Opt. Express 2020, 28, 38867.
- 17X. Wang, Z. Yang, F. Bao, T. Sentz, Z. Jacob, Optica 2024, 11, 73.
- 18T. Mu, F. Han, H. Li, A. Tuniyazi, Q. Li, H. Gong, W. Wang, R. Liang, Opt. Laser Eng. 2022, 148, 106767.
- 19F. Han, T. Mu, H. Li, A. Tuniyazi, Adv. Photon. Nexus 2023, 2, 036009.
- 20L. Zhang, C. Zhou, B. Liu, Y. Ding, H.-J. Ahn, S. Chang, Y. Duan, M. T. Rahman, T. Xia, X. Chen, Z. Liu, X. Ni, Sci. Adv. 2024, 10, eadp5192.
- 21A. Fan, T. Xu, J. Li, G. Teng, X. Wang, Y. Zhang, C. Xu, Opt. Laser Eng. 2023, 160, 107256.
- 22Y. Zhang, H. Li, J. Sun, X. Zhang, H. Wang, IEEE Trans. Geosci. Remote Sens. 2023, 61, 1.
- 23T. Sun, J. Hu, X. Zhu, F. Xu, C. Wang, Laser Photonics Rev. 2022, 16, 2100650.
- 24X. Wang, T. D. Mechelen, S. Bharadwaj, M. Roknuzzaman, F. Bao, R. Rahman, Z. Jacob, eLight 2024, 4, 22.
- 25Y. Ni, C. Chen, S. Wen, X. Xue, L. Sun, Y. Yang, eLight 2022, 2, 23.
- 26S. Wen, X. Xue, S. Wang, Y. Ni, L. Sun, Y. Yang, Light Sci. Appl. 2024, 13, 88.
- 27C. He, H. He, J. Chang, B. Chen, H. Ma, M. J. Booth, Light Sci. Appl. 2021, 10, 194.
- 28Z. Lee, K. L. Carder, C. D. Mobley, R. G. Steward, J. S. Patch, Appl. Opt. 1998, 37, 6329.
- 29Z. Lee, K. L. Carder, C. D. Mobley, R. G. Steward, J. S. Patch, Appl. Opt. 1999, 38, 3831.
- 30L. M. Dale, A. Thewis, C. Boudry, I. Rotar, P. Dardenne, V. Baeten, J. A. F. Pierna, Appl. Spectrosc. Rev. 2013, 48, 142.
- 31Y. Fan, W. Huang, F. Zhu, X. Liu, C. Jin, C. Guo, Y. An, Y. Kivshar, C.-W. Qiu, W. Li, Nature 2024, 630, 77.
- 32L. Bian, Z. Wang, Y. Zhang, L. Li, Y. Zhang, C. Yang, W. Fang, J. Zhao, C. Zhu, Q. Meng, X. Peng, J. Zhang, Nature 2024, 635, 73.
- 33M. Yako, Y. Yamaoka, T. Kiyohara, C. Hosokawa, A. Noda, K. Tack, N. Spooren, T. Hirasawa, A. Ishikawa, Nat. Photon. 2023, 17, 218.
- 34W. Zhang, J. Suo, K. Dong, L. Li, X. Yuan, C. Pei, Q. Dai, Nat. Commun. 2023, 14, 5043.
- 35J. Yang, K. Cui, Y. Huang, W. Zhang, X. Feng, F. liu, Chip 2023, 2, 100045.
- 36J. Xiong, X. Cai, K. Cui, Y. Huang, J. Yang, H. Zhu, W. Li, B. Hong, S. Rao, Z. Zheng, S. Xu, Y. He, F. Liu, X. Feng, W. Zhang, Optica 2022, 9, 461.
- 37J. Yang, K. Cui, X. Cai, J. Xiong, H. Zhu, S. Rao, S. Xu, Y. Huang, F. Liu, X. Feng, W. Zhang, Laser Photonics Rev. 2022, 16, 2100663.
- 38H. He, Y. Zhang, Y. Shao, Y. Zhang, G. Geng, J. Li, X. Li, Y. Wang, L. Bian, J. Zhang, L. Huang, Adv. Mater. 2024, 36, 2313357.
- 39L. Huang, R. Luo, X. Liu, X. Hao, Light Sci. Appl. 2022, 11, 61.
- 40Z. Meng, S. Jalali, X. Yuan, (Preprint) arXiv:2012.08364, v1, submitted: Dec 2020.
- 41X. Yuan, D. J. Brady, A. K. Katsaggelos, IEEE Signal Process. Mag. 2021, 38, 65.
- 42M. E. Gehm, R. John, D. J. Brady, R. M. Willett, T. J. Schulz, Opt. Express 2007, 15, 14013.
- 43A. Wagadarikar, R. John, R. Willett, D. Brady, Appl. Opt. 2008, 47, B44.
- 44Q. Fan, W. Xu, X. Hu, W. Zhu, T. Yue, F. Yan, P. Lin, L. Chen, J. Song, H. J. Lezec, A. Agrawal, Y. Lu, T. Xu, Nat. Commun. 2023, 14, 7180.
- 45A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, I. Polosukhin, Adv. Neural Inf. Process. Syst. 2017, 30.
- 46A. Gu, T.Dao, (Preprint) arXiv:2312.00752, v2, submitted: May 2024.
- 47Z. Liu, Y. Wang, S. Vaidya, F. Ruehle, J. Halverson, M. Soljačić, T. Y. Hou, M. Tegmark, (Preprint) arXiv:2404.19756, v5, submitted: Feb, 2025.
