File Download
There are no files associated with this item.
Links for fulltext
(May Require Subscription)
- Publisher Website: 10.1109/DSAA60987.2023.10302579
- Scopus: eid_2-s2.0-85179011264
Supplementary
-
Citations:
- Scopus: 0
- Appears in Collections:
Conference Paper: Solving Inverse Problems in Compressive Imaging with Score-Based Generative Models
Title | Solving Inverse Problems in Compressive Imaging with Score-Based Generative Models |
---|---|
Authors | |
Keywords | Compressive Imaging Computational Imaging Generative Models Inverse Problem Snapshot Compressive Imaging |
Issue Date | 9-Oct-2023 |
Publisher | IEEE |
Abstract | Snapshot Compressive Imaging (SCI) is a technique for capturing high-dimensional data through snapshot measurements using a two-dimensional (2D) detector. This approach is accomplished via coded aperture compressive temporal imaging (CACTI), which involves applying a temporally variant mask to spatially encode each sequential signal before aggregating the encoded information into a single compressed measurement. The objective of our work is to develop algorithms capable of reconstructing each video frame as a 3D data cube from its 2D measurement. To achieve this goal, we introduce multiple approaches that utilize unconditional and pre-trained 2D score models for video frame reconstruction. Our method involves modeling both the forward perturbation process of the data distribution and its reverse process as stochastic differential equations (SDEs). We also employ score-based deep learning models to estimate the scores of the data distribution across different time steps. Differing from many applications, our sampling process relies on the observed measurement, which directly corresponds to pixel values, rather than class labels. We demonstrate that employing traditional score-based generative methods with 2D score models in SCI, or integrating them into the plug-and-play framework as a deep generative prior, presents challenges. Furthermore, we propose ideas to address these limitations for future research. |
Persistent Identifier | http://hdl.handle.net/10722/339378 |
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Chong, Zhen Yuen | - |
dc.contributor.author | Zhao, Yaping | - |
dc.contributor.author | Wang, Zhongrui | - |
dc.contributor.author | Lam, Edmund Y | - |
dc.date.accessioned | 2024-03-11T10:36:07Z | - |
dc.date.available | 2024-03-11T10:36:07Z | - |
dc.date.issued | 2023-10-09 | - |
dc.identifier.uri | http://hdl.handle.net/10722/339378 | - |
dc.description.abstract | <p>Snapshot Compressive Imaging (SCI) is a technique for capturing high-dimensional data through snapshot measurements using a two-dimensional (2D) detector. This approach is accomplished via coded aperture compressive temporal imaging (CACTI), which involves applying a temporally variant mask to spatially encode each sequential signal before aggregating the encoded information into a single compressed measurement. The objective of our work is to develop algorithms capable of reconstructing each video frame as a 3D data cube from its 2D measurement. To achieve this goal, we introduce multiple approaches that utilize unconditional and pre-trained 2D score models for video frame reconstruction. Our method involves modeling both the forward perturbation process of the data distribution and its reverse process as stochastic differential equations (SDEs). We also employ score-based deep learning models to estimate the scores of the data distribution across different time steps. Differing from many applications, our sampling process relies on the observed measurement, which directly corresponds to pixel values, rather than class labels. We demonstrate that employing traditional score-based generative methods with 2D score models in SCI, or integrating them into the plug-and-play framework as a deep generative prior, presents challenges. Furthermore, we propose ideas to address these limitations for future research.<br></p> | - |
dc.language | eng | - |
dc.publisher | IEEE | - |
dc.relation.ispartof | 2023 IEEE 10th International Conference on Data Science and Advanced Analytics (DSAA) (09/10/2023-13/10/2023, , , Thessaloniki, Greece) | - |
dc.subject | Compressive Imaging | - |
dc.subject | Computational Imaging | - |
dc.subject | Generative Models | - |
dc.subject | Inverse Problem | - |
dc.subject | Snapshot Compressive Imaging | - |
dc.title | Solving Inverse Problems in Compressive Imaging with Score-Based Generative Models | - |
dc.type | Conference_Paper | - |
dc.identifier.doi | 10.1109/DSAA60987.2023.10302579 | - |
dc.identifier.scopus | eid_2-s2.0-85179011264 | - |