Presenter Information

Ian Vyse, University of Toronto Aerospace TeamFollow
Rishit Dagli, University of Toronto Aerospace Team
Dav Vrat Chadha, University of Toronto Aerospace Team
John P. Ma, University of Toronto Aerospace Team
Hector Chen, University of Toronto Aerospace Team
Isha Ruparelia, University of Toronto Aerospace Team
Prithvi Seran, University of Toronto Aerospace Team
Matthew Xie, University of Toronto Aerospace Team
Eesa Aamer, University of Toronto Aerospace Team
Aidan Armstrong, University of Toronto Aerospace Team
Naveen Black, University of Toronto Aerospace Team
Ben Borstein, University of Toronto Aerospace Team
Kevin Caldwell, University of Toronto Aerospace Team
Orrin Dahanaggamaarachchi, University of Toronto Aerospace Team
Joe Dai, University of Toronto Aerospace Team
Abeer Fatima, University of Toronto Aerospace Team
Stephanie Lu, University of Toronto Aerospace Team
Maxime Michet, University of Toronto Aerospace Team
Anoushka Paul, University of Toronto Aerospace Team
Carrie Ann Po, University of Toronto Aerospace Team
Shivesh Prakash, University of Toronto Aerospace Team
Noa Prosser, University of Toronto Aerospace Team
Riddhiman Roy, University of Toronto Aerospace Team
Mirai Shinjo, University of Toronto Aerospace Team
Iliya Shofman, University of Toronto Aerospace Team
Coby Silayan, University of Toronto Aerospace Team
Reid Sox-Harris, University of Toronto Aerospace Team
Shuhan Zheng, University of Toronto Aerospace Team
Khang Nguyen, University of Toronto Aerospace Team

Session

Session X: Ground Systems

Location

Utah State University, Logan, UT

Abstract

Satellite remote sensing missions have gained popularity over the past fifteen years due to their ability to cover large swaths of land at regular intervals, making them ideal for monitoring environmental trends. The FINCH mission, a 3U+ CubeSat equipped with a hyperspectral camera, aims to monitor crop residue cover in agricultural fields. Although hyperspectral imaging captures both spectral and spatial information, it is prone to various types of noise, including random noise, stripe noise, and dead pixels. Effective denoising of these images is crucial for downstream scientific tasks. Traditional methods, including hand-crafted techniques encoding strong priors, learned 2D image denoising methods applied across different hyperspectral bands, or diffusion generative models applied independently on bands, often struggle with varying noise strengths across spectral bands, leading to significant spectral distortion. This paper presents a novel approach to hyperspectral image denoising using latent diffusion models that integrate spatial and spectral information. We particularly do so by building a 3D diffusion model and presenting a 3-stage training approach on real and synthetically crafted datasets. The proposed method preserves image structure while reducing noise. Evaluations on both popular hyperspectral denoising datasets and synthetically crafted datasets for the FINCH mission demonstrate the effectiveness of this approach.

Our code can be found at github.com/utat-ss/FINCH-destriping

Available for download on Friday, August 02, 2024

Share

COinS
 
Aug 8th, 8:45 AM

Beyond the Visible: Jointly Attending to Spectral and Spatial Dimensions with HSI-Diffusion for the FINCH Spacecraft

Utah State University, Logan, UT

Satellite remote sensing missions have gained popularity over the past fifteen years due to their ability to cover large swaths of land at regular intervals, making them ideal for monitoring environmental trends. The FINCH mission, a 3U+ CubeSat equipped with a hyperspectral camera, aims to monitor crop residue cover in agricultural fields. Although hyperspectral imaging captures both spectral and spatial information, it is prone to various types of noise, including random noise, stripe noise, and dead pixels. Effective denoising of these images is crucial for downstream scientific tasks. Traditional methods, including hand-crafted techniques encoding strong priors, learned 2D image denoising methods applied across different hyperspectral bands, or diffusion generative models applied independently on bands, often struggle with varying noise strengths across spectral bands, leading to significant spectral distortion. This paper presents a novel approach to hyperspectral image denoising using latent diffusion models that integrate spatial and spectral information. We particularly do so by building a 3D diffusion model and presenting a 3-stage training approach on real and synthetically crafted datasets. The proposed method preserves image structure while reducing noise. Evaluations on both popular hyperspectral denoising datasets and synthetically crafted datasets for the FINCH mission demonstrate the effectiveness of this approach.

Our code can be found at github.com/utat-ss/FINCH-destriping