Deep Learning Methods Toward Generalized Change Detection on Planetary Surfaces with Convolutional Autoencoders and Transfer Learning

‘Ongoing planetary exploration missions are return- ing large volumes of image data. Identifying surface changes in these images, e.g., new impact craters, is critical for investigating many scientific hypotheses. Traditional approaches to change detection rely on image differencing and manual feature engineering. These methods can be sensitive to irrelevant variations in illumination or image quality and typically require before and after images to be co-registered, which itself is a major challenge. Additionally, most prior change detection studies have been limited to remote sensing images of Earth. We propose a new deep learning approach for binary patch-level change detection involving transfer learning and nonlinear dimensionality reduction using convolutional autoencoders. Our experiments on diverse remote sensing datasets of Mars, the Moon, and Earth show that our methods can detect meaningful changes with high accuracy using a relatively small training dataset despite significant differences in illumination, image quality, imaging sensors, co-registration, and surface properties. We show that the latent representations learned by a convolutional autoencoder yield the most general representations for detecting change across surface feature types, scales, sensors, and planetary bodies.

Download paper here

Recommended citation: Kerner, H. R., Wagstaff, K. L., Bue, B., Gray, P. C., Bell III, J. F., Ben Amor, H. (2019). "Deep Learning Methods Toward Generalized Change Detection on Planetary Surfaces with Convolutional Autoencoders and Transfer Learning." Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 12(10), 3900-3918, doi:10.1109/JSTARS.2019.2936771.