Introducing Time Travelling Pixels (TTP): A Novel Approach to High-Precision Change Detection in Remote Sensing

Change detection plays a crucial role in observing and analyzing surface transformations in remote sensing. While deep learning-based methods have advanced the field significantly, accurately detecting changes in complex spatio-temporal scenarios remains a challenge. To address this, researchers have turned to foundation models with their exceptional versatility and generalization capabilities. However, there is still a gap to be bridged in terms of data and tasks. In this paper, we propose Time Travelling Pixels (TTP), a groundbreaking approach that incorporates the latent knowledge of the SAM foundation model into change detection. This method effectively tackles the domain shift in knowledge transfer and overcomes the challenge of expressing both homogeneous and heterogeneous characteristics of multi-temporal images. The exceptional results achieved on the LEVIR-CD dataset testify to the effectiveness of TTP. You can access the code for TTP at this URL.

Abstract:Change detection, a prominent research area in remote sensing, is pivotal in observing and analyzing surface transformations. Despite significant advancements achieved through deep learning-based methods, executing high-precision change detection in spatio-temporally complex remote sensing scenarios still presents a substantial challenge. The recent emergence of foundation models, with their powerful universality and generalization capabilities, offers potential solutions. However, bridging the gap of data and tasks remains a significant obstacle. In this paper, we introduce Time Travelling Pixels (TTP), a novel approach that integrates the latent knowledge of the SAM foundation model into change detection. This method effectively addresses the domain shift in general knowledge transfer and the challenge of expressing homogeneous and heterogeneous characteristics of multi-temporal images. The state-of-the-art results obtained on the LEVIR-CD underscore the efficacy of the TTP. The Code is available at url{this https URL}.

Read the original article