PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances in the Arctic


Contact
ingmar.nitze [ at ] awi.de

Abstract

Arctic permafrost is facing significant changes due to global climate change. As these regions are largely inaccessible, remote sensing plays a crucial rule in better understanding the underlying processes across the Arctic. In this study, we focus on the remote detection of retrogressive thaw slumps (RTSs), a permafrost disturbance comparable to slow landslides. For such remote sensing tasks, deep learning has become an indispensable tool, but limited labeled training data remains a challenge for training accurate models. We present PixelDINO, a semi-supervised learning approach, to improve model generalization across the Arctic with a limited number of labels. PixelDINO leverages unlabeled data by training the model to define its own segmentation categories (pseudoclasses), promoting consistent structural learning across strong data augmentations. This allows the model to extract structural information from unlabeled data, supplementing the learning from labeled data. PixelDINO surpasses both supervised baselines and existing semi-supervised methods, achieving average intersection-over-union (IoU) of 30.2 and 39.5 on the two evaluation sets, representing significant improvements of 13% and 21%, respectively, over the strongest existing models. This highlights the potential for training robust models that generalize well to regions that were not included in the training data.



Item Type
Article
Authors
Divisions
Primary Division
Programs
Primary Topic
Helmholtz Cross Cutting Activity (2021-2027)
Publication Status
Published
Eprint ID
59635
DOI 10.1109/tgrs.2024.3448294

Cite as
Heidler, K. , Nitze, I. , Grosse, G. and Zhu, X. X. (2024): PixelDINO: Semi-Supervised Semantic Segmentation for Detecting Permafrost Disturbances in the Arctic , IEEE Transactions on Geoscience and Remote Sensing, 62 , pp. 1-12 . doi: 10.1109/tgrs.2024.3448294


Download
[thumbnail of PixelDINO_Semi-Supervised_Semantic_Segmentation_for_Detecting_Permafrost_Disturbances_in_the_Arctic.pdf]
Preview
PDF
PixelDINO_Semi-Supervised_Semantic_Segmentation_for_Detecting_Permafrost_Disturbances_in_the_Arctic.pdf - Other

Download (2MB) | Preview

Share
Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Citation


Actions
Edit Item Edit Item