Hybrid U-Net: Semantic Segmentation of High-Resolution Satellite Images to Detect War Destruction

Authors

Shima Nabiee, University of California, Irvine
Matthew Harding, University of California, Irvine
Jonathan Hersh, Chapman UniversityFollow
Nader Bagherzadeh, University of California, Irvine

Document Type

Article

Publication Date

7-9-2022

Abstract

Destruction caused by violent conflicts play a big role in understanding the dynamics and consequences of conflicts, which is now the focus of a large body of ongoing literature in economics and political science. However, existing data on conflict largely come from news or eyewitness reports, which makes it incomplete, potentially unreliable, and biased for ongoing conflicts. Using satellite images and deep learning techniques, we can automatically extract objective information on violent events. To automate this process, we created a dataset of high-resolution satellite images of Syria and manually annotated the destroyed areas pixel-wise. Then, we used this dataset to train and test semantic segmentation networks to detect building damage of various size. We specifically utilized a U-Net model for this task due to its promising performance on small and imbalanced datasets. However, the raw U-Net architecture does not fully exploit multi-scale feature maps, which are among the important factors for generating fine-grained segmentation maps, especially for high-resolution images. To address this deficiency, we propose a multi-scale feature fusion approach and design a multi-scale skip-connected Hybrid U-Net for segmenting high-resolution satellite images. In our experiments, U-Net and its variants demonstrated promising segmentation results to detect various war-related building destruction. In addition, Hybrid U-Net resulted in significant improvement in segmentation performance compared to U-Net and other baselines. In particular, the mean intersection over union and mean dice score improved by 7.05% and 8.09%, respectively, compared to those in the raw U-Net.

Comments

This article was originally published in Machine Learning with Applications, volume 9, in 2022. https://doi.org/10.1016/j.mlwa.2022.100381

Recommended Citation

Nabiee, S., Harding, M., Hersh, J., & Bagherzadeh, N. (2022). Hybrid U-Net: Semantic segmentation of high-resolution satellite images to detect war destruction. Machine Learning with Applications, 9, 100381. https://doi.org/10.1016/j.mlwa.2022.100381

Peer Reviewed

1

Copyright

The authors

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 License.