TopDiG: Class-agnostic Topological Directional Graph Extraction from Remote Sensing Images

Bingnan Yang 1 , Mi Zhang 1 , Zhan Zhang 2 , Zhili Zhang 1 , Xiangyun Hu 1
1 School of Remote Sensing and Information Engineering, Wuhan University, China
2 State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, China
Corresponding author { mizhang@whu.edu.cn }

TopDiG can extract vector topology of both line- and polygon-shape objects

Abstract

Rapid development in automatic vector extraction from remote sensing images has been witnessed in recent years.
However, the vast majority of existing works concentrate on a specific target, fragile to category variety, and hardly achieve stable performance crossing different categories. In this work, we propose an innovative class-agnostic model, namely TopDiG, to directly extract topological directional graphs from remote sensing images and solve these issues.
Firstly, TopDiG employs a topology-concentrated node detector (TCND) to detect nodes and obtain compact perception of topological components. Secondly, we propose a dynamic graph supervision (DGS) strategy to dynamically generate adjacency graph labels from unordered nodes.
Finally, the directional graph (DiG) generator module is designed to construct topological directional graphs from predicted nodes. Experiments on the Inria, CrowdAI,GID, GF2 and Massachusetts datasets empirically demonstrate that TopDiG is class-agnostic and achieves competitive performance on all datasets.

Video Introduction

Challenges:

• Most existing vector extraction works focus on a specific target and are fragile to category variety;

• Especially Line- and polygon-shape objects are very different in topological structure.


Contributions:

• We propose an innovative class-agnostic model TopDiG,to directly extract topological directional graphs from remote sensing images regardless of target types.

• We design topology-concentrated node detector to extract nodes and corresponding features for both line-and polygon-shape targets.

• We conduct dynamic graph supervision strategy to facilitate inference in practice .


TopDiG can extract vector topology of both line- and polygon-shape objects


TopDiG formulates diverse vector topological structures as directional graphs and works by sequentially predicting target nodes and their connections.



Topology-Concentrated Node detector(TCND):

• In satellite and aerial images, line shape objects can be seen as edges

• TCND minimizes sematic contexts and concentrates on low-level geometric features to achieve category independency.

Visual comparison of attentive maps for a few methods

Dynamic Graph Supervision(DGS):

• Dynamically generates adjacency matrix labels according to real-time unordered predict nodes in each training.

Visual comparison of the adjacency matrix label generation by previous works and DGS

Visual comparison:

• TopDiG performs better in topology quality and completeness, especially in concave/hierarchical polygon contours and parallel/crossing line object centerlines.

Quantitative comparison:

• TopDiG obtains competitive scores in pixel-wise metrics

• TopDiG achieve state-of-the-art performance in topology-wise metrics