Skip to main content
SHARE
Publication

Conflation of Geospatial POI Data and Ground-level Imagery via Link Prediction on Joint Semantic Graph...

by Rutuja R Gurav, Debraj De, Gautam Thakur, Junchuan Fan
Publication Type
Conference Paper
Journal Name
ACM GeoAI Workshop
Book Title
GEOAI '21: Proceedings of the 4th ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery
Publication Date
Page Numbers
5 to 8
Publisher Location
New York, United States of America
Conference Name
The 4th ACM SIGSPATIAL International Workshop on AI for Geographic Knowledge Discovery (GEOAI '21)
Conference Location
Online / Beijing, China, China
Conference Sponsor
ACM
Conference Date
-

With the proliferation of smartphone cameras and social networks, we have rich, multi-modal data about points of interest (POIs) - like cultural landmarks, institutions, businesses, etc. - within a given areas of interest (AOI) (e.g., a county, city or a neighborhood) available to us. Data conflation across multiple modalities of data sources is one of the key challenges in maintaining a geographical information system (GIS) which accumulate data about POIs. Given POI data from nine different sources, and ground-level geo-tagged and scene-captioned images from two different image hosting platforms, in this work we explore the application of graph neural networks (GNNs) to perform data conflation, while leveraging a natural graph structure evident in geospatial data. The preliminary results demonstrate the capacity of a GNN operation to learn distributions of entity (POIs and images) features, coupled with topological structure of entity's local neighborhood in a semantic nearest neighbor graph, in order to predict links between a pair of entities.