标题: A news picture geo-localization pipeline based on deep learning and street view images

作者: Chu, TY (Chu, Tianyou); Chen, YM (Chen, Yumin); Su, H (Su, Heng); Xu, ZZ (Xu, Zhenzhen); Chen, GD (Chen, Guodong); Zhou, AN (Zhou, Annan)

来源出版物: INTERNATIONAL JOURNAL OF DIGITAL EARTH 卷: 15 期: 1 页: 1485-1505 DOI: 10.1080/17538947.2022.2121437 出版年: DEC 31 2022

摘要: Numerous news or event pictures are taken and shared on the internet every day that have abundant information worth being mined, but only a small fraction of them are geotagged. The visual content of the news image hints at clues of the geographical location because they are usually taken at the site of the incident, which provides a prerequisite for geo-localization. This paper proposes an automated pipeline based on deep learning for the geo-localization of news pictures in a large-scale urban environment using geotagged street view images as a reference dataset. The approach obtains location information by constructing an attention-based feature extraction network. Then, the image features are aggregated, and the candidate street view image results are retrieved by the selective matching kernel function. Finally, the coordinates of the news images are estimated by the kernel density prediction method. The pipeline is tested in the news pictures in Hong Kong. In the comparison experiments, the proposed pipeline shows stable performance and generalizability in the large-scale urban environment. In addition, the performance analysis of components in the pipeline shows the ability to recognize localization features of partial areas in pictures and the effectiveness of the proposed solution in news picture geo-localization.

作者关键词: Street view images; geo-localization; image retrieval; social media

KeyWords Plus: VISUAL PLACE RECOGNITION; GEOGRAPHICAL DISPARITIES; KERNELS

地址: [Chu, Tianyou; Chen, Yumin; Su, Heng; Xu, Zhenzhen; Chen, Guodong; Zhou, Annan] Wuhan Univ, Sch Resource & Environm Sci, 129 Luoyu Rd, Wuhan, Peoples R China.

通讯作者地址: Chen, YM (通讯作者)，Wuhan Univ, Sch Resource & Environm Sci, 129 Luoyu Rd, Wuhan, Peoples R China.

电子邮件地址: ymchen@whu.edu.cn

影响因子：4.606