Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology

Xu Qiang; Fan Hong; Dang XiaoHu

doi:doi:10.11648/j.sd.20170505.16

| Peer-Reviewed

Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology

Xu Qiang, Fan Hong, Dang XiaoHu

Published in Science Discovery (Volume 5, Issue 5)

Received: 7 August 2017 Accepted: Published: 7 August 2017

Views: Downloads:

Download PDF

Share This Article

Twitter
Linked In
Facebook

Abstract

It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.

Published in	Science Discovery (Volume 5, Issue 5)
DOI	10.11648/j.sd.20170505.16
Page(s)	331-339
Creative Commons	This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.
Copyright	Copyright © The Author(s), 2024. Published by Science Publishing Group

Keywords

Framework, Business Data, Multi-source, Universality

References

[1]	Gantz J, Reinsel D (2011) Extracting value from chaos. IDC iView, pp 1–12.
[2]	Min Chen, Shiwen Mao, Yunhao Liu. Big Data: A Survey[J]. Mobile Netw Appl, 2014, 19: 171–209.
[3]	Ahmed R, DeSmedt P, Kent W, et al. Pegasus: A system for seamless integration of heterogeneous information sources [C]. Compcon Spring'91. Digest of Papers. IEEE, 1991: 128-136.
[4]	Attaluri G K, Bradshaw D P, Coburn N, et al. The CORDS multidatabase project [J]. IBM Systems Journal, 1995, 34(1): 39-62.
[5]	Li L, kumar Nalluri A, Ai L. Space-Aware Data Integration for Ocean Observing Systems[J]. Procedia Environmental Sciences, 2011, 11: 285-290.
[6]	Belussi A, Migliorini S. A framework for integrating multi-accuracy spatial data in geographical applications[J]. GeoInformatica, 2012, 16(3): 523-561.
[7]	程海军，胡圣武，张子平．GIS数据格式集成方法的探讨[J]. 河南理工大学学报：自然科学版， 2006, 25(1): 37-41.
[8]	张文江．地质灾害数据集成关键技术研究[D]．成都：成都理工大学，2013。
[9]	Bansal S K. Towards a Semantic Extract-Transform-Load (ETL) Framework for Big Data Integration[C]. Big Data (BigData Congress), 2014 IEEE International Congress on. IEEE, 2014: 522-529.
[10]	卢一枝，陈军华．Deep Web 数据库集成技术的研究[J]．上海师范大学学报(自然科学版)，2016, 45(4): 422-427。
[11]	陈惠敏，胡飞虎，耿泽飞等．基于GIS的灾害应急管理系统业务数据和空间数据的集成[J]．自然灾害学报，2011, 20(1): 163-167。
[12]	董浩然，谢欢，陈鹏等．基于GIS主题爬虫的在线房产估价系统与优化[J]．地理信息世界．2016, 23(2), 107-112。
[13]	于一男，关佶红，周水庚等．GSPress：一个GML流压缩器[J]．小型微型计算机系统．2011, 32(3): 397-401。
[14]	崔玉洁，廖坤．借助八爪鱼采集器实现过刊网刊元数据的自动提取[J]．编辑学报．2016, 28(5), 485-487。
[15]	冯文娟．基于FME实现CAD到GIS数据格式转换研究及实例[J]．煤矿现代化．2015(3), 98-100。
[16]	郑江，闫世浩，陈宝枝等．基于DWGdirect.NET与Arcgis Engine的CAD地形图转换[J]．测绘与空间地理信息．2015, 38(2), 176-178。
[17]	李伙友，吴善和．DWG与SHP数据格式互转换方法研究[J]．集美大学学报 (自然科学版). 2015, 20(1), 76-80。
[18]	于艳超，许捍卫，杜婵娟．基于DWGDirect的CAD到GIS数据转换研究[J]．地理空间信息．2015, 13(1), 84-86。
[19]	myfme的博客．用MyFME扩展你的ArcGIS应用[EB/OL]. http://blog.sina.com.cn/s/blog_7cfdb4de0100uyw1.html. 2011-10-13。

Cite This Article

Plain Text BibTeX RIS

APA Style

Xu Qiang, Fan Hong, Dang XiaoHu. (2017). Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Science Discovery, 5(5), 331-339. https://doi.org/10.11648/j.sd.20170505.16

Copy | Download

ACS Style

Xu Qiang; Fan Hong; Dang XiaoHu. Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Sci. Discov. 2017, 5(5), 331-339. doi: 10.11648/j.sd.20170505.16

Copy | Download

AMA Style

Xu Qiang, Fan Hong, Dang XiaoHu. Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Sci Discov. 2017;5(5):331-339. doi: 10.11648/j.sd.20170505.16

Copy | Download

@article{10.11648/j.sd.20170505.16,
  author = {Xu Qiang and Fan Hong and Dang XiaoHu},
  title = {Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology},
  journal = {Science Discovery},
  volume = {5},
  number = {5},
  pages = {331-339},
  doi = {10.11648/j.sd.20170505.16},
  url = {https://doi.org/10.11648/j.sd.20170505.16},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.sd.20170505.16},
  abstract = {It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.},
 year = {2017}
}

Copy | Download

TY  - JOUR
T1  - Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology
AU  - Xu Qiang
AU  - Fan Hong
AU  - Dang XiaoHu
Y1  - 2017/08/07
PY  - 2017
N1  - https://doi.org/10.11648/j.sd.20170505.16
DO  - 10.11648/j.sd.20170505.16
T2  - Science Discovery
JF  - Science Discovery
JO  - Science Discovery
SP  - 331
EP  - 339
PB  - Science Publishing Group
SN  - 2331-0650
UR  - https://doi.org/10.11648/j.sd.20170505.16
AB  - It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.
VL  - 5
IS  - 5
ER  -

Copy | Download

Author Information

Xu Qiang

College of Computer Science, Shaanxi Normal University, Xi’an, China
Fan Hong

College of Computer Science, Shaanxi Normal University, Xi’an, China
Dang XiaoHu

College of Computer Science, Shaanxi Normal University, Xi’an, China

Download PDF

Sections

Plain Text BibTeX RIS

APA Style

Xu Qiang, Fan Hong, Dang XiaoHu. (2017). Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Science Discovery, 5(5), 331-339. https://doi.org/10.11648/j.sd.20170505.16

Copy | Download

ACS Style

Xu Qiang; Fan Hong; Dang XiaoHu. Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Sci. Discov. 2017, 5(5), 331-339. doi: 10.11648/j.sd.20170505.16

Copy | Download

AMA Style

Xu Qiang, Fan Hong, Dang XiaoHu. Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology. Sci Discov. 2017;5(5):331-339. doi: 10.11648/j.sd.20170505.16

Copy | Download

@article{10.11648/j.sd.20170505.16,
  author = {Xu Qiang and Fan Hong and Dang XiaoHu},
  title = {Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology},
  journal = {Science Discovery},
  volume = {5},
  number = {5},
  pages = {331-339},
  doi = {10.11648/j.sd.20170505.16},
  url = {https://doi.org/10.11648/j.sd.20170505.16},
  eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.sd.20170505.16},
  abstract = {It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.},
 year = {2017}
}

Copy | Download

TY  - JOUR
T1  - Research on Universal Processing Framework of Multi-source Heterogeneous Data Integration in GIS Domain Based on Software Technology
AU  - Xu Qiang
AU  - Fan Hong
AU  - Dang XiaoHu
Y1  - 2017/08/07
PY  - 2017
N1  - https://doi.org/10.11648/j.sd.20170505.16
DO  - 10.11648/j.sd.20170505.16
T2  - Science Discovery
JF  - Science Discovery
JO  - Science Discovery
SP  - 331
EP  - 339
PB  - Science Publishing Group
SN  - 2331-0650
UR  - https://doi.org/10.11648/j.sd.20170505.16
AB  - It is difficult to make fine-grained random call in GIS system development or data processing owing to the multi-source heterogeneity of spatial data. Moreover, to convert the data into a unified format easily can lead to the loss of the core attributes. In this paper, we discuss the translation methods among several different data formats, including attribute and business data , network data, CAD data, heterogeneous GIS spatial data, and domestic and foreign GIS data, etc, based on software technology like FME, MyFME, Arcgis, MessagePack package, crawling tools and so on. Then, we propose a universal processing framework for multi-source heterogeneous data integration in the GIS field, and verify the performance of the proposed framework through integrating several kinds of data.
VL  - 5
IS  - 5
ER  -

Copy | Download