Construction and Management of Astronomical Big Data Analysis and Multi-dimensional Information Visualization Platform
American Journal of Information Science and Technology
Volume 4, Issue 2, June 2020, Pages: 30-40
Received: Mar. 10, 2020;
Accepted: Apr. 9, 2020;
Published: Apr. 29, 2020
Views 329 Downloads 107
Yang Zherui, Information Technology Center, Purple Mountain Observatory, Chinese Academy of Sciences, Nanjing, China
Gao Na, Information Technology Center, Purple Mountain Observatory, Chinese Academy of Sciences, Nanjing, China
Liu Liang, Information Technology Center, Purple Mountain Observatory, Chinese Academy of Sciences, Nanjing, China
Follow on us
The development of modern astronomy is rapidly and astronomical data increases exponentially. The HPC architecture based on GPU provides an efficient way of astronomic big data computing. Based on secure Ipv6 network environment, PMO has constructed the Big Data Analysis and Multi-dimensional Information Visualization Platform, which can reach the peak computing speed of 352Tflops and the totally storage capacity of 288TB. The platform is composed of 25 computing nodes, one management node and 5 storage nodes. The use of user-friendly, centralized cluster management software, the deployment of proprietary environmental control settings and multi-dimensional visualization of safety management systems form a multi-level, tridimensional and efficient management structure. A high-speed, high-capacity, highly reliable, secure and efficient high-performance computing cluster is finally constructed. The platform has a fully redundant, self-healing, highly scalable distributed storage system, a high-performance InfiniBand parallel computing and storage network, a complete job scheduling system, a cuda parallel computing architecture, and a variety of physical software tools for astronomical applications. It offers a great help to astronomical research topics such as astronomical image processing, moving target extraction, space target orbit calculation, numerical cosmology, cosmology simulation, galaxy fluid simulation. Thus it provides an important information support for the research work of 3 major breakthroughs and 5 key cultivation directions in the "One Three Five" plan of Purple Mountain Observatory.
HPC, GPU, Cluster, Parallel Storage, Portal Batch System
To cite this article
Construction and Management of Astronomical Big Data Analysis and Multi-dimensional Information Visualization Platform, American Journal of Information Science and Technology.
Vol. 4, No. 2,
2020, pp. 30-40.
Copyright © 2020 Authors retain the copyright of this article.
This article is an open access article distributed under the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/
) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
Zhou X. Development of high performance computing technology [J]. Journal of Nature, 2011, 33 (5): 249-254.
Guo J, Cai W. A new generation of high energy computing technology—introduction of CUDA [J]. Modern Science and Technology, 2009, 8 (6): 58-62.
Zheng Y, Gao N, Liu L. Astronomical scientific applications based on GPU supercomputing system. [J] E-science Technology & Application, 2011 Vol. 2 (6): 144-152.
Dong Y, Zhou E, Chen J. Construction of high performance distributed file system based on InfiniBand technology- Lustre [J]. Computer Engineering and Applications. 2005 (22): 103-108.
Liu Y, Zhou J, Xie K, Zhao Y. High performance computing platform of electric system based on cluster technology [J]. Computer Simulation, 2005, 22 (2): 239-243.
Huang K, Xu Z. Lu X et al. Extensible parallel computing technology, architecture, and programming [M]. Beijing: China Machine Press, 2000.
Sugon. Sugon 5000A high performance computer product sample, 2008.
Wang J. Infrastructure Construction and Management of Computer Rooms in Shanghai Supercomputer Center [J]. Building Electric, 2011 (9): 69-72.
Huang P. H., Dong R. B., Li H. et. al., The Observability of Vortex-driven Spiral Arms in Protoplanetary Disks: Basic Spiral Properties, ApJL, 2019, 883: L39.
Jiang Haoxuan, Yu Liangliang, and Ji Jianghui, Revisiting the Advanced Thermal Physical Model: New Perspectives on Thermophysical Characteristics of (341843) 2008 EV5 from Four-band WISE Data with the Sunlightreflection Model, AJ, 2019, 158: 205.
Tao Cai*, Upward Overshooting in Turbulent Compressible Convection. III. Calibrate Parameters for one-dimensional Reynolds Stress Model. The Astrophysical Journal, 891, 77, 2020.
Wang H. Characterization Method of Free Vibration Mode Phase Difference of Ring Primary Mirror: CN, 201910174229. X. 2019-06-25.
Yilong Zhang (*), Yuan Ren, Wei Miao, Zhenhui Lin, Hao Gao, Shengcai Shi, Microwave SAIR Imaging Approach Based on Deep Convolutional Neural Network, IEEE Trans. Geosci. Remote Sens., 2019.8.28, 57 (12): 10376-10389.
Yilong Zhang (*), Yuan Ren, Wei Miao, Hao Gao, Shengcai Shi, A Terahertz Superconducting Single-Pixel Imaging System Using DMD, 44th International Conference on Infrared, Millimeter, and Terahertz Waves (IRMMW-THz), 1-6 Sept. 2019, Paris, France.
Dark matter particle detection satellite "WuKong" obtains the most accurate high-energy electron cosmic ray energy spectrum up to now [J]. Bulletin of Chinese Academy of Sciences, 2017, 32 (12): 1265.
Chang J. Indirect Detection of Dark Matter Particles in Space [J]. Aerospace Shanghai, 2019, 36 (04): 1-8.
Purple Mountain Observatory 1-meter Near-Earth Object Survey Telescope + 4k × 4kCCD Trial Observation Success [J]. Mechanical Engineer, 2006 (12): 16.