The Rise of Big Data and Cloud Computing
Internet of Things and Cloud Computing
Volume 7, Issue 2, June 2019, Pages: 45-53
Received: Aug. 19, 2019; Accepted: Sep. 4, 2019; Published: Sep. 19, 2019
Views 207      Downloads 84
Authors
Mohaiminul Islam, School of Intelligent Technology and Engineering, Chongqing University of Science and Technology, Chongqing, China
Shamim Reza, Department of Information and Communication Technology, Mawlana Bhasani Science and Technology University, Tangail, Bangladesh
Article Tools
Follow on us
Abstract
Big Data has emerged in the past few years as a new paradigm providing abundant data and opportunities to improve and/or enable research and decision-support applications with unprecedented value for digital earth applications including business, sciences and engineering. At the same time, Big Data presents challenges for digital earth to store, transport, process, mine and serve the data. Cloud computing provides fundamental support to address the challenges with shared computing resources including computing, storage, networking and analytical software; the application of these resources has fostered impressive Big Data advancements. This paper surveys the two frontiers – Big Data and cloud computing – and reviews the advantages and consequences of utilizing cloud computing to tackling Big Data in the digital earth and relevant science domains. While Big Data is responsible for data storage and processing, the cloud provides a reliable, accessible, and scalable environment for Big Data systems to function. Big Data is defined as the quantity of digital data produced from different sources of technology, for example, sensors, digitizers, scanners, numerical modeling, mobile phones, Internet, videos, social networks. Cloud Computing and Big Data are complementary to each other. Rapid growth in Big Data is regarded as a problem. Clouds are evolving and providing solutions for the appropriate environment of Big Data while traditional storage cannot meet the requirements for dealing with Big Data, in addition to the need for data exchange between various distributed storage locations. Cloud Computing provides solutions and addresses problems with Big Data. Big data and Cloud computing both the technologies are valuable on its own. Furthermore, many businesses are targeting to combine the two techniques to reap more business benefits. Both the technologies aim to enhance the revenue of the company while reducing the investment cost. While Cloud manages the local software, Big data helps in business decisions. In paper introduces the relationship between Big Data and Cloud Computing, Cloud Computing role of Big Data, advantages of Big Data and Cloud computing, cloud architecture, importance of Cloud Computing.
Keywords
Big Data, Cloud Computing, Hadoop, Analytics, NoSQL
To cite this article
Mohaiminul Islam, Shamim Reza, The Rise of Big Data and Cloud Computing, Internet of Things and Cloud Computing. Vol. 7, No. 2, 2019, pp. 45-53. doi: 10.11648/j.iotcc.20190702.12
Copyright
Copyright © 2019 Authors retain the copyright of this article.
This article is an open access article distributed under the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
References
[1]
Villars, R. L., Olofson, C. W., & Eastwood, M (June, 2011). Big data: What it is and why you should care. IDC White Paper. Framingham, MA: IDC.
[2]
Shakil, K. A.; Sethi, S.; Alam, M., (2015). An effective framework for managing university data using a cloud based environment, Computing for Sustainable Global Development (INDIACom), 2nd International Conference on, vol., no., pp. 1262, 1266, 11-13.
[3]
K. Das and P. M. Kumar, Big data analytics: A framework forum structured data analysis, International Journal of Engineering and Technology, 5 (1) (2013), pp. 153-156.
[4]
T. K. Das, D. P. Acharjya and M. R. Patra, Opinion mining about aproduct by analyzing public tweets in twitter, International Conference on Computer Communication and Informatics, 2014.
[5]
M. K. Kakhani, S. Kakhani and S. R. Biradar, Research issues in bigdata analytics, International Journal of Application or Innovation in Engineering & Management, 2 (8) (2015), pp. 228-232.
[6]
A. Gandomi and M. Haider, Beyond the hype: Big data concepts, meth-ods, and analytics, International Journal of Information Management, 35 (2) (2015), pp. 137-144.
[7]
C. Lynch, Big data: How do your data grow?, Nature, 455 (2008), pp. 28-29.
[8]
X. Jin, B. W. Wah, X. Cheng and Y. Wang, Significance and challenges of big data research, Big Data Research, 2 (2) (2015), pp. 59-64.
[9]
R. Kitchin, Big Data, new epistemologies and paradigm shifts, Big Data Society, 1 (1) (2014), pp. 1-12.
[10]
C. L. Philip, Q. Chen and C. Y. Zhang, Data-intensive applications, challenges, techniques and technologies: A survey on big data, Infor-mation Sciences, 275 (2014), pp. 314-347.
[11]
K. Kambatla, G. Kollias, V. Kumar and A. Gram, Trends in big data analytics, Journal of Parallel and Distributed Computing, 74 (7) (2014), pp. 2561-2573.
[12]
S. Del. Rio, V. Lopez, J. M. Bentez and F. Herrera, On the use of mapreduce for imbalanced big data using random forest, Information Sciences, 285 (2014), pp. 112-137.
[13]
MH. Kuo, T. Sahama, A. W. Kushniruk, E. M. Borycki and D. K. Grunwell, Health big data analytics: current perspectives, challenges and potential solutions, International Journal of Big Data Intelligence, 1 (2014), pp. 114-126.
[14]
R. Nambiar, A. Sethi, R. Bhardwaj and R. Vargheese, A look at challenges and opportunities of big data analytics in healthcare, IEEE International Conference on Big Data, 2013, pp. 17-22.
[15]
Z. Huang, A fast clustering algorithm to cluster very large categorical data sets in data mining, SIGMOD Workshop on Research Issues on Data Mining and Knowledge Discovery, 1997.
[16]
Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A Distributed Storage System for Structured Data. In OSDI, pages 205–218, 2006.
[17]
Rajeev Gupta, Himanshu Gupta, and Mukesh Mohania, "Cloud Computing and Big Data Analytics: What Is New from Databases Perspective?". S. Srinivasa and V. Bhatnagar (Eds.): BDA 2012, LNCS 7678, pp. Springer-Verlag Berlin Heidelberg 42–61, 2012.
[18]
Curino, C., Jones, E. P. C., Popa, R. A., Malviya, N., Wu, E., Madden, S., Balakrishnan, H., Zeldovich, N.: Realtional Cloud: A Database-as-a-Service for the Cloud. In: Proceedings of Conference on Innovative Data Systems Research, CIDR- 2011.
[19]
Alberto Ferandez, Sara del R, Victoria opez, Abdullah Bawakid, Maria J. del Jesus, Jose M. Benitez, and Francisco Herrera. "Big Data with Cloud Computing: an insight on the computing environment, Map Reduce, and programming frameworks". doi: 10.1002/widm.1134. WIREs Data Mining Knowl Discov, 4:380–409, 2014.
[20]
Lu, Huang, Ting-tin Hu, and Hai-shan Chen. "Research on Hadoop Cloud Computing Model and its Applications". Hangzhou, China: 2012, pp. 59 – 63, 21-24 Oct. 2012.
[21]
Wie, Jiang, Ravi V. T, and Agrawal G. "A Map-Reduce System with an Alternate API for Multi-core Environments.". Melbourne, VIC: 2010, pp. 84-93, 17-20 May. 2010.
[22]
K, Chitharanjan, and Kala Karun A. "A review on hadoop - HDFS infrastructure exten-sions.". JeJu Island: 2013, pp. 132-137, 11-12 Apr. 2013.
[23]
F. C. P, Muhtaroglu, Demir S, Obali M, and Girgin C. "Business model canvas perspective on big data applications." Big Data, 2013 IEEE International Conference, Silicon Valley, CA, Oct 6-9, p. 32 – 37, 2013.
[24]
Castelino, C., Gandhi, D., Narula, H. G., & Chokshi, N. H. (2014). Integration of Big Data and Cloud Computing. International Journal of Engineering Trends and Technology (IJETT), 100-102.
[25]
Chandrashekar, R., Kala, M., & Mane, D. (2015). Integration of Big Data in Cloud compu-ting environments for enhanced data processing capabilities. International Journal of Engineering Research and General Science, 240- 245.
[26]
James Kobielus, I., & Bob Marcus, E. S. (2014). Deploying Big Data Analytics Applica-tions to the Cloud: Roadmap for Success. Cloud Standards Customer Council.
[27]
M. Herland, T. M. Khoshgoftaar and R. Wald, A review of data mining using big data in health informatics, Journal of Big Data, 1 (2) (2014), pp. 1-35.
[28]
X. Y. Chen and Z. G. Jin, Research on key technology and applicationsfor internet of things, Physics Procedia, 33, (2012), pp. 561-566.
[29]
N. Mishra, C. Lin and H. Chang, A cognitive adopted frameworkfor iot big data management and knowledge discovery prospective, International Journal of Distributed Sensor Networks, 2015, (2015), pp. 1-13.
[30]
Z. Hongjun, H. Wenning, H. Dengchao and M. Yuxing, Survey of research on information security in big data, Congresso da sociedada Brasileira de Computacao, 2014, pp. 1-6.
ADDRESS
Science Publishing Group
1 Rockefeller Plaza,
10th and 11th Floors,
New York, NY 10020
U.S.A.
Tel: (001)347-983-5186