International Journal of Information and Communication Sciences
Volume 4, Issue 4, December 2019, Pages: 59-67
Received: Oct. 16, 2019;
Accepted: Nov. 13, 2019;
Published: Nov. 22, 2019
Views 589 Downloads 154
Linh Manh Pham, Faculty of Information Technology, VNU University of Engineering and Technology, Vietnam National University, Hanoi, Vietnam
Truong-Thang Nguyen, Institute of Information Technology, Vietnam Academy of Science and Technology, Hanoi, Vietnam
Manh-Dong Tran, Institute of Information Technology, Vietnam Academy of Science and Technology, Hanoi, Vietnam
Cloud computing is an evolution in IT consumption and delivery which makes available self-management on the Internet with a flexible, pay-as-you-go business model. Within the context of Internet of Things, the MQTT (Message Queuing Telemetry Transport) protocol that is implemented broadly by the applications of “Publish-Subscribe” paradigm has a vital role. However, MQTT brokers are saturated easily if they have to cope with huge and speedy data generated by IoT “chatty” devices. With capability of provisioning/deprovisioning granular virtual resources, Cloud computing empowered MQTT brokers by enabling its elasticity feature. Elasticity helps the brokers deal with a very large variety of data integrated into the IoT every single day. However, there was lack of sturdy benchmarking tools that judge all the aspects of MQTT brokers in order to advocate correct elastic decision-making. This article focuses on the work of benchmarking MQTT by introducing a new developed tool called MQTTBrokerBench. With this tool, users not only can benchmark MQTT brokers but also can specify saturation points where the IoT load makes the brokers be saturated. Those saturation points can be used to set thresholds for elastic decision-making. Furthermore, the article also demonstrates the results acquired by this tool through the experiments on Windows Azure Cloud Platform.
Linh Manh Pham,
A Benchmarking Tool for Elastic MQTT Brokers in IoT Applications, International Journal of Information and Communication Sciences.
Vol. 4, No. 4,
2019, pp. 59-67.
Copyright © 2019 Authors retain the copyright of this article.
This article is an open access article distributed under the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/
) which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
P. T. Eugster, P. A. Felber, R. Guerraoui and A. M. Kermarrec, The many faces of publish/subscribe, ACM Computing Survey, vol. 35, no. 2, pp. 114-131, Jun. 2003.
MQTT, http://mqtt.org/, visited on June 2019.
I. M. Llorente, Key challenges in Cloud Computing to Enable Future Internet of Things, Keynote speech, Jan 2012. [Online]. Available: http://fr.slideshare.net/llorente/challenges-incloud-computing-to-enable-future-internet-of-things-v03.
Smarter Planet, http://www.ibm.com/smarterplanet/us/en/, visited on June 2019.
Y. Zhao, K. Kim and N. Venkatasubramanian, DYNATOPS: a dynamic topic-based publish/subscribe architecture, ACM DEBS 2013, pp. 75-86.
L. M. Pham and T. T. Nguyen, Flexible deployment of component-based distributed applications on the Cloud and beyond, KSII Transactions on Internet and Information Systems, 13, 3, (2019), 1141-1163.
MQTTBrokerBench, https://github.com/fimocode/mqttbench, visited on June 2019.
Apache JMeter, http://jmeter.apache.org/, visited on June 2019.
CLIF Server, http://clif.ow2.org, visited on June 2019.
Gatling, http://gatling.io, visited on June 2019.
E. Cecchet, V. Udayabhanu, T. Wood and P. Shenoy, BenchLab: An Open Testbed for Realistic Benchmarking of Web Applications, in usENIX WebApps, 2011, pp. 4-4.
MQTT FuseSource, https://github.com/fusesource/mqtt-client, visited on June 2019.
Sysstat, http://sebastien.godard.pagesperso-orange.fr/, visited on June 2019.
Mosquitto, http://mosquitto.org/, visited on June 2019.
L. Durkop, B. Czybik and J. Jasperneite, Performance evaluation of M2M protocols over cellular networks in a lab environment, ICIN, pp. 70, 75, 17-19 Feb. 2015.
D. Thangavel, X. Ma, A. Valera, H. Tan and C.K.-Y. Tan, Performance evaluation of MQTT and CoAP via a common middleware, IEEE ISSNIP, pp. 1, 6, 21-24 April 2014.
A. Giuliani, MQTT benchmarks with RabbitMQ & ActiveMQ, June 2014. [Online]. Available: http://www.ekito.fr/people/mqtt-benchmarks-rabbitmq-activemq/.
Scalagent, Benchmark of MQTT servers, Jan 2015. [Online]. Available: http://www.scalagent.com/IMG/pdf/Benchmark MQTT servers-v1-1.pdf.
SmartBear, MQTT Test Steps, [Online]. Available: https://smartbear.com/plugins/mqtt-teststeps-page/, visited on June 2019.