Abstract
Internet of Things is a very active research area with great commercialisation potential. The number of IoT platforms is already exceeding 300 and still growing. However, performance evaluation and benchmarking of IoT platforms are still in their infancy. As a step towards developing a performance benchmarking approach for IoT platforms, this paper analyses and compares a number of popular IoT platforms from data ingestion and storage capability perspectives. In order to test the proposed approach, we use the widely used open source IoT platform, OpenIoT. The results of the experiments and the lessons learnt are presented and discussed. While having a great research promise and pioneering contribution to semantic interoperability of IoT silos, the experimental results indicate OpenIoT platform needs more development effort to be ready for any substantial deployment in commercial IoT applications.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Velosa, A., Natis, Y.V., Pezzini, M., Lheureux, B.J., Goodness, E.: Gartner’s Market Guide for IoT Platforms (2015)
Vandikas, K., Tsiatsis, V.: Performance evaluation of an IoT platform. In: 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies, pp. 141–146. IEEE (2014)
Predix developer network, services and software. https://www.predix.io/catalog/services/
Predix Architecture. https://www.predix.com/sites/default/files/ge-predix-architecture-r092615.pdf
Tibbo Aggregate IoT Integration platform. http://aggregate.tibbo.com/
AggreGate Performance and Scalability Facts. http://aggregate.tibbo.com/technology/architecture/performance.html
ThingWorx IoT Technology Platform. https://www.thingworx.com/platforms/
Amazon Kinesis. https://aws.amazon.com/kinesis/
Amazon AWS IoT. http://docs.aws.amazon.com/iot/latest/developerguide/what-is-aws-iot.html
Foster, A.: Enhanced data storage capabilities for IBM Watson IoT Platform. https://developer.ibm.com/iotplatform/2016/07/25/enhanced-data-storage-capabilities-for-ibm-watson-iot-platform/
Moltchanov, B., Rocha, O.R.: Generic enablers concept and two implementations for European future internet test-bed. In: 2014 International Conference on Computing, Management and Telecommunications (ComManTel), pp. 304–308. IEEE (2014)
Ramparany, F., Marquez, F.G., Soriano, J., Elsaleh, T.: Handling smart environment devices, data and services at the semantic level with the FI-WARE core platform. In: 2014 IEEE International Conference on Big Data (Big Data), pp. 14–20. IEEE (2014)
FIWARE semantic application support generic enabler. https://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Semantic_Application_Support_-_Users_and_Programmers_Guide
Serrano, M., Quoc, H.N.M., Le Phuoc, D., Hauswirth, M., Soldatos, J., Kefalakis, N., Jayaraman, P.P., Zaslavsky, A.: Defining the stack for service delivery models and interoperability in the internet of things: a practical case with OpenIoT-VDK. IEEE J. Sel. Areas Commun. 33, 676–689 (2015)
Aberer, K., Hauswirth, M., Salehi, A.: A middleware for fast and flexible sensor network deployment. In: Proceedings of 32nd International Conference on Very Large Data Bases, pp. 1199–1202 (2006)
Le-Phuoc, D., Nguyen-Mau, H.Q., Parreira, J.X., Hauswirth, M.: A middleware framework for scalable management of linked streams. Web Semant. Sci. Serv. Agents World Wide Web 16, 42–51 (2012)
Hassani, A.: OpenIoT evaluations. https://github.com/ahas36/openiot/tree/Evaluation/evaluations
Transaction Processing Performance Council. http://www.tpc.org/
Cooper, B.F., Silberstein, A., Tam, E., Ramakrishnan, R., Sears, R.: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing - SoCC 2010, p. 143. ACM Press, New York (2010)
Yahoo! Cloud Serving Benchmark (YCSB) github page. https://github.com/brianfrankcooper/YCSB/wiki
RDF Store Benchmarking. https://www.w3.org/wiki/RdfStoreBenchmarking
Virtuoso BSBM V3.1 Results, April 2013. http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/results/V7/index.html#exploreVirtuoso
Bizer, C., Schultz, A., Pan, Z., Heflin, J.: Berlin SPARQL Benchmark (BSBM) Specification - V3.1. http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/spec/index.html
Malim, G.: Looking for a benchmarking framework for IoT platforms. http://www.iotglobalnetwork.com/iotdir/2016/02/16/looking-for-a-benchmarking-framework-for-iot-platforms-1031/
Nambiar, R.: Benchmarking internet of things (CISCO). http://blogs.cisco.com/datacenter/industry-standards-for-benchmarking-iot
PROBE-IT benchmarking framework. http://www.probe-it.eu/?page_id=1036
Arlitt, M., Marwah, M., Bellala, G., Shah, A., Healey, J., Vandiver, B.: IoTAbench. In: Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering - ICPE 2015, pp. 133–144. ACM Press, New York (2015)
Acknowledgement
Part of this work has been carried out in the scope of the project bIoTope which is co-funded by the European Commission under Horizon-2020 program, contract number H2020-ICT-2015/688203 – bIoTope. The research has been carried out with the financial support of the Ministry of Education and Science of the Russian Federation under grant agreement RFMEFI58716X0031.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Medvedev, A. et al. (2017). Data Ingestion and Storage Performance of IoT Platforms: Study of OpenIoT. In: Podnar Žarko, I., Broering, A., Soursos, S., Serrano, M. (eds) Interoperability and Open-Source Solutions for the Internet of Things. InterOSS-IoT 2016. Lecture Notes in Computer Science(), vol 10218. Springer, Cham. https://doi.org/10.1007/978-3-319-56877-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-56877-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-56876-8
Online ISBN: 978-3-319-56877-5
eBook Packages: Computer ScienceComputer Science (R0)