Skip to main content

Data Ingestion and Storage Performance of IoT Platforms: Study of OpenIoT

  • Conference paper
  • First Online:
Interoperability and Open-Source Solutions for the Internet of Things (InterOSS-IoT 2016)

Abstract

Internet of Things is a very active research area with great commercialisation potential. The number of IoT platforms is already exceeding 300 and still growing. However, performance evaluation and benchmarking of IoT platforms are still in their infancy. As a step towards developing a performance benchmarking approach for IoT platforms, this paper analyses and compares a number of popular IoT platforms from data ingestion and storage capability perspectives. In order to test the proposed approach, we use the widely used open source IoT platform, OpenIoT. The results of the experiments and the lessons learnt are presented and discussed. While having a great research promise and pioneering contribution to semantic interoperability of IoT silos, the experimental results indicate OpenIoT platform needs more development effort to be ready for any substantial deployment in commercial IoT applications.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Velosa, A., Natis, Y.V., Pezzini, M., Lheureux, B.J., Goodness, E.: Gartner’s Market Guide for IoT Platforms (2015)

    Google Scholar 

  2. Vandikas, K., Tsiatsis, V.: Performance evaluation of an IoT platform. In: 2014 Eighth International Conference on Next Generation Mobile Apps, Services and Technologies, pp. 141–146. IEEE (2014)

    Google Scholar 

  3. Predix developer network, services and software. https://www.predix.io/catalog/services/

  4. Predix Architecture. https://www.predix.com/sites/default/files/ge-predix-architecture-r092615.pdf

  5. Tibbo Aggregate IoT Integration platform. http://aggregate.tibbo.com/

  6. AggreGate Performance and Scalability Facts. http://aggregate.tibbo.com/technology/architecture/performance.html

  7. ThingWorx IoT Technology Platform. https://www.thingworx.com/platforms/

  8. Amazon Kinesis. https://aws.amazon.com/kinesis/

  9. Amazon AWS IoT. http://docs.aws.amazon.com/iot/latest/developerguide/what-is-aws-iot.html

  10. Foster, A.: Enhanced data storage capabilities for IBM Watson IoT Platform. https://developer.ibm.com/iotplatform/2016/07/25/enhanced-data-storage-capabilities-for-ibm-watson-iot-platform/

  11. Moltchanov, B., Rocha, O.R.: Generic enablers concept and two implementations for European future internet test-bed. In: 2014 International Conference on Computing, Management and Telecommunications (ComManTel), pp. 304–308. IEEE (2014)

    Google Scholar 

  12. Ramparany, F., Marquez, F.G., Soriano, J., Elsaleh, T.: Handling smart environment devices, data and services at the semantic level with the FI-WARE core platform. In: 2014 IEEE International Conference on Big Data (Big Data), pp. 14–20. IEEE (2014)

    Google Scholar 

  13. FIWARE semantic application support generic enabler. https://forge.fiware.org/plugins/mediawiki/wiki/fiware/index.php/Semantic_Application_Support_-_Users_and_Programmers_Guide

  14. Serrano, M., Quoc, H.N.M., Le Phuoc, D., Hauswirth, M., Soldatos, J., Kefalakis, N., Jayaraman, P.P., Zaslavsky, A.: Defining the stack for service delivery models and interoperability in the internet of things: a practical case with OpenIoT-VDK. IEEE J. Sel. Areas Commun. 33, 676–689 (2015)

    Article  Google Scholar 

  15. Aberer, K., Hauswirth, M., Salehi, A.: A middleware for fast and flexible sensor network deployment. In: Proceedings of 32nd International Conference on Very Large Data Bases, pp. 1199–1202 (2006)

    Google Scholar 

  16. Le-Phuoc, D., Nguyen-Mau, H.Q., Parreira, J.X., Hauswirth, M.: A middleware framework for scalable management of linked streams. Web Semant. Sci. Serv. Agents World Wide Web 16, 42–51 (2012)

    Article  Google Scholar 

  17. Hassani, A.: OpenIoT evaluations. https://github.com/ahas36/openiot/tree/Evaluation/evaluations

  18. Transaction Processing Performance Council. http://www.tpc.org/

  19. Cooper, B.F., Silberstein, A., Tam, E., Ramakrishnan, R., Sears, R.: Benchmarking cloud serving systems with YCSB. In: Proceedings of the 1st ACM Symposium on Cloud Computing - SoCC 2010, p. 143. ACM Press, New York (2010)

    Google Scholar 

  20. Yahoo! Cloud Serving Benchmark (YCSB) github page. https://github.com/brianfrankcooper/YCSB/wiki

  21. RDF Store Benchmarking. https://www.w3.org/wiki/RdfStoreBenchmarking

  22. Virtuoso BSBM V3.1 Results, April 2013. http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/results/V7/index.html#exploreVirtuoso

  23. Bizer, C., Schultz, A., Pan, Z., Heflin, J.: Berlin SPARQL Benchmark (BSBM) Specification - V3.1. http://wifo5-03.informatik.uni-mannheim.de/bizer/berlinsparqlbenchmark/spec/index.html

  24. Malim, G.: Looking for a benchmarking framework for IoT platforms. http://www.iotglobalnetwork.com/iotdir/2016/02/16/looking-for-a-benchmarking-framework-for-iot-platforms-1031/

  25. Nambiar, R.: Benchmarking internet of things (CISCO). http://blogs.cisco.com/datacenter/industry-standards-for-benchmarking-iot

  26. PROBE-IT benchmarking framework. http://www.probe-it.eu/?page_id=1036

  27. Arlitt, M., Marwah, M., Bellala, G., Shah, A., Healey, J., Vandiver, B.: IoTAbench. In: Proceedings of the 6th ACM/SPEC International Conference on Performance Engineering - ICPE 2015, pp. 133–144. ACM Press, New York (2015)

    Google Scholar 

Download references

Acknowledgement

Part of this work has been carried out in the scope of the project bIoTope which is co-funded by the European Commission under Horizon-2020 program, contract number H2020-ICT-2015/688203 – bIoTope. The research has been carried out with the financial support of the Ministry of Education and Science of the Russian Federation under grant agreement RFMEFI58716X0031.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Alexey Medvedev .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Medvedev, A. et al. (2017). Data Ingestion and Storage Performance of IoT Platforms: Study of OpenIoT. In: Podnar Žarko, I., Broering, A., Soursos, S., Serrano, M. (eds) Interoperability and Open-Source Solutions for the Internet of Things. InterOSS-IoT 2016. Lecture Notes in Computer Science(), vol 10218. Springer, Cham. https://doi.org/10.1007/978-3-319-56877-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-56877-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-56876-8

  • Online ISBN: 978-3-319-56877-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics