Skip to main content
Log in

Cloud-based load balancing using double Q-learning for improved Quality of Service

  • Published:
Wireless Networks Aims and scope Submit manuscript

Abstract

Cloud computing improves the performance of software applications by providing on-demand usage, high availability, reliability, and agility. However, during peak traffic conditions the resources in cloud services can become over-utilized, impairing the ability to provide performance levels specified in service-level agreements. Therefore, a load balancing algorithm that provides an efficient and fair allocation of cloud resources while providing high availability to end users is a timely necessity. In this paper, we propose a load balancing scheme to distribute the workload among virtual servers using a modified version of the double Q-learning algorithm. The proposed algorithm is implemented on a load balancing controller and leverages user requests using software defined network technologies. The results reveal a considerable reduction in terms of unsatisfied cloud consumers compared to already existing popular algorithms. In short, this work will serve as a future guide for load balancing implementations in cloud environments that require higher Quality of Service.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Chaczko, Z., Mahadevan, V., Aslanzadeh, S., & Mcdermid, C. (2011) Availability and load balancing in cloud computing. In International conference on computer and software modeling, singapore (Vol. 14)

  2. Dasgupta, K., Mandal, B., Dutta, P., Mandal, J. K., & Dam, S. (2013). A genetic algorithm (ga) based load balancing strategy for cloud computing. Procedia Technology, 10, 340–347.

    Article  Google Scholar 

  3. Domanal, S. G., & Reddy, G. R. M. (2013). Load balancing in cloud computingusing modified throttled algorithm. In IEEE international conference on cloud computing in emerging markets (CCEM) (pp. 1–5).

  4. Iyer, B., & Henderson, J. C. (2010) Preparing for the future: Understanding the seven capabilities cloud computing. MIS Quarterly Executive, 9(2), 117–131.

    Google Scholar 

  5. James, J., & Verma, B. (2012). Efficient VM load balancing algorithm for a cloud computing environment. International Journal on Computer Science and Engineering, 4(9), 1658.

    Google Scholar 

  6. Knox, W. B., & Stone, P. (2010). Combining manual feedback with subsequent MDP reward signals for reinforcement learning. In In: Proceedings of the 9th international conference on autonomous agents and multiagent systems: volume 1-Volume 1, International Foundation for Autonomous Agents and Multiagent Systems (pp. 5–12).

  7. Krishna, P. V. (2013). Honey bee behavior inspired load balancing of tasks in cloud computing environments. Applied Soft Computing, 13(5), 2292–2303.

    Article  MathSciNet  Google Scholar 

  8. Namal, S., Ghaboosi, K., Bennis, M., MacKenzie, A. B., Latva-aho, M. (2010). Joint admission control & interference avoidance in self-organized femtocells. In 2010 Conference record of the forty fourth Asilomar conference on signals, systems and computers (ASILOMAR) (pp. 1067–1071). IEEE

  9. Namal, S., Ahmad, I., Gurtov, A., & Ylianttila, M. (2013). SDN based inter-technology load balancing leveraged by flow admission control. In: 2013 IEEE SDN for future networks and services (SDN4FNS) (pp. 1–5). https://doi.org/10.1109/SDN4FNS.2013.6702551.

  10. Nuaimi, K. A., Mohamed, N., Nuaimi, M. A., & Al-Jaroodi, J. (2012). A survey of load balancing in cloud computing: Challenges and algorithms. In 2012 Second Symposium on Network Cloud Computing and Applications (pp. 137–142). https://doi.org/10.1109/NCCA.2012.29

  11. Sethi, S., Sahu, A., & Jena, S. K. (2012). Efficient load balancing in cloud computing using fuzzy logic. IOSR Journal of Engineering, 2(7), 65–71.

    Article  Google Scholar 

  12. Su, J., Liu, J., Thomas, D. B., & Cheung, P. Y. (2017). Neural network based reinforcement learning acceleration on FPGA platforms. ACM SIGARCH Computer Architecture News, 44(4), 68–73.

    Article  Google Scholar 

  13. Tennakoon, D., Karunarathna, S., Udugama, B. (2018). Q-learning approach for load-balancing in software defined networks. In 2018 Moratuwa engineering research conference (MERCon) (pp. 1–6). IEEE

  14. Van Hasselt, H., Guez, A., & Silver, D. (2016). Deep reinforcement learning with double Q-learning. AAAI, 16, 2094–2100.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Deepal Tennakoon.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tennakoon, D., Chowdhury, M. & Luan, T.H. Cloud-based load balancing using double Q-learning for improved Quality of Service. Wireless Netw 29, 1043–1050 (2023). https://doi.org/10.1007/s11276-018-1888-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11276-018-1888-8

Keywords

Navigation