Research Article
BibTex RIS Cite

Performance Analysis of Open Source Cloud Computing Architectures

Year 2024, Volume: 7 Issue: 2, 244 - 252, 31.08.2024

Mehmet Zahid Kuzan , Abdullah Sevin

https://doi.org/10.35377/saucis...1432389

Abstract

Organizations prioritize cloud computing as the primary solution for ensuring secure and, most importantly, uninterrupted delivery of data. In today's landscape, there are various architectural frameworks offering cloud computing infrastructures to choose from. It is crucial to understand how advantageous the performance offered by a chosen architecture is when making a selection. This study aims to comprehend how effective open-source cloud computing architectures are in specific usage scenarios, provide a comparative perspective, and assist organizations in making informed decisions when selecting their IT infrastructures. In line with the study's objectives, the network, disk, and processor performances of OpenStack, OpenNebula, and Apache CloudStack architectures on the same hardware are examined based on data-driven methods. The Iperf3 tool is used for network performance measurement, the dd (Linux) tool for disk performance measurement, and the Sysbench tool for processor performance measurement. After conducting performance measurements with these tools, it was observed that the OpenNebula architecture outperformed the other architectures in terms of overall performance.

Keywords

Open source Performance analysis Cloud computing

References

  • [1] İ. Günebakan, “KOBİ’ler İçin Bulut Bilişimin Avantaj ve Dezavantajları,” International Journal of Academic Value Studies, vol. 2, no. 3, pp. 116–132, May 2016.
  • [2] C. Zou, H. Deng, and Q. Qiu, “Design and implementation of hybrid cloud computing architecture based on cloud bus,” in Proceedings - IEEE 9th International Conference on Mobile Ad-Hoc and Sensor Networks, MSN 2013, 2013, pp. 289–293. doi: 10.1109/MSN.2013.72.
  • [3] P. T. Endo, G. E. Gonçalves, J. Kelner, and D. Sadok, “A Survey on Open-source Cloud Computing Solutions,” in VIII Workshop em Clouds, Grids e Aplicações, 2010, pp. 3–16.
  • [4] J. W. Rittinghouse and J. F. Ransome, “Cloud Computing: History and Evolution,” in Encyclopedia of Information Systems and Technology - Two Volume Set, vol. 1, CRC Press, 2011, pp. 178–192.
  • [5] Z. Li, L. O’Brien, and M. Kihl, “DoKnowMe: Towards a Domain Knowledge-driven Methodology for Performance Evaluation,” Aug. 2017, doi: 10.1145/2897356.2897360.
  • [6] S. Eren, “VMWare ve Hyper-V Sanallaştırma Sistemlerinin Performans ve Yüksek Kullanılabilirliğinin Deneysel Olarak Karşılaştırılması,” Yüksek Lisans Tezi, Maltepe Üniversitesi, 2020.
  • [7] A. Doğru, “Sunucu Sanallaştırma ve Uygulama Sanallaştırma Teknolojileri Performans Karşılaştırması,” Yüksek Lisans Tezi, Maltepe Üniversitesi, 2019.
  • [8] H. Elmas, “Bulut Teknolojisinin Uygulama Sunucularının Yönetimi ve Performansı Üzerindeki Etkisi,” Yüksek Lisans Tezi, İstanbul Üniversitesi, 2013.
  • [9] G. Ataş, “Performance Evaluations of Cloud Computing Platforms,” Yüksek Lisans Tezi, Bahçeşehir University, 2013.
  • [10] A. Husain, M. H. Zaki, and S. Islam, “Performance Evaluation of Private Clouds: OpenStack vs Eucalyptus.” [Online]. Available: http://www.publishingindia.com/ijdcc
  • [11] S. Yadav, “Comparative Study on Open Source Software for Cloud Computing Platform: Eucalyptus, OpenStack and OpenNebula.” [Online]. Available: https://www.researchgate.net/publication/262335770
  • [12] P. Bedi, B. Deep, P. Kumar, and P. Sarna, “Comparative Study of OpenNebula, CloudStack, Eucalyptus and OpenStack,” International Journal of Distributed and Cloud Computing, vol. 6, no. 1, pp. 37–42, 2018, [Online]. Available: http://www.publishingindia.com/ijdcc
  • [13] Saisree S. and Shitharth S., Artificial Intelligence and Data Science, vol. 1673. In Communications in Computer and Information Science, vol. 1673. Cham: Springer Nature Switzerland, 2022. doi: 10.1007/978-3-031-21385-4.
  • [14] B. Mohammed and M. Kiran, “Analysis of Cloud Test Beds Using OpenSource Solutions,” in Proceedings - 2015 International Conference on Future Internet of Things and Cloud, FiCloud 2015 and 2015 International Conference on Open and Big Data, OBD 2015, Institute of Electrical and Electronics Engineers Inc., Oct. 2015, pp. 195–203. doi: 10.1109/FiCloud.2015.106.
  • [15] G. Işık, U. Gürel, and A. G. Yavuz, “Bulut Ortamlarında Hipervizör ve Konteyner Tipi Sanallaştırmanın Farklı Özellikte İş Yüklerinin Performansına Etkisinin Değerlendirilmesi,” Uludağ University Journal of The Faculty of Engineering, pp. 981–1002, Aug. 2020, doi: 10.17482/uumfd.605560.
  • [16] J. Peng, X. Zhang, Z. Lei, B. Zhang, W. Zhang, and Q. Li, “Comparison of several cloud computing platforms,” 2nd International Symposium on Information Science and Engineering, ISISE 2009, pp. 23–27, 2009, doi: 10.1109/ISISE.2009.94.
  • [17] E. Simmon, “Evaluation of Cloud Computing Services Based on NIST SP 800-145.” Special Publication (NIST SP), National Institute of Standards and Technology, Gaithersburg, MD, 2018. doi: https://doi.org/10.6028/NIST.SP.500-322.
  • [18] J. Yang, L. Zhang, and X. A. Wang, “On Cloud Computing Middleware Architecture,” in Proceedings - 2015 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2015, Institute of Electrical and Electronics Engineers Inc., 2015, pp. 832–835. doi: 10.1109/3PGCIC.2015.46.
  • [19] T. Cordeiro et al., “Open source cloud computing platforms,” in Proceedings - 9th International Conference on Grid and Cloud Computing, GCC 2010, 2010, pp. 366–371. doi: 10.1109/GCC.2010.77.
  • [20] O. Sefraoui, M. Aissaoui, and M. Eleuldj, “OpenStack: Toward an Open-source Solution for Cloud Computing,” Int J Comput Appl, vol. 55, no. 3, pp. 38–42, Oct. 2012, doi: 10.5120/8738-2991.
  • [21] T. Rosado and J. Bernardino, “An overview of OpenStack architecture,” in ACM International Conference Proceeding Series, Association for Computing Machinery, 2014, pp. 366–367. doi: 10.1145/2628194.2628195.
  • [22] Kevin. Jackson, OpenStack Cloud Computing Cookbook. Packt Publishing, 2013.
  • [23] K. Ahokas, “Comparison of cloud management platforms,” 2014.
  • [24] G. Işık, “Bulut Ortamlarında Hipervizör ve Konteyner Tipi Sanallaştırmanın Farklı Özellikte İş Yüklerinin Performansına Etkisinin Değerlendirilmesi,” Yüksek Lisans TEzi, Eskişehir Osmangazi Üniversitesi, 2021.
  • [25] F. Gomez-Folgar, A. Garcia-Loureiro, T. F. Pena, and R. Valin, “Performance of the CloudStack KVM pod primary storage under NFS version 3,” in Proceedings of the 2012 10th IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2012, 2012, pp. 845–846. doi: 10.1109/ISPA.2012.128.
  • [26] A. P. Kurniawan, M. N. Ashar, and F. Hidayat, “Performance Evaluation for Deploying Dockerized Web Application on AWS, GCP, and Azure,” in 2023 IEEE International Conference on Control, Electronics and Computer Technology (ICCECT), 2023, pp. 346–350.

Year 2024, Volume: 7 Issue: 2, 244 - 252, 31.08.2024

Mehmet Zahid Kuzan , Abdullah Sevin

https://doi.org/10.35377/saucis...1432389

Abstract

References

  • [1] İ. Günebakan, “KOBİ’ler İçin Bulut Bilişimin Avantaj ve Dezavantajları,” International Journal of Academic Value Studies, vol. 2, no. 3, pp. 116–132, May 2016.
  • [2] C. Zou, H. Deng, and Q. Qiu, “Design and implementation of hybrid cloud computing architecture based on cloud bus,” in Proceedings - IEEE 9th International Conference on Mobile Ad-Hoc and Sensor Networks, MSN 2013, 2013, pp. 289–293. doi: 10.1109/MSN.2013.72.
  • [3] P. T. Endo, G. E. Gonçalves, J. Kelner, and D. Sadok, “A Survey on Open-source Cloud Computing Solutions,” in VIII Workshop em Clouds, Grids e Aplicações, 2010, pp. 3–16.
  • [4] J. W. Rittinghouse and J. F. Ransome, “Cloud Computing: History and Evolution,” in Encyclopedia of Information Systems and Technology - Two Volume Set, vol. 1, CRC Press, 2011, pp. 178–192.
  • [5] Z. Li, L. O’Brien, and M. Kihl, “DoKnowMe: Towards a Domain Knowledge-driven Methodology for Performance Evaluation,” Aug. 2017, doi: 10.1145/2897356.2897360.
  • [6] S. Eren, “VMWare ve Hyper-V Sanallaştırma Sistemlerinin Performans ve Yüksek Kullanılabilirliğinin Deneysel Olarak Karşılaştırılması,” Yüksek Lisans Tezi, Maltepe Üniversitesi, 2020.
  • [7] A. Doğru, “Sunucu Sanallaştırma ve Uygulama Sanallaştırma Teknolojileri Performans Karşılaştırması,” Yüksek Lisans Tezi, Maltepe Üniversitesi, 2019.
  • [8] H. Elmas, “Bulut Teknolojisinin Uygulama Sunucularının Yönetimi ve Performansı Üzerindeki Etkisi,” Yüksek Lisans Tezi, İstanbul Üniversitesi, 2013.
  • [9] G. Ataş, “Performance Evaluations of Cloud Computing Platforms,” Yüksek Lisans Tezi, Bahçeşehir University, 2013.
  • [10] A. Husain, M. H. Zaki, and S. Islam, “Performance Evaluation of Private Clouds: OpenStack vs Eucalyptus.” [Online]. Available: http://www.publishingindia.com/ijdcc
  • [11] S. Yadav, “Comparative Study on Open Source Software for Cloud Computing Platform: Eucalyptus, OpenStack and OpenNebula.” [Online]. Available: https://www.researchgate.net/publication/262335770
  • [12] P. Bedi, B. Deep, P. Kumar, and P. Sarna, “Comparative Study of OpenNebula, CloudStack, Eucalyptus and OpenStack,” International Journal of Distributed and Cloud Computing, vol. 6, no. 1, pp. 37–42, 2018, [Online]. Available: http://www.publishingindia.com/ijdcc
  • [13] Saisree S. and Shitharth S., Artificial Intelligence and Data Science, vol. 1673. In Communications in Computer and Information Science, vol. 1673. Cham: Springer Nature Switzerland, 2022. doi: 10.1007/978-3-031-21385-4.
  • [14] B. Mohammed and M. Kiran, “Analysis of Cloud Test Beds Using OpenSource Solutions,” in Proceedings - 2015 International Conference on Future Internet of Things and Cloud, FiCloud 2015 and 2015 International Conference on Open and Big Data, OBD 2015, Institute of Electrical and Electronics Engineers Inc., Oct. 2015, pp. 195–203. doi: 10.1109/FiCloud.2015.106.
  • [15] G. Işık, U. Gürel, and A. G. Yavuz, “Bulut Ortamlarında Hipervizör ve Konteyner Tipi Sanallaştırmanın Farklı Özellikte İş Yüklerinin Performansına Etkisinin Değerlendirilmesi,” Uludağ University Journal of The Faculty of Engineering, pp. 981–1002, Aug. 2020, doi: 10.17482/uumfd.605560.
  • [16] J. Peng, X. Zhang, Z. Lei, B. Zhang, W. Zhang, and Q. Li, “Comparison of several cloud computing platforms,” 2nd International Symposium on Information Science and Engineering, ISISE 2009, pp. 23–27, 2009, doi: 10.1109/ISISE.2009.94.
  • [17] E. Simmon, “Evaluation of Cloud Computing Services Based on NIST SP 800-145.” Special Publication (NIST SP), National Institute of Standards and Technology, Gaithersburg, MD, 2018. doi: https://doi.org/10.6028/NIST.SP.500-322.
  • [18] J. Yang, L. Zhang, and X. A. Wang, “On Cloud Computing Middleware Architecture,” in Proceedings - 2015 10th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing, 3PGCIC 2015, Institute of Electrical and Electronics Engineers Inc., 2015, pp. 832–835. doi: 10.1109/3PGCIC.2015.46.
  • [19] T. Cordeiro et al., “Open source cloud computing platforms,” in Proceedings - 9th International Conference on Grid and Cloud Computing, GCC 2010, 2010, pp. 366–371. doi: 10.1109/GCC.2010.77.
  • [20] O. Sefraoui, M. Aissaoui, and M. Eleuldj, “OpenStack: Toward an Open-source Solution for Cloud Computing,” Int J Comput Appl, vol. 55, no. 3, pp. 38–42, Oct. 2012, doi: 10.5120/8738-2991.
  • [21] T. Rosado and J. Bernardino, “An overview of OpenStack architecture,” in ACM International Conference Proceeding Series, Association for Computing Machinery, 2014, pp. 366–367. doi: 10.1145/2628194.2628195.
  • [22] Kevin. Jackson, OpenStack Cloud Computing Cookbook. Packt Publishing, 2013.
  • [23] K. Ahokas, “Comparison of cloud management platforms,” 2014.
  • [24] G. Işık, “Bulut Ortamlarında Hipervizör ve Konteyner Tipi Sanallaştırmanın Farklı Özellikte İş Yüklerinin Performansına Etkisinin Değerlendirilmesi,” Yüksek Lisans TEzi, Eskişehir Osmangazi Üniversitesi, 2021.
  • [25] F. Gomez-Folgar, A. Garcia-Loureiro, T. F. Pena, and R. Valin, “Performance of the CloudStack KVM pod primary storage under NFS version 3,” in Proceedings of the 2012 10th IEEE International Symposium on Parallel and Distributed Processing with Applications, ISPA 2012, 2012, pp. 845–846. doi: 10.1109/ISPA.2012.128.
  • [26] A. P. Kurniawan, M. N. Ashar, and F. Hidayat, “Performance Evaluation for Deploying Dockerized Web Application on AWS, GCP, and Azure,” in 2023 IEEE International Conference on Control, Electronics and Computer Technology (ICCECT), 2023, pp. 346–350.
There are 26 citations in total.

Details

Primary Language English
Subjects Software Architecture, Software Testing, Verification and Validation
Journal Section Articles
Authors

Mehmet Zahid Kuzan 0000-0002-2303-521X

Abdullah Sevin 0000-0001-9694-0870

Early Pub Date August 26, 2024
Publication Date August 31, 2024
Submission Date February 6, 2024
Acceptance Date July 26, 2024
Published in Issue Year 2024Volume: 7 Issue: 2

Cite

IEEE M. Z. Kuzan and A. Sevin, “Performance Analysis of Open Source Cloud Computing Architectures”, SAUCIS, vol. 7, no. 2, pp. 244–252, 2024, doi: 10.35377/saucis...1432389.
 Download Cover Image

29070    The papers in this journal are licensed under a Creative Commons Attribution-NonCommercial 4.0 International License