Optimizing the performance of optimization in the cloud environment–An intelligent auto-scaling approach

• Published in: Future generation computer systems 2019-12, Vol.101, p.909-920
• Main Authors: Simic, Visnja, Stojanovic, Boban, Ivanovic, Milos
• Format: Article
• Language: English
• Subjects: Cloud computing; Machine learning; Parallel metaheuristics based optimization framework; Resource usage optimization; Resource usage prediction; Surrogate model
• ISSN: 0167-739X; 1872-7115
• DOI: 10.1016/j.future.2019.07.042

The cloud computing paradigm has gained wide acceptance in the scientific community, taking a significant share from fields previously reserved exclusively for High Performance Computing (HPC). On-demand access to a large amount of computing resources provided by Cloud makes it ideal for executing large-scale optimizations using evolutionary algorithms without the need for owning any computing infrastructure. In this regard, we extended WoBinGO, an existing parallel software framework for genetic algorithm based optimization, to be used in Cloud. With these extensions, the framework is capable of elastically and frugally utilizing the underlying cloud computing infrastructure for performing computationally expensive fitness evaluations. We studied two issues that are pertinent when dealing with large-scale optimization in the elastic cloud environment: the computing instance launching overhead and the price of engaging Cloud for solving optimization problems, in terms of the instances’ cumulative uptime. To explain the usability limits of WoBinGO framework running in the IaaS environment, a comprehensive analysis of the framework’s performance was given. Optimization of both total optimization time and total cumulative uptime, leads to minimizing the cost of cloud resources utilization. In this way, we are proposing an intelligent decision support engine based on artificial neural networks and metaheuristics to provide the user with an assessment of the framework’s behavior on the underlying infrastructure in terms of optimization duration and the cost of resource consumption. According to a given assessment, the user can decide upon faster delivery of results or lower infrastructure costs. The proposed software framework has been used to solve a complex real-world optimization problem of a subsurface rock mass model calibration. The results obtained from the private OpenStack deployment show that by using the proposed decision support engine, significant savings can be achieved in both optimization time and optimization cost. •A software framework for large-scale optimization using parallel GA over cloud resources.•Auto-scaling in the application layer for user QoS including cost and performance.•ML surrogate model for predicting a delivery time and an execution cost.•An intelligent decision support engine optimizes cost/performance ratio.•Recommends optimal VM instance’s parameters for the best efficiency.