Xiao Liu
ABSTRACT
On-time completion is one of the most important QoS (Quality of Service) dimensions for business processes running in the cloud. While today’s business systems often need to handle thousands of concurrent user requests, process monitoring is basically conducted in a one by one fashion. It is possible to repeat the strategies for monitoring a single process a thousand times to monitor a thousand parallel processes. However, the time overhead will be a thousand-fold increase as well, which brings a big challenge for process monitoring. In this paper, based on a novel runtime throughput consistency model, we propose a QoS-aware throughput based checkpoint selection strategy which can dynamically select a small number of checkpoints along the system timeline to facilitate the temporal verification of throughput constraints and achieve the target on-time completion rate. The experimental results demonstrate that our strategy can achieve the best efficiency and effectiveness compared with the state-of-the-art as well as other representative response-time based checkpoint selection strategies.
- W. M. P. van der Aalst and K. M. V. Hee, Workflow Management: Models, Methods, and Systems: The MIT Press, Cambridge, 2002. Google Scholar
Digital Library
- I. Alexandru, "Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing," IEEE Trans. on Parallel and Distributed Systems, vol. 22, no. 6, pp. 931-945, 2011. Google ScholarDigital Library
- R. Barga and D. Gannon, "Scientific versus Business Workflows," in Workflows for e-Science, pp. 9-16. 2007.Google Scholar
- H. Cao, H. Jin, X. Wu, and S. Wu, "ServiceFlow: QoS-based hybrid service-oriented grid workflow system," The Journal of Supercomputing, vol. 53, issue. 3, pp. 371-393, 2010. Google ScholarDigital Library
- J. Chen and Y. Yang, "Adaptive Selection of Necessary and Sufficient Checkpoints for Dynamic Verification of Temporal Constraints in Grid Workflow Systems," ACM Trans. on Autonomous and Adaptive Systems, vol. 2, no. 2, 2007. Google ScholarDigital Library
- J. Chen and Y. Yang, "Multiple States based Temporal Consistency for Dynamic Verification of Fixed-time Constraints in Grid Workflow Systems," Concurrency and Computation: Practice and Experience, Wiley, vol. 19, no. 7, pp. 965-982, 2007. Google ScholarDigital Library
- J. Chen and Y. Yang, "Temporal Dependency based Checkpoint Selection for Dynamic Verification of Fixed-time Constraints in Grid Workflow Systems," Proc. 30th International Conference on Software Engineering, pp. 141-150, Leipzig, Germany, 2008. Google ScholarDigital Library
- J. Chen, Y. Yang, and T. Y. Chen, "Dynamic Verification of Temporal Constraints on-the-fly for Workflow Systems," Proc. 11th Asia-Pacific Software Engineering Conference, pp. 30-37, 2004. Google ScholarDigital Library
- J. Chen and Y. Yang, "Activity Completion Duration Based Checkpoint Selection for Dynamic Verification of Temporal Constraints in Grid Workflow Systems," International Journal of High Performance Computing Applcations, vol. 22, no. 3, pp. 319- 329, 2008. Google ScholarDigital Library
- C. Ghezzi, L. Pinto, P. Spoletini, and G. Tamburrelli, "Managing Non-functional Uncertainty via Model-Driven Adaptivity," Proc. 35th International Conference on Software Engineering, pp. 33-42 2013. Google ScholarDigital Library
- D. Gross, J. Shortle, J. Thompson, and C. Harris, Fundamentals of Queueing Theory (Fourth Edition), John Wiley & Sons, 2008. Google ScholarDigital Library
- C. Hagen and G. Alonso, "Exception Handling in Workflow Management Systems," IEEE Trans. on Software Engineering, vol. 26, no. 10, pp. 943-958, 2000. Google ScholarDigital Library
- K. Hamzeh, "Performance Analysis of Cloud Computing Centers Using M/G/m/m+r Queuing Systems," IEEE Trans. on Parallel and Distributed Systems, vol. 23, no. 5, pp. 936-943, 2012. Google ScholarDigital Library
- HPGC, Proc. Sixth High-Performance Grid Computing Workshop, May 25-29, 2009, Rome, Italy,Google Scholar
- K. Hwang, J. Dongarra, and G. Fox, Distributed and Cloud Computing: From Parallel Processing to the Internet of Things: Morgan Kaufmann, 2012. Google ScholarDigital Library
- B. S. Lerner, S. Christov, L. J. Osterweil, R. Bendraou, U. Kannengiesser, and A. Wise, "Exception Handling Patterns for Process Modeling," IEEE Trans. on Software Engineering, vol. 36, no. 2, pp. 162-183, 2010. Google ScholarDigital Library
- K. Liu, J. Chen, Y. Yang, and H. Jin, "A Throughput Maximization Strategy for Scheduling Transaction-Intensive Workflows on SwinDeW-G," Concurrency and Computation: Practice and Experience, vol. 20, no. 15, pp. 1807-1820, 2008. Google ScholarDigital Library
- X Liu, D. Wang, D. Yuan, and Y. Yang, "A Novel Deadline Assignment Strategy for a Large Batch of Parallel Tasks with Soft Deadlines in the Cloud," Proc. 15th IEEE International Conference on High Performance Computing and Communications, pp. 51-58, Zhangjiajie, China, Nov. 2013.Google Scholar
- X. Liu, Z. Ni, J. Chen, and Y. Yang, "A Probabilistic Strategy for Temporal Constraint Management in Scientific Workflow Systems," Concurrency and Computation: Practice and Experience, vol. 23, no. 16, pp. 1893-1919, 2011. Google ScholarDigital Library
- X. Liu, D. Yuan, G. Zhang, W. Li, D. Cao, Q. He, J. Chen, and Y. Yang, The Design of Cloud Workflow Systems: Springer, 2012. Google ScholarDigital Library
- X. Liu, J. Chen, and Y. Yang, Temporal QoS Management in Scientific Cloud Workflow Systems: Elsevier, 2012. Google ScholarDigital Library
- X. Liu, Y. Yang, D. Cao, and D. Yuan, "Selecting Checkpoints along the Time Line: A Novel Temporal Checkpoint Selection Strategy for Monitoring a Batch of Parallel Business Processes," Proc. 35th International Conference on Software Engineering (NIER Track), pp. 1281-1284, 2013. Google ScholarDigital Library
- X. Liu, Y. Yang, D. Yuan, and J. Chen, "Do We Need to Handle Every Temporal Violation in Scientific Workflow Systems?," ACM Trans. on Software Engineering and Methodology, vol. 23, no. 1, Article 5, Feb. 2014. Google ScholarDigital Library
- X. Liu, Y. Yang, J. Chen, Q. Wang, and M. Li, "Achieving On-Time Delivery: A Two-Stage Probabilistic Scheduling Strategy for Software Projects," Proc. 2009 International Conference on Software Process, pp. 317-329, 2009. Google ScholarDigital Library
- X. Liu, Z. Ni, Z. Wu, D. Yuan, J. Chen, and Y. Yang, "A Novel General Framework for Automatic and Cost-Effective Handling of Recoverable Temporal Violations in Scientific Workflow Systems," Journal of Systems and Software vol. 84, no. 3, pp. 492-509, 2011. Google ScholarDigital Library
- X. Liu, Y. Yang, Y. Jiang, and J. Chen, "Preventing Temporal Violations in Scientific Workflows: Where and How," IEEE Trans. on Software Engineering, vol. 37, no. 6, pp. 805-825, 2011. Google ScholarDigital Library
- O. Marjanovic and M.E. Orlowska, "On Modelling and Verification of Temporal Constraints in Production Workflows," Knowledge and Information Systems, vol. 1, no. 2, pp. 157-192, 1999.Google ScholarDigital Library
- V. Nallur and R. Bahsoon, "A Decentralized Self-Adaptation Mechanism for Service-Based Applications in the Cloud," IEEE Trans. on Software Engineering, vol. 39, issue. 5, pp. 591-612, 2013. Google ScholarDigital Library
- E. Schwalb and L. Vila, "Temporal Constraints: A Survey," Constraints, vol. 3, no. 2, pp. 129-149, 1998. Google ScholarDigital Library
- SECES, Proc. First International Workshop on Software Engineering for Computational Science and Engineering, Leipzig, Germany, May, 2008, 2008.Google Scholar
- K. Sriram, G. Nathan, D. Janakiram, and S. Naveen, "Optimizing Ordered Throughput using Autonomic Cloud Bursting Schedulers," IEEE Trans. on Software Engineering, vol. 39 no. 11, pp. 1564-1581. Google ScholarDigital Library
- K. A. Stroud, Engineering Mathematics (Sixth Edition). New York: Palgrave Macmillan, 2007.Google Scholar
- D. Warneke and O. Kao, "Exploiting Dynamic Resource Allocation for Efficient Parallel Data Processing in the Cloud," IEEE Trans. on Parallel and Distributed Systems, vol. 22, no. 6, pp. 985-997, 2011. Google ScholarDigital Library
- J. Xu, A. Romanovsky, and B. Randell, "Concurrent Exception Handling and Resolution in Distributed Object Systems," IEEE Trans. on Parallel and Distributed Systems, vol. 11, no. 10, pp. 1019-1032, 2000. Google ScholarDigital Library
- H. Zhuge, T. Cheung, and H. Pung, "A Timed Workflow Process Model," Journal of Systems and Software, vol. 55, no. 3, pp. 231-243, 2001. Google ScholarDigital Library
- MySQL Developer Zone, Data Type Storage Requirements, http://dev.mysql.com/doc/refman/5.1/en/storage-requirements.html, accessed on 01/01/2014.Google Scholar
Index Terms
- Throughput based temporal verification for monitoring large batch of parallel processes
Recommendations
Workflow temporal verification for monitoring parallel business processes
Workflow temporal verification is conducted to guarantee on-time completion, which is one of the most important QoS Quality of Service dimensions for business processes running in the cloud. However, as today's business systems often need to handle a ...
Temporal dependency-based checkpoint selection for dynamic verification of temporal constraints in scientific workflow systems
In a scientific workflow system, a checkpoint selection strategy is used to select checkpoints along scientific workflow execution for verifying temporal constraints so that we can identify any temporal violations and handle them in time in order to ...
An integrated scheduling algorithm for multi-device-processes with the strategy of exchanging adjacent parallel processes of the same device
AbstractAt present, Multi-Devices-Process Integrated Scheduling Algorithm with Time-Selective Strategy for Process Sequence (MISATPS) is an advanced algorithm in the field of integrated scheduling with multi-devices-process problems. This algorithm ...
Comments