Volume 39, Issue 6 e12878

ORIGINAL ARTICLE

A multi-tenancy and robust workflow management system

Weilong Ding,

Corresponding Author

Weilong Ding

[email protected]

orcid.org/0000-0002-9982-5488

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Correspondence

Weilong Ding, School of Information Science and Technology, Hanxue Building, North China University of Technology, No.5 Jinyuanzhuang Road, Shijingshan District, Beijing, China.

Email: [email protected]

Search for more papers by this author

Ji Liu,

Ji Liu

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Zhongguo Yang,

Zhongguo Yang

orcid.org/0000-0002-3720-0642

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Bo Lv,

Bo Lv

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Han Li,

Han Li

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Hanchuan Xu,

Hanchuan Xu

orcid.org/0000-0002-6813-2435

School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China

Search for more papers by this author

Weilong Ding,

Corresponding Author

Weilong Ding

[email protected]

orcid.org/0000-0002-9982-5488

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Correspondence

Weilong Ding, School of Information Science and Technology, Hanxue Building, North China University of Technology, No.5 Jinyuanzhuang Road, Shijingshan District, Beijing, China.

Email: [email protected]

Search for more papers by this author

Ji Liu,

Ji Liu

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Zhongguo Yang,

Zhongguo Yang

orcid.org/0000-0002-3720-0642

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Bo Lv,

Bo Lv

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Han Li,

Han Li

School of Information Science and Technology, North China University of Technology, Beijing, China

Beijing Key Laboratory on Integration and Analysis of Large-scale Stream Data, Beijing, China

Search for more papers by this author

Hanchuan Xu,

Hanchuan Xu

orcid.org/0000-0002-6813-2435

School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China

Search for more papers by this author

First published: 11 November 2021

https://doi.org/10.1111/exsy.12878

Funding information: National Key R&D Program of China, Grant/Award Number: 2018YFB1402500; Beijing Municipal Natural Science Foundation, Grant/Award Numbers: 4192020, 4202021; “Yuyou” Talents of North China University of Technology, Grant/Award Number: XN115013

Share a link

Email
Wechat
Bluesky

Abstract

Workflow management system (WfMS) in cloud always works as platform as a service to manage customized business processes for massive enterprises. In big data era, non-functional guarantees of such systems are significant when facing a large number of users and concurrent requests. It is not trivial to support multi-tenancy and hold high-availability, because traditional architecture cannot simultaneously satisfy requirements about data isolation and runtime efficiency. In this paper, a modularized distributed workflow management system is proposed, which considers both multi-tenancy and high-availability in storage and engine parts of the system. A multiple-worker-with-separate-schema mechanism is defined to jointly manage the data for tenants, and a proactive strategy is presented to intelligently dispatch large concurrent requests from users to engine workers. After extensive case studies and experiments in practical scenes, our system deployed on modest machines is proved to support tens of thousands of tenants, second-level response time for 10 K concurrency, and no-human-intervened failure recovery for a fail-stop system node.

CONFLICT OF INTEREST

The authors declare no conflict of interest.

Open Research

DATA AVAILABILITY STATEMENT

The data that support the findings of this study are available from the corresponding author upon reasonable request.

REFERENCES

Al-Kiswany, S. & Ripeanu, M. (2016), A software-defined storage for workflow applications. IEEE International Conference on Cluster Computing (CLUSTER2016), Taipei, Taiwan. 458-465. https://doi.org/10.1109/CLUSTER.2016.56
10.1109/CLUSTER.2016.56
Google Scholar
Alvarez, J. A. (2018). Multitenancy in Flowable https://blog.flowable.org/2018/09/11/multitenancy-in-flowable/
Google Scholar
Azeez, A., Perera, S., Gamage, D., Linton, R., Siriwardana, P., Leelaratne, D., Weerawarana S & Fremantle, P. (2010). Multi-tenant SOA middleware for cloud computing. 2010 IEEE 3rd International Conference on Cloud Computing. 458-465. https://doi.org/10.1109/CLOUD.2010.50
10.1109/CLOUD.2010.50
Google Scholar
Barrez, J. (2015). Multi-tenancy with separate database schemas in activiti. http://www.jorambarrez.be/blog/2015/10/06/multi-tenancy-separate-database-schemas-in-activiti/
Google Scholar
Bernstein, D. (2014). Containers and cloud: from LXC to Docker to Kubernetes. IEEE Cloud Computing, 1(3), 81–84. https://doi.org/10.1109/MCC.2014.51
10.1109/MCC.2014.51
Google Scholar
Calheiros, R. N., & Buyya, R. (2014). Meeting deadlines of scientific workflows in public clouds with tasks replication. IEEE Transactions on Parallel and Distributed Systems, 25(7), 1787–1796. https://doi.org/10.1109/TPDS.2013.238
10.1109/TPDS.2013.238
Web of Science® Google Scholar
Chong, F., Carraro, G., & Wolter, R. (2006). Multi-tenant data architecture. MSDN Library (pp. 14–30). Microsoft Corporation.
Google Scholar
Ding, W., Wang, J. & Han, Y. (2010). ViPen: A model supporting knowledge provenance for exploratory service composition. IEEE International Conference on Services Computing(SCC), Miami Florida USA. 265-272. https://doi.org/10.1109/SCC.2010.44
10.1109/SCC.2010.44
Google Scholar
Ding, W., Zhao, Z., Wang, J., & Li, H. (2020). Task allocation in hybrid big data analytics for urban IoT applications. ACM/IMS Transactions on Data Science, 1(3), 1–22. https://doi.org/10.1145/3374751
10.1145/3374751
Google Scholar
Gao, H., Huang, W., Duan, Y., Yang, X., & Zou, Q. (2019). Research on cost-driven services composition in an uncertain environment. Journal of Internet Technology, 20(3), 755–769. https://jit.ndhu.edu.tw/article/view/2054
Web of Science® Google Scholar
Gao, H., Huang, W., Yang, X., Duan, Y., & Yin, Y. (2018). Toward service selection for workflow reconfiguration: An interface-based computing solution. Future Generation Computer Systems, 87, 298–311. https://doi.org/10.1016/j.future.2018.04.064
10.1016/j.future.2018.04.064
Web of Science® Google Scholar
Hilman, M. H., Rodriguez, M. A., & Buyya, R. (2020). Multiple workflows scheduling in multi-tenant distributed systems: A taxonomy and future directions. ACM Computing Surveys, 53(1), 1–39. https://doi.org/10.1145/3368036
10.1145/3368036
Web of Science® Google Scholar
Hunt, P., Konar, M., Junqueira, F. P. & Reed, B. (2010). ZooKeeper: wait-free coordination for internet-scale systems. USENIX Conference on USENIX Annual Technical Conference, Boston, MA, USA.
Google Scholar
Jin, W., Liu, T., Zheng, Q., Cui, D. & Cai, Y. (2018). Functionality-oriented microservice extraction based on execution trace clustering. IEEE International Conference on Web Services (ICWS2018), San Francisco, CA, USA. 211-218. https://doi.org/10.1109/ICWS.2018.00034
10.1109/ICWS.2018.00034
Google Scholar
Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., & Vahi, K. (2013). Characterizing and profiling scientific workflows. Future Generation Computer Systems, 29(3), 682–692. https://doi.org/10.1016/j.future.2012.08.015
10.1016/j.future.2012.08.015
Web of Science® Google Scholar
Koziolek, H. (2011). The SPOSAD architectural style for multi-tenant software applications. Ninth Working IEEE/IFIP Conference on Software Architecture, 320-327. https://doi.org/10.1109/WICSA.2011.50
10.1109/WICSA.2011.50
Google Scholar
Makki, M., Van Landuyt, D., Lagaisse, B., & Joosen, W. (2018). A comparative study of workflow customization strategies: Quality implications for multi-tenant SaaS. Journal of Systems and Software, 144, 423–438. https://doi.org/10.1016/j.jss.2018.07.014
10.1016/j.jss.2018.07.014
Web of Science® Google Scholar
Marlon Dumas, M. L. R., & Jan Mendling, H. A. R. (2018). Fundamentals of business process management ( 2nd ed.). Springer.
10.1007/978-3-662-56509-4
Google Scholar
Mazlami, G., Cito, J. & Leitner, P. (2017). Extraction of microservices from monolithic software architectures. IEEE International Conference on Web Services (ICWS2017), Honolulu, HI, USA, 524-531. https://doi.org/10.1109/ICWS.2017.61
10.1109/ICWS.2017.61
Google Scholar
Mouallem, P., Crawl, D., Altintas, I., Vouk, M. & Yildiz, U (2010). A fault-tolerance architecture for Kepler-based distributed scientific workflows. 22nd International Conference on Scientific and Statistical Database Management (SSDBM 2010), Berlin, Heidelberg, Germany. 452-460. https://doi.org/10.1007/978-3-642-13818-8_31
10.1007/978-3-642-13818-8_31
Google Scholar
Plankensteiner, K., & Prodan, R. (2012). Meeting soft deadlines in scientific workflows using resubmission impact. IEEE Transactions on Parallel and Distributed Systems, 23(5), 890–901. https://doi.org/10.1109/TPDS.2011.221
10.1109/TPDS.2011.221
Web of Science® Google Scholar
Poola, D., Salehi, M. A., Ramamohanarao, K., & Buyya, R. (2017). A taxonomy and survey of fault-tolerant workflow management systems in cloud and distributed computing environments. In I. Mistrik, R. Bahsoon, N. Ali, M. Heisel, & B. Maxim (Eds.), Software architecture for big data and the cloud (pp. 285–320). Morgan Kaufmann.
10.1016/B978-0-12-805467-3.00015-6
Google Scholar
Schulte, S., Janiesch, C., Venugopal, S., Weber, I., & Hoenisch, P. (2015). Elastic business process management: State of the art and open challenges for BPM in the cloud. Future Generation Computer Systems, 46, 36–50. https://doi.org/10.1016/j.future.2014.09.005
10.1016/j.future.2014.09.005
Web of Science® Google Scholar
Wang, J., Korambath, P., Altintas, I., Davis, J., & Crawl, D. (2014). Workflow as a service in the cloud: Architecture and scheduling algorithms. Procedia Computer Science, 29, 546–556. https://doi.org/10.1016/j.procs.2014.05.049
10.1016/j.procs.2014.05.049
PubMed Web of Science® Google Scholar
Yang, X., Zhou, S., & Cao, M. (2020). An approach to alleviate the sparsity problem of hybrid collaborative filtering based recommendations: The product-attribute perspective from user reviews. Mobile Networks & Applications, 25(2), 376–390.
10.1007/s11036-019-01246-2
Web of Science® Google Scholar
Yao, Y., Cao, J., Jiang, Y. & Wang, J. (2016). An optimal engine component placement strategy for cloud workflow service. IEEE International Conference on Web Services (ICWS2016), San Francisco, CA, USA, 380-387. https://doi.org/10.1109/ICWS.2016.56
10.1109/ICWS.2016.56
Google Scholar

Volume39, Issue6

Special Issue:Advances in Robotics for Healthcare / Intelligent Software Engineering

July 2022

e12878

A multi-tenancy and robust workflow management system

Abstract

CONFLICT OF INTEREST

Open Research

DATA AVAILABILITY STATEMENT

REFERENCES

References

Information

About Wiley Online Library

Help & Support

Opportunities

Connect with Wiley

A multi-tenancy and robust workflow management system

Abstract

CONFLICT OF INTEREST

Open Research

DATA AVAILABILITY STATEMENT

REFERENCES

References

Related

Information