Tunable scheduling in a GridRPC framework
A. Amar
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorR. Bolze
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorY. Caniou
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorCorresponding Author
E. Caron
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
LIP Laboratory, École normale supérieure de Lyon, 46 Allée d'Italie, F-69364 Lyon Cedex 07, FranceSearch for more papers by this authorA. Chis
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorF. Desprez
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorB. Depardon
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorJ.-S. Gay
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorG. Le Mahec
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorD. Loureiro
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorA. Amar
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorR. Bolze
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorY. Caniou
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorCorresponding Author
E. Caron
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
LIP Laboratory, École normale supérieure de Lyon, 46 Allée d'Italie, F-69364 Lyon Cedex 07, FranceSearch for more papers by this authorA. Chis
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorF. Desprez
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorB. Depardon
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorJ.-S. Gay
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorG. Le Mahec
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorD. Loureiro
LIP Laboratory (UMR CNRS, ENS Lyon, INRIA, UCBL 5668), GRAAL Project, 46 Allée d'Italie, F-69364 Lyon Cedex 07, France
Search for more papers by this authorAbstract
Among existing grid middleware approaches, one simple, powerful, and flexible approach consists of using servers available in different administrative domains through the classic client–server or remote procedure call paradigm. Network Enabled Servers (NES) implement this model, also called GridRPC. Clients submit computation requests to a scheduler, whose goal is to find a server available on the grid using some performance metric. The aim of this paper is to give an overview of a NES middleware developed in the GRAAL team called distributed interactive engineering toolbox (DIET) and to describe recent developments around plug-in schedulers, workflow management, and tools. DIET is a hierarchical set of components used for the development of applications based on computational servers on the grid. Copyright © 2007 John Wiley & Sons, Ltd.
REFERENCES
- 1 Seymour K, Lee C, Desprez F, Nakada H, Tanaka Y. The end-user and middleware APIs for GridRPC. Workshop on Grid Application Programming Interfaces, in Conjunction with GGF12, Brussels, Belgium, September 2004.
- 2 Caron E, Desprez F. Diet: A scalable toolbox to build network enabled servers on the grid. International Journal of High Performance Computing Applications 2006; 20(3): 335–352.
- 3 DIET. Distributed Interactive Engineering Toolbox. http://graal.ens-lyon.fr/DIET [ 2007].
- 4 Dail H, Desprez F. Experiences with hierarchical request flow management for network-enabled server environments. International Journal of High Performance Computing Applications 2006; 20(1): 143–157.
- 5 Arbenz P, Gander W, Mori J. The remote computational system. Parallel Computing 1997; 23(10): 1421–1428.
- 6 Matsuoka S, Nakada H, Sato M, Sekiguchi S. Design issues of network enabled server systems for the grid. Grid Forum, Advanced Programming Models Working Group Whitepaper, 2000.
- 7 Arnold D, Agrawal S, Blackford S, Dongarra J, Miller M, Sagi K, Shi Z, Vadhiyar S. Users' guide to NetSolve v1.4. Computer Science Department Technical Report 2001, CS-01-467, University of Tennessee, Knoxville, TN, July 2001. http://www.cs.utk.edu/netsolve/.
- 8 Nakada H, Sato M, Sekiguchi S. Design, implementations of Ninf: Towards a global computing infrastructure. Future Generation Computing Systems, Metacomputing Issue 1999; 15(5–6): 649–658. Available at: http://ninf.apgrid.org/papers/papers.shtml.
- 9 Sato M, Boku T, Takahasi D. OmniRPC: A grid RPC system for parallel programming in cluster and grid environment. Proceedings of CCGrid2003, Tokyo, May 2003; 206–213.
- 10 Arnold DC, Casanova H, Dongarra J. Innovations of the NetSolve grid computing system. Concurrency and Computation: Practice and Experience 2002; 14: 1–23.
- 11 Tanaka Y, Nakada N, Sekiguchi S, Suzumura T, Matsuoka S. Ninf-G: A reference implementation of RPC-based programming middleware for grid computing. Journal of Grid Computing 2003; 1: 41–51.
10.1023/A:1024083511032 Google Scholar
- 12 Tanaka Y, Takemiya H, Nakada H, Sekiguchi S. Design, implementation and performance evaluation of GridRPC programming middleware for a large-scale computational grid. Proceedings of 5th IEEE/ACM International Workshop on Grid Computing, Pittsburgh, U.S.A., 2004; 298–305.
- 13 Shirasuna S, Nakada H, Matsuoka S, Sekiguchi S. Evaluating web services based implementations of GridRPC. Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing (HPDC-11 2002), Edinburgh, Scotland, July 2002; 237–245. Available at: http://matsu-www.is.titech.ac.jp/∼sirasuna/research/hpdc2002/hpdc2002.pdf.
- 14 Nakada H, Tanaka Y, Matsuoka S, Sekiguchi S. The design and implementation of a fault-tolerant RPC system: Ninf-C. Proceeding of HPC Asia, Omiya Sonic City, Tokyo Area, Japan, 2004; 9–18.
- 15 Denis A, Perez C, Priol T. Towards high performance CORBA and MPI middlewares for grid computing. Proceedings of the 2nd International Workshop on Grid Computing, Denver, CO, U.S.A., November 2001, CA Lee (ed.) ( Lecture Notes in Computer Science, vol. 2242). Springer: Berlin, 2001; 14–25.
10.1007/3-540-45644-9_3 Google Scholar
- 16 Quinson M. Dynamic performance forecasting for network-enabled servers in a metacomputing environment. International Workshop on Performance Modeling, Evaluation, and Optimization of Parallel and Distributed Systems (PMEO-PDS'02), in Conjunction with IPDPS'02, Fort Lauderdale, FL, April 2002.
- 17 Legrand A, Marchal L, Casanova H. Scheduling distributed applications: The simgrid simulation framework. Third International Symposium on Cluster Computing and the Grid. IEEE Computer Society Press: Silver Spring, MD, 2003; 138.
- 18 Amin K, von Laszewski G, Hategan M, Zaluzec NJ, Hampton S, Rossi A. GridAnt: A client-controllable grid workflow system. HICSS, Big Island, HI, vol. 7, 2004; 70210c.
- 19 Oinn TM, Addis M, Ferris J, Marvin D, Greenwood RM, Carver T, Pocock MR, Wipat A, Li P. Taverna: A tool for the composition and enactment of bioinformatics workflow. Bioinformatics 2004; 20(17): 3045–3054.
- 20 Singh G, Deelman E, Mehta G, Vahi K, Su MH, Berriman GB, Good J, Jacob JC, Katz DS, Lazzarini A, Blackburn K, Koranda S. The pegasus portal: Web based grid computing. SAC '05: Proceedings of the 2005 ACM Symposium on Applied Computing. ACM Press: New York, NY, U.S.A., 2005; 680–686.
10.1145/1066677.1066834 Google Scholar
- 21 Condor Team. The directed acyclic graph manager. http://www.cs.wisc.edu/condor/dagman [ 2006].
- 22 LogService. http://graal.ens-lyon.fr/DIET/logservice.html [ 2006].
- 23 Bolze R, Caron E, Desprez F, Hoesch G, Pontvieux C. A monitoring and visualization tool and its application for a network enabled server platform. Computational Science and its Applications—ICCSA 2006, Glasgow, U.K., 8–11 May 2006, M Gavrilova et al. (eds.) ( Lecture Notes in Computer Science, vol. 3984). Springer: Berlin, 2006; 202–213.
- 24 Cappello F, Caron E, Dayde M, Desprez F, Jeannot E, Jegou Y, Lanteri S, Leduc J, Melab N, Mornet G, Namyst R, Primet P, Richard O. Grid'5000: A large scale, reconfigurable, controllable and monitorable grid platform. SC'05: Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing Grid'2005, Seattle, U.S.A., 13–14 November 2005. IEEE Press/ACM: New York, 2005; 99–106.
- 25 Caron E, Chouhan PK, Dail H. Godiet: A deployment tool for distributed middleware on grid'5000. EXPGRID Workshop. Experimental Grid Testbeds for the Assessment of Large-Scale Distributed Applications and Tools. In Conjunction with HPDC-15, Paris, France. IEEE Press: New York, June 2006; 1–8.
- 26 Capit N, Da Costa G, Georgiou Y, Huard G, Martin C, Mounié G, Neyron P, Richard O. A batch scheduler with high level components. Cluster Computing and Grid 2005 (CCGrid05), Cardiff, U.K., 2005.
- 27 Carey L, Darling AE, Feng W-C. The design, implementation, and evaluation of mpiblast. ClusterWorld 2003, 2003.
- 28 Bjornson RD, Sherman AH, Weston SB, Willard N, Wing J. Turboblast: A parallel implementation of blast based on the turbohub process integration architecture. Parallel and Distributed Processing Symposium, Proceedings International, IPDPS, Fort Lauderdale, FL, TurboGenomics, Inc., 2002; 183–190.
10.1109/IPDPS.2002.1016583 Google Scholar
- 29 Braun RC, Pedretti KT, Casavant TL, Scheetz TE, Birkett CL, Roberts CA. Parallelization of local BLAST service on workstation clusters. Future Generation Computer Systems 2001; 17(6): 745–754.
- 30 Wang C, Alqaralleh BA, Zhou BB, Till M, Zomaya AY. A BLAST service built on data indexed overlay network. e-Science, 2005; 16–23.
- 31 Mathog DR. Parallel BLAST on split databases. Bioinformatics 2003; 19(14): 1865–1866.
