Abstract
Developing applications for solving compute intensive problems is not trivial. Despite availability of a range of Grid computing platforms, domain specialists and scientists only rarely take advantage of these computing facilities. One reason for this is the complexity of Grid computing, and the need to learn a new programming environment to interact with the Grid. Typically, only a few programming languages are supported, and often scientists use special-purpose languages that are not supported by most Grid platforms. Moreover, users cannot easily deploy their compute tasks to multiple Grid platforms without rewriting their program to use different task submission interfaces.
In this paper we present Stroll, a universal filesystem-based interface for seamless task submission to one or more Grid facilities. Users interact with the Grid through simple read and write filesystem commands. Stroll allows all categories of users to submit and manage compute tasks both manually, and from within their programs, which may be written in any language. Stroll has been implemented on Windows and Linux, and we demonstrate that we can submit the same compute tasks to both Condor and Unicore clusters. Our evaluation shows the overhead of Stroll to negligible. Comparing the code complexity of a Stroll compute task with command-line clients and Grid APIs show that Stroll can eliminated up to 95% of the complexity.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Domingues, P., Marques, P., Silva, L.: Resource usage of windows computer laboratories. In: ICPP Workshops 2005, pp. 469–476 (2005)
Anderson, D.P.: Public Computing: Reconnecting People to Science. In: Shared Knowledge and the Web, Madrid, Spain (November 2003)
McConnell, B.: Beyond Contact: A Guide to SETI and Communicating with Alien Civilizations. O’Reilly (2001)
Bijsterbosch, M., et al.: DRIVER, Digital Repository Infrastructure Vision for European Research II. Technology Watch Report (December 2008)
Filesystem in userspace, http://fuse.sourceforge.net/
Callback File System (2011), http://www.eldos.com/cbfs/
Litzkow, M., Livny, M., Mutka, M.: Condor - a hunter of idle workstations. In: ICDCS (June 1988)
Erwin, D.W., Snelling, D.F.: Unicore: A grid computing environment. In: ECPP, pp. 825–834 (2001)
McCabe, T.J.: A complexity measure. IEEE Trans. Softw. Eng. (1976)
Halstead, M.H.: Elements of Software Science (Operating and programming systems series). Elsevier Science Inc., NY (1977)
Card, D.N., Agresti, W.W.: Measuring software design complexity. The Journal of Systems And Software 3(8) (June 1988)
Pike, R., et al.: The use of name spaces in Plan 9. SIGOPS Oper. Syst. Rev. 27(2), 72–76 (1993)
Wang, X.D., Yang, X., Allan, R.: Top ten questions to design a successful grid portal. In: SKG, pp. 18–24 (2006)
Saad, Y.: Iterative Methods for Sparse Linear Systems, 2nd edn. Society for Industrial and Applied Mathematics, Philadelphia (2003)
Abramson, D., Giddy, J., Kotler, L.: High performance parametric modeling with nimrod/g: Killer application for the global grid? (2000)
Goodale, T., et al.: Saga: A simple api for grid applications. high-level application programming on the grid. In: Comput. Methods in Science and Tech. (2006)
Herrera, J., Huedo, E., Montero, R.S., Llorente, I.M.: Developing grid-aware applications with drmaa on globus-based grids (2004)
Hagemeier, B., Menday, R., Schuller, B., Streit, A.: A universal api for grids. In: Cracow Grid Workshop (July 2007)
Chapman, C., et al.: Condor birdbath: Web service interfaces to condor. In: UK e-Science All Hands Meeting, Nottingham, UK (2005)
Grid ASCII Helper Protocol, http://www.cs.wisc.edu/condor/gahp/
Wegener, D., et al.: GridR: An R-based tool for scientific data analysis in grid environments. Future Gener. Comput. Syst. 25, 481–488 (2009)
R Development Core Team, R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria (2011)
Urbanek, S.: rJava: Low-Level R to Java Interface (2009), http://cran.r-project.org/package=rJava
Wilde, M., et al.: Swift: A language for distributed parallel scripting. Parallel Computing 37(9), 633–652 (2011)
Murray, D.G., Hand, S.: Scripting the cloud with skywriting (2010)
Morgan, M.M., Grimshaw, A.S.: Genesis ii - standards based grid computing. In: CCGRID, pp. 611–618 (2007)
Anjomshoaa, A., et al.: Job Submission Description Language Specification (2005)
van Hensbergen, E., Evans, N.P., Stanley-Marbell, P.: A unified execution model for cloud computing. In: LADIS (October 2009)
Thain, D., Livny, M.: Parrot: Transparent user-level middleware for data-intensive computing. Scalable Computing: Practice and Experience 6(3), 9–18 (2005)
Azab, A., Meling, H.: A Virtual File System Interface for Computational Grids. In: Aagesen, F.A., Knapskog, S.J. (eds.) EUNICE 2010. LNCS, vol. 6164, pp. 87–96. Springer, Heidelberg (2010)
Condor submit description file, http://www.cs.wisc.edu/condor/manual/v7.6/condor_submit.html
Batch processing, http://www.hpcx.ac.uk/support/documentation/#userguide/hpcxuser/batch_processing.html (retrieved 6, 2011)
Microsoft.Net (2011), http://www.microsoft.com/net/
Tierney, L., Rossini, A.J., Li, N., Sevcikova, H.: Snow: Simple Network of Workstations (November 2011)
Boyer, C.B.: A History of Mathematics, 2nd edn., p. 431. Wiley (1968)
Condor Java API, http://staff.aist.go.jp/hide-nakada/condor_java_api/
Bowbrick, S., Borg, A.: ECG complete. Churchill Livingstone (2006)
Safar, P.: History of cardiopulmonary-cerebral resuscitation. In: Cardiopulmonary Resuscitation, New York, pp. 1–53 (1989)
Klim, S., et al.: Population stochastic modelling (psm)-an r package for mixed-effects models based on stochastic differential equations. Comput. Methods Prog. Biomed. 94, 279–289 (2009)
Schuller, B., Demuth, B., Mix, H., Rasch, K., Romberg, M., Sild, S., Maran, U., Bała, P., del Grosso, E., Casalegno, M., Piclin, N., Pintore, M., Sudholt, W., Baldridge, K.K.: Chemomentum - UNICORE 6 Based Infrastructure for Complex Applications in Science and Technology. In: Bougé, L., Forsell, M., Träff, J.L., Streit, A., Ziegler, W., Alexander, M., Childs, S. (eds.) Euro-Par Workshops 2007. LNCS, vol. 4854, pp. 82–93. Springer, Heidelberg (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 IFIP International Federation for Information Processing
About this paper
Cite this paper
Azab, A., Meling, H. (2012). Stroll: A Universal Filesystem-Based Interface for Seamless Task Deployment in Grid Computing. In: Göschka, K.M., Haridi, S. (eds) Distributed Applications and Interoperable Systems. DAIS 2012. Lecture Notes in Computer Science, vol 7272. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30823-9_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-30823-9_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30822-2
Online ISBN: 978-3-642-30823-9
eBook Packages: Computer ScienceComputer Science (R0)