Abstract
The Integrated Forecast System (IFS) code is a parallel MPI application running on multiple tasks, a specified number of which, during its execution, writes output to a single global file at the end of several output time intervals. It can therefore write output multiple times during a given run. With the appropriate choice of parallel writing routine the overhead of writing to disk can be effectively hidden from the computation. We shall show how this is possible with careful use of MPI-IO routines on top of the IBM General Parallel File System (GPFS).
Chapter PDF
Similar content being viewed by others
References
Barros, S. R. M., Dent D., Isaksen, I., Robinson, G., Mozdzynski, G., Wollen-wever, F., The IFS model: a parallel production weather code. Parallel Computing, 21 No. 10 (1995) 1621–1638.
The IFS Model Overview and Parallelisation Strategies, Proceedings of the 6th ECMWF workshop, 1994. ISBN 981-01-2211-4.
Message Passing Interface Forum, MPI-2: Extensions to the Message-Passing Interface, July 1997. http://www.mpi-forum.org/docs/docs.html.
Gropp, W., Lusk, E., and Thakur, R., Using MPI-2: Advanced Features of the Message-Passing Interface. MIT Press, Cambridge, MA, 1999.
The GPFS parallel file system: http://www.almaden.ibm.com/cs/gpfs-spsort.html.
The Network File System (NFS): http://www.nfsv4.org/
The IBM SP system: http://www.rs6000.ibm.com/hardware/largescale/SP/index.html
Kotz, D. and Nieuwejaar, N., Dynamic file-access characteristics of a production parallel scientific workload. In Proceedings of Supercomputing’ 94, 640–649, (1994). IEEE Computer Society Press.
Nieuwejaar, N., Kotz, D., Purakayastha, A., Schlatter Ellis, C., and Best, M., File-access characteristics of parallel scientific workloads. IEEE Transactions on Parallel and Distributed Systems, 7(10) (1996) 1075–1089.
Smirni, E., and Reed, D. A., Lessons from characterizing the input/output behavior of parallel scientific applications. Performance Evaluation: An International Journal, 33(1) (1998) 27–44.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Allsopp, N.K., Hague, J.F., Prost, JP. (2001). Experiences in Using MPI-IO on Top of GPFS for the IFS Weather Forecast Code. In: Sakellariou, R., Gurd, J., Freeman, L., Keane, J. (eds) Euro-Par 2001 Parallel Processing. Euro-Par 2001. Lecture Notes in Computer Science, vol 2150. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44681-8_55
Download citation
DOI: https://doi.org/10.1007/3-540-44681-8_55
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42495-6
Online ISBN: 978-3-540-44681-1
eBook Packages: Springer Book Archive