Abstract
This paper presents the development and implementation of a zero-copy file transfer mechanism that improves the efficiency of file transfers for PC cluster systems using hardware-based VIA (Virtual Interface Architecture) network adapters. VIA is one of the representative user-level communication interfaces, but because there is no library for file transfer, one copy occurs between kernel buffer and user buffers. Our mechanism presents a file transfer primitive that does not require the file system to be modified and allows the NIC to transfer data from the kernel buffer to the remote node directly without copying. To do this, we have developed a hardware-based VIA network adapter, which supports the PCI 64bit/66MHz bus and Gigabit Ethernet, as a NIC, and implemented a zero-copy file transfer mechanism. The experimental results show that the overhead of data coy and context switching in the sender is greatly reduced and the CPU utilization of the sender is reduced to 30% ~ 40% of the VIA send/receive mechanism. We demonstrate the performance of the zero-copy file transfer mechanism experimentally, and compare the results with those from existing file transfer mechanisms.
This work was supported by the Regional Research Centers Program(Research Center for Logistics Information Technology), granted by the Korean Ministry of Education & Human Resources Development.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Stancevic, D.: Zero Copy I: User-Mode Perspective. Linux Journal 2003(105) (January 2003)
Tranter, J.: Exploring The Sendfile System Call. Linux Gazette (91) (June 2003)
Fadele, O.: A Performance Comparison of read and mmap, http://developers.sun.com/solaris/articles/read_mmap.html
von Eicken, T., Basu, A., Buch, V., Vogels, W.: U-Net: A User-level Network Interface for Parallel and Distributed Computing. In: Proc, of the 15thACM Symposium on Operating Systems Principles (SOSP), Colorado, December 3-6 (1995)
Virtual Interface Architecture Specification, http://www.viarch.org/
Bozeman, P., Saphir, B.: A Modular High Performance implementation of the Virtual Interface Architecture. In: Proc. Of the 2nd Extreme Linux Workshop (June 1999)
InfiniBandTM Architecture, http://www.infinibandta.org/
DAFS Collaborabive, Direct Access File System Protocol, Version 1.0 (September 2001), http://www.dafscollaborative.org
Feforova, A., Seltzer, M., Magoutis, K., Addetia, S.: Application performance on the Direct Access File System. In: ACM SIGSOFT Software Engineering Notes, Proc. of the 4th international workshop on Software and Performance, vol. 29 (January 2004)
Shepler, S., et al.: NFS version 4 Protocol, Internet Engineering Task Force RFC3010 (December 2000)
Park, S., Sang-Hwa C., Lee, B.: Implementation and Performance Study of a Hardware-VIA-based Network Adapter on Gigabit Ethernet. Journal of Systems Architecture 51 October-November (2005)
M-VIA Core Release 1.2, http://old-www.nersc.gov/research/FTG/via/
Hellwagner, H., Ohlenroth, M.: VI architecture communication features and performance on the Gigabit cluster LAN. Future Generation Computer Systems 18(3) (January 2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Park, S., Chung, SH., Yoon, IS. (2006). Development and Performance Study of a Zero-Copy File Transfer Mechanism for VIA-Based PC Cluster Systems. In: Gerndt, M., Kranzlmüller, D. (eds) High Performance Computing and Communications. HPCC 2006. Lecture Notes in Computer Science, vol 4208. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11847366_32
Download citation
DOI: https://doi.org/10.1007/11847366_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-39368-9
Online ISBN: 978-3-540-39372-6
eBook Packages: Computer ScienceComputer Science (R0)