Abstract
Efficient data storage, a major concern in the modern computer industry, is mostly provided today by traditional magnetic disks. However, the cost of a disk transfer (measured in processor cycles) continues to increase with time, making disk accesses increasingly expensive. In this paper we describe the design, implementation and evaluation of a Network RamDisk device that uses main memory of remote workstations as a faster‐than‐disk storage device. In our study we propose various reliability policies, making the device tolerant to single workstation crashes. We show that the Network RamDisk is portable, flexible, and can operate under any of the existing Unix file systems. The Network RamDisk has been implemented both on the Linux and the Digital Unix operating systems, as a block device driver without any modifications to the kernel code. Using several real applications and benchmarks, we measure the performance of the Network RamDisk over an Ethernet and an ATM network, and find it to be usually four to eight times better than the magnetic disk. In one benchmark, our system was two orders of magnitude faster than the disk. We believe that a Network RamDisk can be efficiently used to provide reliable low‐latency access to files that would otherwise be stored on magnetic disks.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
D.C. Anderson, J.S. Chase, S. Gadde, A.J. Gallatin, K.G. Yocum and M.J. Feeley, Cheating the I/O bottleneck: Network storage with Trapeze/Myrinet, in: Proceedings of the USENIX 1998 Annual Technical Conference, USENIX Association, Berkeley, USA, 15–19 June 1998, pp. 143-154.
T.E. Anderson, D.E. Culler and D.A. Patterson, A case for NOW (Networks Of Workstations), IEEE Micro 15(1) (February 1995) 54-64.
T.E. Anderson, M.D. Dahlin, J.M. Neefe, D.A. Patterson, D.S. Roselli and R.Y. Wang, Serverless network file systems. ACM Transactions on Computer Systems 14(1) (February 1996) 41-79.
G. Bernard and S. Hamma, Remote memory paging in networks of workstations, in: Proceedings of the SUUG International Conference on Open Systems: Solutions for Open Word (April 1994).
M. Blumrich, K. Li, R. Alpert, C. Dubnicki, E. Felten and J. Sandberg, Virtual memory mapped network interface for the SHRIMP multicomputer, in: Proc. 21th International Symposium on Comp. Arch., Chicago, IL (April 1994) pp. 142-153.
N.J. Boden, D. Cohen and W.-K. Su, Myrinet: A Gigabit-per-second Local Area Network, IEEE Micro 15(1) (February 1995) 29.
A. Brown and M. Seltzer, Operating system benchmarking in the wake of Lmbench: A case study of the performance of NetBSD on the Intel x86 architecture, in: Proceedings of the 1997 ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems, Seattle, AW (June 1997) pp. 214-224.
G. Buzzard, D. Jacobson, M. Mackey, S. Marovich and J. Wilkes, An implementation of the Hamlyn sender-managed interface architecture, in: Second Symposium on Operating System Design and Implementation (October 1996) pp. 245-259.
D. Comer and J. Griffioen, A new design for distributed systems: the remote memory model, in: Proceedings of the USENIX Summer Conference (1990) pp. 127-135.
T. Cortes, S. Girona and J. Labarta, PACA: A cooperative file system cache for parallel machines, in: 2nd International Euro-Par Conference (Euro-Par'96), Lecture Notes in Computer Science, Vol. 1123 (1996) pp. 477-486.
M. Dahlin, Serverless network file systems, Ph.D. thesis, UC Berkeley (December 1995).
M.D. Dahlin, R.Y. Wang, T.E. Anderson and D.A. Patterson, Cooperative caching: Using remote client memory to improve file system performance, in: First Symposium on Operating System Design and Implementation (1994) pp. 267-280.
M.J. Feeley, W.E. Morgan, F.H. Pighin, A.R. Karlin, H.M. Levy and C.A. Thekkath, Implementing global memory management in a workstation cluster, in: Proc. 15th Symposium on Operating Systems Principles (December 1995) pp. 201-212.
E.W. Felten and J. Zahorjan, Issues in the implementation of a remote memory paging system, Technical Report 91-03-09, Computer Science Department, University of Washington (November 1991).
D.P. Ghormley, D. Petrou and T.E. Anderson, SLIC: Secure loadable interposition code, URL: http://now.CS.Berkeley.EDU/Slic/.
R. Gillett, Memory channel network for PCI, IEEE Micro 16(1) (February 1996) 12-18.
J. Hartman and J. Ousterhout, The zebra striped network file system, in: Proc. 14th Symposium on Operating Systems Principles (December 1993) pp. 29-43.
L. Iftode, K. Li and K. Petersen, Memory servers for multicomputers, in: Proceedings of COMPCON 93 (1993) pp. 538-547.
D.V. James, A.T. Laundrie, S. Gjessing and G.S. Sohi, Scalable coherent interface, IEEE Computer 23(6) (June 1990) 74-77.
E.K. Lee and C.A. Thekkath, Petal: Distributed virtual disks, in: Seventh International Conference on Architectural Support for Programming Languages and Operating Systems, Cambridge, MA, 1–5 October 1996, pp. 84-92. ACM Press.
E.P. Markatos and G. Dramitinos, Implementation of a reliable remote memory pager, in: Proceedings of the 1996 Usenix Technical Conference (January 1996) pp. 177-190.
E.P. Markatos and M. Katevenis, Telegraphos: High-performance networking for parallel processing on workstation clusters, in: Proceedings of the Second International Symposium on High-Performance Computer Architecture (February 1996) pp. 144-153.
J.N. Matthews, D. Roselli, A.M. Costello, R.Y. Wang and T.E. Anderson, Improving the performance of log-structured file systems with adaptive methods, in: Proc. 16th Symposium on Operating Systems Principles (October 1997).
A.K. McKusick, K.J. Karels and K. Bostic, A pageable memory based filesystem, in: Proceedings of the Summer 1990 Usenix Technical Conference (June 1990) pp. 137-145.
M. Rosenblum and J.K. Ousterhout, The design and implementation of a log-structured file system, ACM Transactions on Computer Systems 10(1) (February 1992) 26-52.
C. Ruemmler and J. Wilkes, UNIX disk access patterns, in: Proceedings of the Winter'93 USENIX Conference (January 1993) pp. 405-420.
B.N. Schilit and D. Duchamp, Adaptive remote paging for mobile computers, Technical Report CUCS-004-91, University of Columbia (1991).
M. Seltzer, M.K. McKusick, K. Bostic and C. Staelin, An implementation of a log-structured file system for unix, in: Proceedings of the 1995 Winter Usenix Technical Conference, San Diego, CA (January 1993).
D. Stodolsky, M. Holland, W.V. Courtright II and G.A. Gibson, Parity logging disk arrays, ACM Transactions on Computer Systems 12(3) (August 1994) 206-235.
T. von Eicken, D.E. Culler, S.C. Goldstein and K.E. Schauser, Active Messages: a Mechanism for Integrated Communication and Computation, in: Proc. 19th International Symposium on Comp. Arch., Gold Coast, Australia (May 1992) pp. 256-266.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Flouris, M.D., Markatos, E.P. The Network RamDisk: Using remote memory on heterogeneous NOWs. Cluster Computing 2, 281–293 (1999). https://doi.org/10.1023/A:1019051330479
Issue Date:
DOI: https://doi.org/10.1023/A:1019051330479