Flash file system

A flash file system is a file system designed for storing files on flash memory–based storage devices. While flash file systems are closely related to file systems in general, they are optimized for the nature and characteristics of flash memory (such as to avoid write amplification), and for use in particular operating systems.

Overview

While a block device layer can emulate a disk drive so that a general-purpose file system can be used on a flash-based storage device, this is suboptimal for several reasons:

Erasing blocks: flash memory blocks have to be explicitly erased before they can be written to. The time taken to erase blocks can be significant, thus it is beneficial to erase unused blocks while the device is idle.
Random access: general-purpose file systems are optimized to avoid disk seeks whenever possible, due to the high cost of seeking. Flash memory devices impose no seek latency.
Wear leveling: flash memory devices tend to wear out when a single block is repeatedly overwritten; flash file systems are designed to spread out writes evenly.

Log-structured file systems have all the desirable properties for a flash file system.^[1] Such file systems include JFFS2 and YAFFS.

Because of the particular characteristics of flash memory, it is best used with either a controller to perform wear leveling and error correction or specifically designed flash file systems, which spread writes over the media and deal with the long erase times of NAND flash blocks. The basic concept behind flash file systems is: when the flash store is to be updated, the file system will write a new copy of the changed data over to a fresh block, remap the file pointers, then erase the old block later when it has time.

In practice, flash file systems are used only for Memory Technology Devices (MTDs), which are embedded flash memories that do not have a controller. Removable flash memory cards and USB flash drives have built-in controllers to manage MTD with dedicated algorithms,^[2]^[3] like wear leveling, bad block recovery, power loss recovery, garbage collection and error correction, so use of a flash file system has limited benefit. However, some flash file systems, such as APFS and F2FS, can be used on FTL-based flash devices such as SSD and eUFS.

Flash-based memory devices are becoming more prevalent as the number of mobile devices is increasing, the cost per memory size decreases, and the capacity of flash memory chips increases.

Origins

The earliest flash file system, managing an array of flash as a freely writable disk, was TrueFFS by M-Systems of Israel, presented as a software product in PC-Card Expo at Santa Clara, California, in July 1992 and patented in 1993.^[4]

One of the earliest flash file systems was Microsoft's FFS2, for use with MS-DOS, released in autumn 1992.^[5] FFS2 was preceded by an earlier product, called "FFS", which however fell short of being a flash file system, managing a flash array as write once read many (WORM) space rather than as a freely writable disk.

Around 1994, the PCMCIA, an industry group, approved the Flash Translation Layer (FTL) specification, based on the design of M-Systems' TrueFFS. The specification was authored and jointly proposed by M-Systems and SCM Microsystems, who also provided the first working implementations of FTL. Endorsed by Intel,^[6] FTL became a popular flash file system design in non-PCMCIA media as well.

Linux flash filesystems

JFFS, JFFS2 and YAFFS: JFFS was the first flash-specific file system for Linux, but it was quickly superseded by JFFS2, originally developed for NOR flash. Then YAFFS was released in 2002, dealing specifically with NAND flash, and JFFS2 was updated to support NAND flash too.

UBIFS: UBIFS has been merged since Linux 2.6.22^[7] in 2008. UBIFS has been actively developed from its initial merge.^[8] UBIFS has documentation hosted at infradead.org along with JFFS2 and MTD drivers. Some initial comparison show UBIFS with compression faster than F2FS.^[9]

LogFS: LogFS, another Linux flash-specific file system, is currently^[update] being developed to address the scalability issues of JFFS2.

F2FS: F2FS (Flash-Friendly File System) was added to the Linux kernel 3.8.^[10] Instead of being targeted at speaking directly to raw flash devices, F2FS is designed to be used on flash-based storage devices that already include a flash translation layer, such as SD cards.^[11]

Union filesystems

Overlayfs, Unionfs, and aufs are union filesystems, that allow multiple filesystems to be combined and presented to the user as a single tree. This allows the system designer to place parts of the operating system that are nominally read-only on different media to the normal read-write areas. OpenWrt is usually installed on raw flash chips without FTL. It uses overlayfs to combine a compressed read-only SquashFS with JFFS2.

Translation layers

References

^ Arnd Bergmann (2011-02-18). "Optimizing Linux with cheap flash drives". LWN.net. Retrieved 2013-01-26.
^ "Phison's USBkey controller PS2251-63". Archived from the original on 2011-07-28. Retrieved 2011-05-26.
^ OpenNFM: An open source NAND FTL for SSD and embedded storage module
^ US patent 5404485, "Flash file system, Amir Ban"
^ "Microsoft FFS2 patent". Archived from the original on 2016-12-19. Retrieved 2009-01-09.
^ "Understanding the Flash Translation Layer (FTL) Specification" (PDF). Intel. December 1998. Archived from the original (PDF) on 2014-07-19. Retrieved 2015-07-27.
^ Jonathan Corbet (2008-04-02). "UBIFS". LWN.
^ Richard Weinberger (2012-09-24). "UBI: Fastmap request for inclusion". LKML.
^ Neil Brown (2012-12-11). "JFFS2, UBIFS, and the growth of flash storage". LWN.
^ "Filesystems and storage". Kernel Log - Coming in 3.8. The H. 2013-01-21. Retrieved 2013-01-23.
^ Neil Brown (2012-10-10). "An f2fs teardown". LWN.net. Retrieved 2014-04-09.

External links

Presentation on various Flash File Systems – 2007-09-24
Article regarding various Flash File Systems – 2005 USENIX Annual Conference
Survey of various Flash File Systems – 2005-08-10
Anatomy of Linux Flash File Systems – 2008-05-20

[1] Arnd Bergmann (2011-02-18). "Optimizing Linux with cheap flash drives". LWN.net. Retrieved 2013-01-26.

[2] "Phison's USBkey controller PS2251-63". Archived from the original on 2011-07-28. Retrieved 2011-05-26.

[3] OpenNFM: An open source NAND FTL for SSD and embedded storage module

[autogenerated1-4] US patent 5404485, "Flash file system, Amir Ban"

[5] "Microsoft FFS2 patent". Archived from the original on 2016-12-19. Retrieved 2009-01-09.

[6] "Understanding the Flash Translation Layer (FTL) Specification" (PDF). Intel. December 1998. Archived from the original (PDF) on 2014-07-19. Retrieved 2015-07-27.

[7] Jonathan Corbet (2008-04-02). "UBIFS". LWN.

[8] Richard Weinberger (2012-09-24). "UBI: Fastmap request for inclusion". LKML.

[9] Neil Brown (2012-12-11). "JFFS2, UBIFS, and the growth of flash storage". LWN.

[10] "Filesystems and storage". Kernel Log - Coming in 3.8. The H. 2013-01-21. Retrieved 2013-01-23.

[11] Neil Brown (2012-10-10). "An f2fs teardown". LWN.net. Retrieved 2014-04-09.

[1]

[2]

[3]

[4]

[5]

[6]

[7]

[8]

[9]

[10]

[11]