Testing SFS Turbo Performance
Fio is an open-source I/O tester. You can use fio to test the throughput and IOPS of SFS Turbo file systems.
Prerequisites
Fio has been installed on the ECS. It can be downloaded from the official website or from GitHub.
Note and Description
The test performance depends on the network bandwidth between the client and server, as well as the capacity of the file system.
Installing fio
The following uses a Linux CentOS system as an example:
- Download fio.
yum install fio
- Install the libaio engine.
yum install libaio-devel
- Check the fio version.
fio --version
File System Performance Data
The performance metrics of SFS Turbo file systems include IOPS and throughput. For details, see Table 1.
Parameter | Previous-generation File System | HPC | ||||
|---|---|---|---|---|---|---|
Standard | Performance | 20 MB/s/TiB | 40 MB/s/TiB | 125 MB/s/TiB | 250 MB/s/TiB | |
Max. capacity | 32 TB | 32 TB | 1 PB | 1 PB | 1 PB | 1 PB |
Max. IOPS | 5,000 | 20,000 | 250,000 | 250,000 | 1 million | 1 million |
Max. throughput | 150 MB/s | 350 MB/s | 8 GB/s | 8 GB/s | 20 GB/s | 20 GB/s |
IOPS calculation formula | IOPS = Min. [5,000, (1,200 + 6 x Capacity)] Capacity unit: GB | IOPS = Min. [20,000, (1,500 + 20 x Capacity)] Capacity unit: GB | IOPS = Min. (250,000, 600 x Capacity) Capacity unit: TB | IOPS = Min. (250,000, 1,200 x Capacity) Capacity unit: TB | IOPS = Min. (1,000,000, 6,000 x Capacity) Capacity unit: TB | IOPS = Min. (1,000,000, 12,500 x Capacity) Capacity unit: TB |
Common Test Configuration Example
The following estimated values are obtained from the test on a single ECS. You are advised to use multiple ECSs to test the performance of SFS.
In the following examples, SFS Turbo Performance and ECSs with the following specifications are used for illustration.
Specifications: General computing-plus | c3.xlarge.4 | 4 vCPUs | 16 GB
Image: CentOS 7.5 64-bit
- fio command:
fio --randrepeat=1 --ioengine=libaio --name=test -output=output.log --direct=1 --filename=/mnt/nfs/test_fio --bs=1M --iodepth=128 --size=10240M --readwrite=rw --rwmixwrite=30 --fallocate=none
Note/mnt/nfs/test_fio indicates the location of the file to be tested. The location must be specific to the file name, which is the test_fio file in the /mnt/nfs directory in this example. Set it based on the site requirements.
- fio result:
- fio command:
fio --randrepeat=1 --ioengine=libaio --name=test -output=output.log --direct=1 --filename=/mnt/nfs/test_fio --bs=1M --iodepth=128 --size=10240M --readwrite=rw --rwmixwrite=70 --fallocate=none
Note/mnt/nfs/test_fio indicates the location of the file to be tested. The location must be specific to the file name, which is the test_fio file in the /mnt/nfs directory in this example. Set it based on the site requirements.
- fio result:
Sequential read IOPS
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=read --bs=4k --size=1G --iodepth=128 --runtime=120 --numjobs=10
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
Random read IOPS
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=randread --bs=4k --size=1G --iodepth=128 --runtime=120 --numjobs=10
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
Sequential write IOPS
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=write --bs=4k --size=1G --iodepth=128 --runtime=120 --numjobs=10
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
Random write IOPS
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=randwrite --bs=4k --size=1G --iodepth=128 --runtime=120 --numjobs=10
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
Sequential read bandwidth
- fio command:
fio --randrepeat=1 --ioengine=libaio --name=test -output=output.log --direct=1 --filename=/mnt/sfs-turbo/test_fio --bs=1M --iodepth=128 --size=10240M --readwrite=read --fallocate=none
Note/mnt/sfs-turbo/test_fio indicates the location of the file to be tested. The location must be specific to the file name, which is the test_fio file in the /mnt/sfs-turbo directory in this example. Set it based on the site requirements.
- fio result:
Random read bandwidth
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=randread --bs=1M --size=10G --iodepth=128 --runtime=120 --numjobs=1
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
Sequential write bandwidth
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=write --bs=1M --size=10G --iodepth=128 --runtime=120 --numjobs=1
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
Random write bandwidth
- fio command:
fio --ioengine=libaio --direct=1 --fallocate=none --time_based=1 --group_reporting=1 --name=iops_fio --directory=/mnt/sfs-turbo/ --rw=randwrite --bs=1M --size=10G --iodepth=128 --runtime=120 --numjobs=1
NoteVariable /mnt/sfs-turbo/ is the local path where the file to be tested is stored. Set it to the actual file name.
- fio result:
- Prerequisites
- Note and Description
- Installing fio
- File System Performance Data
- Common Test Configuration Example