测试环境：

CPU:Kunpeng 920 8Core
MEM:16G
Storage:200G
OS:openEuler 20.03 (LTS-SP3)

1 文件系统性能测试工具——IOZone

1.1 编译安装——IOZone

1. 安装IOZone环境

yum install gcc -y

2. 源码编译安装

   下载源码：

wget http://www.iozone.org/src/current/iozone3_490.tar

解压编译：

tar -xvf iozone3_490.tar
cd iozone3_490/src/current
make linux

3. 添加环境变量（可选）

vi /etc/profile

export PATH=$PATH:/root/iozone3_490/src/current

source /etc/profile

1.2 验证与运行——IOZone

1. 执行如下命令，查看IOZone版本

./iozone -v
或
iozone -v

返回内容如下所示，表示安装已经完成：

[root@controller current]# ./iozone -v
       'Iozone' Filesystem Benchmark Program

        Version $Revision: 3.489 $
        Compiled for 64 bit mode.

       Original Author: William Norcott (wnorcott@us.oracle.com)
               4 Dunlap Drive
               Nashua, NH 03060

       Enhancements: Don Capps (capps@iozone.org)
                  7417 Crenshaw
                  Plano, TX 75025

  Copyright 1991, 1992, 1994, 1998, 1999, 2002   William D. Norcott

  License to freely use and distribute this software is hereby granted
  by the author, subject to the condition that this copyright notice
  remains intact.  The author retains the exclusive right to publish
  derivative works based on this work, including, but not limited to,
  revised versions of this work

  Other contributors:

  Don Capps       (Network Appliance)   capps@iozone.org

2. 运行

1）自动测试示例

iozone -a

返回结果：

[root@controller ~]# iozone -a
        Iozone: Performance Test of File I/O
                Version $Revision: 3.489 $
                Compiled for 64 bit mode.
                Build: linux

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                     Alexey Skidanov, Sudhir Kumar.

        Run began: Tue Jan  3 15:03:49 2023

        Auto Mode
        Command line used: iozone -a
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
              64       4  1105556  2561267  4018152  5389653  3958892  2278628  2203800   2278628   2892445  2358717  3203069  2689580  3958892
              64       8  1679761  3588436  5735102  7100397  5860307  3203069  2662899   3022727   3791156  3165299  4564786  2772930  4988978
              64      16  1780008  6421025  4274062  7940539  7100397  4018152  2662899   3791156   3738358  3588436  3791156  3203069  7100397
              64      32  2203800  4564786  6421025 10402178 10821524  4274062  2892445   4564786   4274062  4897948  7100397  3791156  6421025
              64      64  2467108  3022727 10821524 15972885 10402178  4274062  2892445   2203800   3363612  3958892  4564786  2067979  7940539
             128       4  1504659  3199360  4135958  4717434  3867787  2920861  2453642   3036502   2985839  3053774  2905056  3053774  4717434
             128       8  2132084  4759253  4889281  7476717  5325799  4233807  3297617   4135958   5122535  4267461  4267461  3445772  5325799
             ... ...
          524288    1024  4594096  8072304  7216636  7197127  7336685  7767907  7125324  12993227   7278839  5628234  5248919  7336685  7347913
          524288    2048  4464044  7782340  7137535  7054464  7189597  7570287  6944127  12187086   7159285  5076514  5158843  7099857  7192866
          524288    4096  4366079  6849604  6693649  6665164  6785228  6922747  6868067  10548857   6864208  4655950  4484701  6773670  6715952
          524288    8192  4332062  6910065  6074267  5818509  6284992  6736320  6271763   8857714   6301453  4122507  4098336  6433771  6415657
          524288   16384  3813115  5729983  5865441  5846401  5867945  6176011  6083711   6866630   6086321  4079557  3884570  6105246  6150945

iozone test complete.

其中IOZone输出的第一组包含标题信息，其中显示有关IOZone实用程序的信息，以及用于生成此报告的所有IOZone选项，如下所示。

		Iozone: Performance Test of File I/O
                Version $Revision: 3.489 $
                Compiled for 64 bit mode.
                Build: linux

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                     Alexey Skidanov, Sudhir Kumar.

        Run began: Tue Jan  3 15:03:49 2023

        Auto Mode
        Command line used: iozone -a
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.

输出的第二部分包含各种测试的输出值（以每秒为单位），如下所示。

第1列KB：表示用于测试的文件大小。

第2列reclen：表示用于测试的记录长度。

第3列直到最后一列：表示执行的各种测试及其每秒输出值。

                                                              random    random     bkwd    record    stride
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
              64       4  1105556  2561267  4018152  5389653  3958892  2278628  2203800   2278628   2892445  2358717  3203069  2689580  3958892
              64       8  1679761  3588436  5735102  7100397  5860307  3203069  2662899   3022727   3791156  3165299  4564786  2772930  4988978
              64      16  1780008  6421025  4274062  7940539  7100397  4018152  2662899   3791156   3738358  3588436  3791156  3203069  7100397
              64      32  2203800  4564786  6421025 10402178 10821524  4274062  2892445   4564786   4274062  4897948  7100397  3791156  6421025
              64      64  2467108  3022727 10821524 15972885 10402178  4274062  2892445   2203800   3363612  3958892  4564786  2067979  7940539
             128       4  1504659  3199360  4135958  4717434  3867787  2920861  2453642   3036502   2985839  3053774  2905056  3053774  4717434
             128       8  2132084  4759253  4889281  7476717  5325799  4233807  3297617   4135958   5122535  4267461  4267461  3445772  5325799
             128      16  2464907  5847904  5122535  6727225  7917784  5325799  3867787   5325799   6114306  4934216  4717434  4104338  6727225
             128      32  2905056  6727225  6812590  8548124  9129573  6727225  4267461   6812590   6045455  5325799  5847904  4934216  6727225
             128      64  3277486  7582312  8036304 11470204 10567140  6727225  4934216   7176872   5847904  7476717  7476717  5325799  7582312
             128     128  2969325  6114306 11720614 12542043 10779307  5847904  4267461   5847904   4717434  5603747  5122535  4104338  9129573
             256       4  1683493  3605511  4572895  4929815  4132864  3236056  3159869   3511189   3545976  3316006  3326279  4264168  4819184
             256       8  2350543  5687020  5971678  7073132  6107548  4840911  4496299   5320671   4819184  4907284  4998665  5217259  6936061
             256      16  3207059  5971678  6107548 10245071  7965107  6595234  4197489   7073132   8534922  6249745  6398720  4929815  8534922
             256      32  3756894  8815202  6249745  9868433  9868433  8208677  5117791   8888172   8534922  6891544  6891544  5347168  7314033
             256      64  3879045  9114515  8271916 11569783 11569783  8024634  5217259   8534922   7571923  6719046  7314033  5217259  9114515
             256     128  3454704 10651598 10245071 11569783 11207494  7120034  5117791   6891544   6398720  6936061  9434868  5428265  9518507
             256     256  3197509  6398720 12090911 13454450 11091721  6719046  5428265   6107548   5242734  6107548  7314033  5687020  9114515
             512       4  1723770  4000485  4494470  5760329  4228947  2665014  3459188   3736016   3877684  3604335  3628697  4494470  5278892
             512       8  2845081  6319739  6395018  7115451  5398323  5331314  4927617   6018636   5566231  5384786  5566231  5398323  7758090
             512      16  3822466  8665997  6571132  8992598  8394979  7871843  6086873   8528336   7211022  6086873  7620440  6551087  7435738
             512      32  4742616 10694336  7309196  9145790 10044089  9638369  6652558  11080601  10434519  8394979  8265729  5624545 10434519
             512      64  5019764 11683444  8665997 10044089 11374040 10434519  6571132  12797441  10434519  8562340  8665997  5624545  8265729
             512     128  4532414 10694336  8844453 11374040 12499490  8808176  5453155  10434519   9344779  7410080  8394979  6018636 10911694
             512     256  3388236  7540170  9468384 11943357 12427157  6571132  5807059   7647578   6821616  6086873  7647578  5807059 10485468
             512     512  3684733  6931711 11683444 12499490 12215097  6228097  5822804   6319739   5384786  6319739  6736026  5822804  9814569
             ... ...

2）输出结果至文件

iozone -a -b /home/output.xls

返回结果：

[root@controller ~]# iozone -a -b /home/output.xls
        Iozone: Performance Test of File I/O
                Version $Revision: 3.489 $
                Compiled for 64 bit mode.
                Build: linux

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                     Alexey Skidanov, Sudhir Kumar.

        Run began: Tue Jan  3 15:13:05 2023

        Auto Mode
        Command line used: iozone -a -b /home/output.xls
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
              64       4   926260  2203800  3363612  5389653  4018152  2379626  2203800   2467108   3363612  2358717  2467108  2662899  4274062
              64       8  1599680  3363612  4274062  7100397  5389653  3363612  2772930   3363612   4274062  3406295  3363612  3165299  6271021
              64      16  1933893  4274062  5735102  7940539  7100397  4274062  3203069   4274062   4564786  3738358  4018152  3791156  4643754
              64      32  2278628  5283570  7940539 12902017  9006179  4988978  3541098   4564786   4564786  5860307  5860307  4274062  4897948
              64      64  1679761  2662899 12902017 15972885 10821524  4274062  3363612   4564786   4274062  3958892  4564786  4018152  5283570
             ... ...
          524288     128  5960465 12585854  7441254  7099834  7229567 10373935  7156256  17236722   7254873  9898563  9810200  7422166  7418811
          524288     256  5934279 12283618  7373734  7251356  7429237 11072356  7365855  17585319   7425249  7569766  7425550  7486525  7501389
          524288     512  5100676 10063313  7459884  7352335  7379029  9355602  7198705  15406572   7431120  6169254  6030044  7347004  7292719
          524288    1024  4647370  7707384  7102356  6950382  7284215  7603346  7085833  13008676   7131239  5568940  5459792  7086792  7075710
          524288    2048  4547675  7683095  7019246  6961450  7135103  7444327  6884494  12397188   7014902  5121298  5110919  6983535  7160147
          524288    4096  4339987  7005449  6502315  6550486  6821430  6858812  6734607  10821229   6774963  4768028  4822051  6803807  6776884
          524288    8192  4310653  6741255  6391732  6164757  6436144  6854152  6398130   9452561   6428091  4566174  4516182  6388074  6363709
          524288   16384  3709410  6380679  5543209  5735931  6155128  6166797  6076029   8025696   6122431  4111162  3997956  5890138  5822901

iozone test complete.
Excel output is below:

"Writer report"
        "4"  "8"  "16"  "32"  "64"  "128"  "256"  "512"  "1024"  "2048"  "4096"  "8192"  "16384"
"64"   926260  1599680  1933893  2278628  1679761
"128"   1487977  2367096  2727923  3124872  3657016  2784517
"256"   1729594  2463808  3410808  4281170  4572895  3465855  3410808
"512"   1835760  2811557  3736016  4973263  5067142  4690818  4532414  4000485
"1024"   1852232  3085895  4228138  4876180  4943530  3894582  4570058  4211554  3955557
"2048"   1825390  2892423  4188565  5144271  5659442  5593112  5184636  4394265  4284671  4146110
"4096"   1945007  3031667  4249491  5320812  5883908  5721272  5306022  4853336  4470657  4471821  4128976
"8192"   1934800  3052081  4257814  5104089  5599873  5696426  5595314  4899570  4751854  4390568  4313404  3944043
"16384"   1905814  2954811  4197940  5350398  5925213  5951384  5756940  4931852  4738030  4585637  4329929  4082715  3263838
"32768"   0  0  0  0  5708592  5966577  5884069  4973940  4630098  4546020  4348122  4081722  3581209
"65536"   0  0  0  0  5565253  5905154  5818161  4806078  4417639  4450973  4266117  4090639  3547461
"131072"   0  0  0  0  5841269  5917728  5888255  5065995  4631831  4476044  4330224  4246077  3994859
"262144"   0  0  0  0  5859286  5926302  5907738  4801784  4685915  4429374  4302516  4206486  4163447
"524288"   0  0  0  0  5892995  5960465  5934279  5100676  4647370  4547675  4339987  4310653  3709410

... ...

"Re-Fread report"
        "4"  "8"  "16"  "32"  "64"  "128"  "256"  "512"  "1024"  "2048"  "4096"  "8192"  "16384"
"64"   4274062  6271021  4643754  4897948  5283570
"128"   3895854  7582312  5325799  8548124  7176872  8548124
"256"   4477549  6719046  7791708  8534922  9868433  8534922  8534922
"512"   5344582  6931711  8844453  9510316  9859630  11374040  10434519  10434519
"1024"   5593820  7927135  9320560  7160597  9569770  9569770  10689164  9569770  8750850
"2048"   4945823  7262337  8390200  8830061  10240672  11015480  11380325  11502234  11320334  9944290
"4096"   5204750  7463648  8939441  10036109  10344298  9846293  11164417  10190895  10580003  9846293  10112910
"8192"   5188093  7111158  7307775  6873589  7663074  7765253  9080735  9080735  5457560  7961372  7460092  6420214
"16384"   4647665  5783588  7304517  7324760  7360851  7553412  8130744  7443774  7692072  7406867  6995911  6301760  5797250
"32768"   0  0  0  0  7378557  7410384  7576232  7249728  7311047  6907241  6431154  6293048  5654573
"65536"   0  0  0  0  7160739  7273863  7381689  7378518  7197866  6840855  6357203  6435793  6006972
"131072"   0  0  0  0  7197376  7242701  7454032  7331073  7317607  6986455  6503538  6120311  5980689
"262144"   0  0  0  0  7205102  7431251  7444282  7443879  7314482  7104724  6431253  6442785  6104606
"524288"   0  0  0  0  7137257  7418811  7501389  7292719  7075710  7160147  6776884  6363709  5822901

3）在测试过程中指定测试类型、文件大小、测试的记录大小等

iozone -i 0 -i 1 -s 1024 -r 32

参数说明：

-i
	指定测试类型，可进行叠加，具体参数如下：
	0=write/rewrite
	1=read/re-read
	2=random-read/write
	3=Read-backwards
	4=Re-write-record
	5=stride-read
	6=fwrite/re-fwrite
	7=fread/Re-fread
	8=random mix
	9=pwrite/Re-pwrite
	10=pread/Re-pread
	11=pwritev/Re-pwritev
	12=preadv/Re-preadv

-s	
	指定文件大小，而不是对所有文件大小运行测试。默认情况下，iozone 会自动创建大小从 64k 到 512M 的临时文件，以执行各种测试。iozone 输出中的第一列（带有列标题 KB）表示文件大小。它从 64KB 文件开始，并且会不断增加直到 512M（每次文件大小都翻倍）。
	
-r
	指定要测试的记录大小，对于特定的文件大小，它会使用从 4k 到 16M 的不同记录大小进行测试，reclen 代表记录长度。对于 1024KB 的文件大小，iozone 测试使用从 4k 到 16M 的各种记录大小来执行写入测试。

返回结果：

[root@controller ~]# iozone -i 0 -i 1 -s 1024 -r 32
        Iozone: Performance Test of File I/O
                Version $Revision: 3.489 $
                Compiled for 64 bit mode.
                Build: linux

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                     Alexey Skidanov, Sudhir Kumar.

        Run began: Tue Jan  3 15:24:56 2023

        File size set to 1024 kB
        Record Size 32 kB
        Command line used: iozone -i 0 -i 1 -s 1024 -r 32
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
            1024      32  4287225 10039528  7054742  9064828

iozone test complete.

4）进行吞吐量测试

iozone -t 2

参数说明：

要为所有测试类型执行吞吐量，可以直接使用-t指令，注意-a与-t指令不能并存。
-i可以与-t并存，用于指定对应的测试类型以及对应的线程。

返回结果：

[root@controller ~]# iozone -t 2
        Iozone: Performance Test of File I/O
                Version $Revision: 3.489 $
                Compiled for 64 bit mode.
                Build: linux

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                     Alexey Skidanov, Sudhir Kumar.

        Run began: Tue Jan  3 15:34:12 2023

        Command line used: iozone -t 2
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
        Throughput test with 2 processes
        Each process writes a 512 kByte file in 4 kByte records

        Children see throughput for  2 initial writers  = 2722164.38 kB/sec
        Parent sees throughput for  2 initial writers   =   61073.84 kB/sec
        Min throughput per process                      = 1349799.88 kB/sec
        Max throughput per process                      = 1372364.50 kB/sec
        Avg throughput per process                      = 1361082.19 kB/sec
        Min xfer                                        =     436.00 kB

        ... ...
        Children see throughput for  2 freaders         = 6420061.75 kB/sec
        Parent sees throughput for  2 freaders          = 2579861.00 kB/sec
        Min throughput per process                      = 3140488.00 kB/sec
        Max throughput per process                      = 3279573.75 kB/sec
        Avg throughput per process                      = 3210030.88 kB/sec
        Min xfer                                        =     512.00 kB



iozone test complete.

1.3 其他——IOZone

1. IOZone源码仓库

http://www.iozone.org/src/current/

2. IOZone文档

   IOZone自带，路径如下：

iozone3_490/docs

3. 详细参数

 Usage: iozone [-s filesize_kB] [-r record_size_kB] [-f [path]filename] [-h]
                  [-i test] [-E] [-p] [-a] [-A] [-z] [-Z] [-m] [-M] [-t children]
                  [-l min_number_procs] [-u max_number_procs] [-v] [-R] [-x] [-o]
                  [-d microseconds] [-F path1 path2...] [-V pattern] [-j stride]
                  [-T] [-C] [-B] [-D] [-G] [-I] [-H depth] [-k depth] [-U mount_point]
                  [-S cache_size] [-O] [-L cacheline_size] [-K] [-g maxfilesize_kB]
                  [-n minfilesize_kB] [-N] [-Q] [-P start_cpu] [-e] [-c] [-b Excel.xls]
                  [-J milliseconds] [-X write_telemetry_filename] [-w] [-W]
                  [-Y read_telemetry_filename] [-y minrecsize_kB] [-q maxrecsize_kB]
                  [-+u] [-+m cluster_filename] [-+d] [-+x multiplier] [-+p # ]
                  [-+r] [-+t] [-+X] [-+Z] [-+w percent dedupable] [-+y percent_interior_dedup]
                  [-+C percent_dedup_within] [-+a zero_pct]  [-+Q dedup granule size]
                  [-+M dedup+compress flag ]

           -a  Auto mode
           -A  Auto2 mode
           -b Filename  Create Excel worksheet file
           -B  Use mmap() files
           -c  Include close in the timing calculations
           -C  Show bytes transferred by each child in throughput testing
           -d #  Microsecond delay out of barrier
           -D  Use msync(MS_ASYNC) on mmap files
           -e  Include flush (fsync,fflush) in the timing calculations
           -E  Run extension tests
           -f filename  to use
           -F filenames  for each process/thread in throughput test
           -g #  Set maximum file size (in kBytes) for auto mode (or #m or #g)
           -G  Use msync(MS_SYNC) on mmap files
           -h  help
           -H #  Use POSIX async I/O with # async operations
           -i #  Test to run (0=write/rewrite, 1=read/re-read, 2=random-read/write
                 3=Read-backwards, 4=Re-write-record, 5=stride-read, 6=fwrite/re-fwrite
                 7=fread/Re-fread, 8=random_mix, 9=pwrite/Re-pwrite, 10=pread/Re-pread
                 11=pwritev/Re-pwritev, 12=preadv/Re-preadv)
           -I  Use VxFS VX_DIRECT, O_DIRECT,or O_DIRECTIO for all file operations
           -j #  Set stride of file accesses to (# * record size)
           -J #  milliseconds of compute cycle before each I/O operation
           -k #  Use POSIX async I/O (no bcopy) with # async operations
           -K  Create jitter in the access pattern for readers
           -l #  Lower limit on number of processes to run
           -L #  Set processor cache line size to value (in bytes)
           -m  Use multiple buffers
           -M  Report uname -a output
           -n #  Set minimum file size (in kBytes) for auto mode (or #m or #g)
           -N  Report results in microseconds per operation
           -o  Writes are synch (O_SYNC)
           -O  Give results in ops/sec.
           -p  Purge on
           -P #  Bind processes/threads to processors, starting with this cpu
           -q #  Set maximum record size (in kBytes) for auto mode (or #m or #g)
           -Q  Create offset/latency files
           -r #  record size in Kb
              or -r #k .. size in kB
              or -r #m .. size in MB
              or -r #g .. size in GB
           -R  Generate Excel report
           -s #  file size in Kb
              or -s #k .. size in kB
              or -s #m .. size in MB
              or -s #g .. size in GB
           -S #  Set processor cache size to value (in kBytes)
           -t #  Number of threads or processes to use in throughput test
           -T  Use POSIX pthreads for throughput tests
           -u #  Upper limit on number of processes to run
           -U  Mount point to remount between tests
           -v  version information
           -V #  Verify data pattern write/read
           -w  Do not unlink temporary file
           -W  Lock file when reading or writing
           -x  Turn off stone-walling
           -X filename  Write telemetry file. Contains lines with (offset reclen compute_time) in ascii
           -y #  Set minimum record size (in kBytes) for auto mode (or #m or #g)
           -Y filename  Read  telemetry file. Contains lines with (offset reclen compute_time) in ascii
           -z  Used in conjunction with -a to test all possible record sizes
           -Z  Enable mixing of mmap I/O and file I/O
           -+b #,#  burst size (KB),sleep between burst (mili-second)
           -+E Use existing non-Iozone file for read-only testing
           -+F Truncate file before write in thread_mix_test
           -+J Include think time (-j #) in throughput calculation
           -+K Sony special. Manual control of test 8.
           -+m  Cluster_filename   Enable Cluster testing
           -+d  File I/O diagnostic mode. (To troubleshoot a broken file I/O subsystem)
           -+u  Enable CPU utilization output (Experimental)
           -+x # Multiplier to use for incrementing file and record sizes
           -+p # Percentage of mix to be reads
           -+r Enable O_RSYNC|O_SYNC for all testing.
           -+t Enable network performance test. Requires -+m
           -+n No retests selected.
           -+k Use constant aggregate data set size.
           -+q Delay in seconds between tests.
           -+l Enable record locking mode.
           -+L Enable record locking mode, with shared file.
           -+B Sequential mixed workload.
           -+D Enable O_DSYNC mode.
           -+A #  Enable madvise. 0 = normal, 1=random, 2=sequential
                                  3=dontneed, 4=willneed
           -+N Do not truncate existing files on sequential writes.
           -+S # Dedup-able data is limited to sharing within each numerically
                 identified file set.
           -+W # Add this value to the child thread ID, so that additional files
                 can be added while maintaining the proper dedupability with previously
                 existing files that are within the same seed group (-+S).
           -+V Enable shared file. No locking.
           -+X Enable short circuit mode for filesystem testing ONLY
               ALL Results are NOT valid in this mode.
           -+Z Enable old data set compatibility mode. WARNING.. Published
               hacks may invalidate these results and generate bogus, high
               values for results.
           -+w ## Percent of dedup-able data in buffers.
           -+y ## Percent of dedup-able within & across files in buffers.
           -+C ## Percent of dedup-able within & not across files in buffers.
           -+a ## Percent of data that is compressible.
           -+Q ## Dedup granule size.
           -+H Hostname    Hostname of the PIT server.
           -+P Service     Service  of the PIT server.
           -+z Enable latency histogram logging.
           -+M Enable Dedup+compress option. (Experimental).
           -+R enable iozone to take filenames from a file.