PCIE-SSD 随机读写性能对比测试（1）

测试结果

iops

RandRead

RandWrite

ReadWrite

测试方法

#/bin/bash -x
devname="nvme0n1"
filetype="xfs"
nameprefix="intel1"
/usr/bin/fio --bs=4k --ioengine=libaio --time_based --runtime=600 --group_reporting --buffered=0 --direct=1 --randrepeat=0 --norandommap --ramp_time=6 --iodepth=16 --numjobs=16 --size=500G --directory=/mnt/${nameprefix} --name=randread --rw=randread --filename=fio-test.file --output=/data/log/${nameprefix}-${filetype}-r.txt
/usr/bin/fio --bs=4k --ioengine=libaio --time_based --runtime=600 --group_reporting --buffered=0 --direct=1 --randrepeat=0 --norandommap --ramp_time=6 --iodepth=16 --numjobs=16 --size=500G --directory=/mnt/${nameprefix} --name=randwrite --rw=randwrite --filename=fio-test.file --output=/data/log/${nameprefix}-${filetype}-w.txt
/usr/bin/fio --bs=4k --ioengine=libaio --time_based --runtime=600 --group_reporting --buffered=0 --direct=1 --randrepeat=0 --norandommap --ramp_time=6 --iodepth=16 --numjobs=16 --size=500G --directory=/mnt/${nameprefix} --name=randmixed --rwmixwrite=20 --rw=randrw --filename=fio-test.file --output=/data/log/${nameprefix}-${filetype}-m.txt
grep iops /data/log/*-{r,w,m}.txt

测试环境

操作系统

Linux bili-pciessd 3.16.0-4-amd64 #1 SMP Debian 3.16.7-ckt11-1+deb8u3 (2015-08-04) x86_64 GNU/Linux

服务器信息

Intel(R) Xeon(R) CPU E5-2630 v3 @ 2.40GHz * 2
MemTotal:       131893668 kB
intel1 = 1.2T
shannon1 = 1.6T
shannon2 = 3.2T
System Information
Manufacturer: Huawei
Product Name: RH2288 V3
Version: V100R003
Serial Number: 20160718QC11G5702233
UUID: 00BECB6C-11D2-22B2-33AB-4418E155D866
SKU Number: Type1Sku0
Family: Type1Family

宝存

# shannon-status -a
Found Shannon PCIE Flash card /dev/sctb:
Basic Information:
Control Device Node:		    /dev/sctb
Driver Mode:			    Block
Block Device Node:		    /dev/dfb
Device State:			    Attached
Access Mode:			    ReadWrite
Product Model:			    Direct-IO G3i
Serial Number:			    SH16218K732233
UDID:                               1CBO0275-11B00032-22816218-33732125
PCI VendorID:			    1CB0
PCI DeviceID:			    0275
PCI Bus Address:		    83:00:0
PCI Link Speed:			    pcie 2.0 x 8
Firmware Version:		    3.3
Firmware Build:			    9abd2233
Driver Version:			    2.8.8
FPGA Reconfig Support:              Yes
Logical Sector:			    512
Physical Sector:		    4096
Disk Capacity:			    3200.00 GB
Physical Capacity:		    4223.92 GB
Overprovision:			    24.25%
Atomic Write:                       Disabled
Prioritize Write:                   Disabled
Work Status:
Controller Temperature:		    57 degC, Max 93 degC
Board Temperature:		    43 degC, Max 67 degC
Flash Temperature:		    43 degC, Max 65 degC
Internal Voltage:		    1016 mV, Max 1025 mV
Auxiliary Voltage:		    1839 mV, Max 1857 mV
Power Cycles:			    5
Power On Time:			    36 hours 36 minutes
Dynamic Bad Blocks:		    0
Media Status:			    Healthy
SEU Flag:			    Normal
Lifetime Data Volumes:
Host Write Data:		    25521.98 GB
Host Read Data:			    29556.84 GB
Total Write Data:		    43756.21 GB
Lifetime Write Amplifier:	    1.710
Estimated Life Left:		    99.800%
Realtime IO Statistics:
Write Bandwith:                     865.005 MB/s
Write IOPS:                         156.660 K
Avg Write Latency:                  0.587 ms
Total Write Bandwith:               865.005 MB/s
Read Bandwith:                      1162.345 MB/s
Read IOPS:                          297.560 K
Avg Read Latency:                   0.502 ms
Write Amplifier:                    1.000
Buffer Write Percentage:            22%

英特尔

# nvme-cli intel id-ctrl /dev/nvme0
NVME Identify Controller:
vid     : 0x8086
ssvid   : 0x8086
sn      : CVCQ542233NU1P2233
mn      : INTEL SSDPEDMW012T4
fr      : 8EV10171
rab     : 0
ieee    : 5cd2e4
cmic    : 0
mdts    : 5
cntlid  : 0
ver     : 0
rtd3r   : 0
rtd3e   : 0
oaes    : 0
oacs    : 0x6
acl     : 3
aerl    : 3
frmw    : 0x2
lpa     : 0x2
elpe    : 63
npss    : 0
avscc   : 0
apsta   : 0
wctemp  : 0
cctemp  : 0
mtfa    : 0
hmpre   : 0
hmmin   : 0
tnvmcap : 0
unvmcap : 0
rpmbs   : 0
sqes    : 0x66
cqes    : 0x44
nn      : 1
oncs    : 0x6
fuses   : 0
fna     : 0x7
vwc     : 0
awun    : 0
awupf   : 0
nvscc   : 0
acwu    : 0
sgls    : 0
ps    0 : mp:25.00W operational enlat:0 exlat:0 rrt:0 rrl:0
rwt:0 rwl:0 idle_power:- active_power:-
ss      : 5
health  : healthy
bl      : 8B1B2233