“GRID” Bricks

Components (NARA I brick)

AIC RMC4E2-QI-XPSS 4U w/SATA Raid Controllers:• 3ware - mirrored root disks (2)

• Areca - data disks, battery backed cache, raid6 Storage:

• 24 x 400Gb drives (Hitachi 7200RPM, 8mb)

• Two raid groups, 11 drives + 1 spare, 3.6Tb each Tyan i7501R motherboard, 1G ram, Intel Xeon

2.4Ghz, 500mhz FSB. RedHat Enterprise Linux 4

Performance - write

write-raid6-ext3

0

20000

40000

60000

80000

100000

120000

140000

segment size

kB

/se

c

Write 0 0 0 0 119435 107828 117402 114608 105681 105823 92926 117003 120600

Re-Writer 0 0 0 0 92849 103871 92579 91300 96886 87994 105792 104039 99446

Random Write 0 0 0 0 22452 25267 34731 47492 62492 68612 89761 90899 87497

Fwrite 0 0 0 0 118291 100904 96561 99346 98434 89435 93319 96996 103393

Re-Fwrite 0 0 0 0 96129 99419 97722 112718 115209 103224 86693 107431 98637

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Performance - read

read-raid6-ext3

0

50000

100000

150000

200000

250000

300000

segment size

kB

/se

c

Reader 0 0 0 0 210743 211772 213934 201363 166321 163613 175420 179892 173703

Re-Reader 0 0 0 0 226094 250376 197442 209938 158072 191384 168845 158148 192426

Random Read 0 0 0 0 13547 22939 17961 28276 45637 74885 99634 133650 153137

Backward Read 0 0 0 0 22292 28256 30189 39055 46572 63848 86526 102789 126184

Stride Read 0 0 0 0 11407 19925 16418 18963 32793 59683 108831 117026 130035

Fread 0 0 0 0 215119 201830 207776 185427 177242 163046 170464 171482 171436

Re-Fread 0 0 0 0 257303 249565 235838 182254 192866 157247 185837 190871 190025

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Components (3ware brick)

Chenbro 2U RM215 460W SATA Server Chassis RM21508T-460 SATA

Raid Controllers:• 3ware - raid 5, battery backed

Storage:• 8 x 400Gb drives (Hitachi 7200RPM, 8mb)

• One raid set, standalone root disk (80gb) TYAN S5350G2NR SSI CEB Server Motherboard RedHat Enterprise Linux 4

Performance - write

write - cache

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

100000

segment size

kb/s

ec

Writer 0 0 0 0 60766 68521 64793 69168 64741 74688 63939 66875 62291

Re-writer 0 0 0 0 54758 85975 68440 63620 69335 85039 68464 61715 55365

Random Write 0 0 0 0 18927 35670 30136 42484 55569 58043 62006 63172 62136

Fwrite 0 0 0 0 60026 70941 73357 59653 73224 59871 71986 73307 59223

Re-fwrite 0 0 0 0 64718 64680 70434 62880 73126 69535 65318 60125 56309

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Performance - read

read - cache

0

20000

40000

60000

80000

100000

120000

140000

segment size

kb/s

ec

Reader 0 0 0 0 95447 94152 88776 89325 89547 88978 89578 89161 89716

Re-reader 0 0 0 0 95762 93886 90442 89462 90033 88347 89779 88777 89608

Random Read 0 0 0 0 13471 23571 21497 27979 39613 60622 79818 92682 114301

Backward Read 0 0 0 0 15668 22009 22803 28167 34925 48827 49328 57571 82511

Stride Read 0 0 0 0 12080 18098 25311 23371 31477 46213 61509 74354 85472

Fread 0 0 0 0 75835 76064 70958 79779 73262 70692 71541 78817 81393

Re-fread 0 0 0 0 96412 94398 90260 90166 90079 90272 89835 89015 90021

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Comparison w/ other bricksRead

0

50000

100000

150000

200000

250000

segment size

kB

/se

c

r6-ext3 0 0 0 0 210743 211772 213934 201363 166321 163613 175420 179892 173703

IDE-FC 0 0 0 0 42699 42022 40780 40708 40382 40366 40374 41056 40802

FasT 0 0 0 0 19022 18860 19177 18884 18614 18553 18433 22310 18674

3ware 0 0 0 0 87451 87477 85690 15033 85054 85151 85233 85196 85112

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Write

0

20000

40000

60000

80000

100000

120000

140000

segment size

kB

/se

c

Areca 0 0 0 0 119435 107828 117402 114608 105681 105823 92926 117003 120600

IDE-FC 0 0 0 0 45362 56697 60575 64580 51272 65336 51487 63078 49562

FastT 0 0 0 0 11951 13337 15564 16967 15080 17193 17588 17415 15976

3ware 0 0 0 0 43474 44099 33461 45767 44738 46713 36230 40257 42744

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Random Read

0

20000

40000

60000

80000

100000

120000

140000

160000

180000

segment size

kB

/se

c

r6-ext3 0 0 0 0 13547 22939 17961 28276 45637 74885 99634 133650 153137

IDE-FC 0 0 0 0 8976 14552 13115 16924 24920 33202 41977 47457 51421

FasT 0 0 0 0 9822 15278 17056 21088 23932 26553 27040 27615 28462

3ware 0 0 0 0 10375 17730 19201 21047 33737 42722 51016 56470 58189

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384

Random Write

0

10000

20000

30000

40000

50000

60000

70000

80000

90000

100000

segment size

kB

/se

c

r6-ext3 0 0 0 0 22452 25267 34731 47492 62492 68612 89761 90899 87497

IDE-FC 0 0 0 0 26524 42134 43313 39456 48126 60741 53719 61526 63477

FasT 0 0 0 0 7587 10203 10723 17344 16678 19570 20256 15056 17107

3ware 0 0 0 0 13003 20256 22210 32611 45375 59731 31837 40365 36013

4 8 16 32 64 128 256 512 1024 2048 4096 8192 16384