Evaluation of the results carry heavily database servers on the storage system (SAN) EMC Symmetrix VMAX

===>

Korol Oleg, Head of Network Team, 2011

Scheduled to migrate data (5 servers) located at a number of EOS/EOL storages – 2xIBM DS4100, IBM DS4800

• Configuration of IBM DS410014хHDD 400GB SATA (each)

• Configuration of IBM DS4800dual-controller 1815-82A14хEXP810224xHDD different models 73GB 15K 4Gb FC/ 146GB 10K 2Gb FC/ 146GB 15K 4Gb FC(6 of them HotSpare)120xHDD used to accommodate the most "severe" DBMS ABS B2 and DWHthe remaining available 98хHDD used to accommodate data from 32 servers who have not participated in the migration to new storage

• Configuration of EMC Symmetrix VMAX1xVMAX engine 200xHDD 300GB 15K 4Gb FC9xEFD 200GB(8xHDD и 1хEFD HotSpare)

*EFD – Enterprise Flash Drive (SSD)

Migrating data on storage EMC Symmetrix VMAX 2

Previously held a series of tests to determine the characteristics of both SSD performance when using R5 and VMAX in general

• We used the following test configurationsIBM DS4800 4xR1(5+5) 15K 144GB FC2/4EMC V-MAX 4 metas (total 48 H-Vols, protection 2M)EMC V-MAX 2 LUNs from SSD-pool, protection R5 (3+1)

• Synthetic test, 100% Random, R/W = 80/20

Migrating data on storage EMC Symmetrix VMAX 3

for DWH hot tablespaces (60% of all readings in the database is in the region less than 10%) were submitted to separate LUN, located on the SSD

• This screenshot is presented disk performance is productive database, which confirmed the results of previously conducted synthetic tests SSD

• 438.4K/27.4K= average 16KB block size

Migrating data on storage EMC Symmetrix VMAX 4

DWH (Oracle 10, OLAP), Disks Latency in msec, less - is better16x times less latency

Before (IBM DS4800) After (EMC VMAX)

Migrating data on storage EMC Symmetrix VMAX 5

0:00

:14

0:50

:15

1:40

:15

2:30

:15

3:20

:16

4:10

:15

5:00

:16

5:50

:16

6:40

:15

7:30

:17

8:20

:16

9:10

:17

10:0

0:17

10:5

0:18

11:4

0:17

12:3

0:17

13:2

0:18

14:1

0:19

15:0

0:19

15:5

0:18

16:4

0:19

17:3

0:18

18:2

0:20

19:1

0:19

20:0

0:20

20:5

0:20

21:4

0:20

22:3

0:22

23:2

0:21

0

20

40

60

80

100

120

140

160

180

Disk Service Time msec/xfer kvhowh2 9/14/2010

hdisk0 hdisk1 hdisk10 hdisk2 hdisk4hdisk5 hdisk6 hdisk7 hdisk8 hdisk9

0:00

:09

0:50

:10

1:40

:10

2:30

:10

3:20

:11

4:10

:11

5:00

:11

5:50

:12

6:40

:11

7:30

:11

8:20

:12

9:10

:12

10:0

0:12

10:5

0:13

11:4

0:13

12:3

0:13

13:2

0:14

14:1

0:14

15:0

0:13

15:5

0:14

16:4

0:14

17:3

0:14

18:2

0:15

19:1

0:15

20:0

0:15

20:5

0:16

21:4

0:16

22:3

0:16

23:2

0:16

0

1

2

3

4

5

6

7

8

9

10

Disk Service Time msec/xfer kvhowh2 12/29/2010

hdisk15 hdisk17 hdisk14 hdisk16 hdisk18 hdisk4hdisk10 hdisk9 hdisk0 hdisk11 hdisk3 hdisk5

DWH (Oracle 10, OLAP), Disks Performance iops/MBps, more - is better1.5x more MBps and 4.5x more iops

Before (IBM DS4800) After (EMC VMAX)

Migrating data on storage EMC Symmetrix VMAX 6

0:00

:14

1:00

:15

2:00

:15

3:00

:15

4:00

:16

5:00

:16

6:00

:16

7:00

:17

8:00

:17

9:00

:17

10:0

0:17

11:0

0:18

12:0

0:17

13:0

0:18

14:0

0:17

15:0

0:19

16:0

0:19

17:0

0:19

18:0

0:20

19:0

0:20

20:0

0:20

21:0

0:21

22:0

0:21

23:0

0:21

0

100000

200000

300000

400000

500000

600000

0

1000

2000

3000

4000

5000

6000

7000

8000

9000

Disk total KB/s kvhowh2 - 9/14/2010

Disk Read KB/s Disk Write KB/s IO/sec

KB

/sec

IO/s

ec

0:00

:09

1:00

:10

2:00

:10

3:00

:10

4:00

:10

5:00

:11

6:00

:12

7:00

:11

8:00

:12

9:00

:12

10:0

0:12

11:0

0:13

12:0

0:13

13:0

0:14

14:0

0:14

15:0

0:13

16:0

0:14

17:0

0:14

18:0

0:14

19:0

0:14

20:0

0:15

21:0

0:16

22:0

0:16

23:0

0:16

0

100000

200000

300000

400000

500000

600000

700000

800000

900000

0

5000

10000

15000

20000

25000

30000

35000

40000

Disk total KB/s kvhowh2 - 12/29/2010

Disk Read KB/s Disk Write KB/s IO/sec

KB

/sec

IO/s

ec

ABS (Oracle 10, OLTP/OLAP), Disks Latency in msec, less - is better

Before (IBM DS4800) After (EMC VMAX)

Migrating data on storage EMC Symmetrix VMAX 7

0:00

:16

0:50

:17

1:40

:18

2:30

:18

3:20

:19

4:10

:20

5:00

:21

5:50

:21

6:40

:22

7:30

:23

8:20

:24

9:10

:23

10:0

0:24

10:5

0:24

11:4

0:25

12:3

0:24

13:2

0:25

14:1

0:26

15:0

0:26

15:5

0:27

16:4

0:26

17:3

0:27

18:2

0:27

19:1

0:28

20:0

0:29

20:5

0:30

21:4

0:32

22:3

0:33

23:2

0:33

0

20

40

60

80

100

120

140

160

180

Disk Service Time msec/xfer kvhoB2 9/14/2010

hdisk13 hdisk14 hdisk5 hdisk6 hdisk3hdisk2 hdisk7 hdisk10 hdisk9 hdisk12hdisk11 hdisk8 hdisk0 hdisk1 cd0

0:01

:19

0:51

:20

1:41

:21

2:31

:21

3:21

:21

4:11

:22

5:01

:21

5:51

:22

6:41

:22

7:31

:22

8:21

:23

9:11

:23

10:0

1:24

10:5

1:24

11:4

1:24

12:3

1:24

13:2

1:25

14:1

1:25

15:0

1:25

15:5

1:25

16:4

1:26

17:3

1:26

18:2

1:25

19:1

1:26

20:0

1:26

20:5

1:26

21:4

1:27

22:3

1:26

23:2

1:27

0

2

4

6

8

10

12

14

16

Disk Service Time msec/xfer kvhoB2 2/1/2011

hdisk1 hdisk2 hdisk19 hdisk21 hdisk20hdisk15 hdisk16 hdisk0 cd0

ABS (Oracle 10, OLTP/OLAP), Disks Performance iops/MBps, more - is better

Before (IBM DS4800) After (EMC VMAX)

Migrating data on storage EMC Symmetrix VMAX 8

0:00

:16

1:00

:17

2:00

:18

3:00

:19

4:00

:20

5:00

:21

6:00

:21

7:00

:22

8:00

:23

9:00

:23

10:0

0:24

11:0

0:24

12:0

0:25

13:0

0:24

14:0

0:25

15:0

0:26

16:0

0:26

17:0

0:26

18:0

0:27

19:0

0:27

20:0

0:29

21:0

0:31

22:0

0:33

23:0

0:33

0

20000

40000

60000

80000

100000

120000

140000

160000

0

1000

2000

3000

4000

5000

6000

7000

Disk total KB/s kvhoB2 - 9/14/2010

Disk Read KB/s Disk Write KB/s IO/sec

KB

/sec

IO/s

ec

0:01

:19

0:56

:20

1:51

:21

2:46

:21

3:41

:21

4:36

:22

5:31

:21

6:26

:22

7:21

:22

8:16

:23

9:11

:23

10:0

6:24

11:0

1:24

11:5

6:24

12:5

1:24

13:4

6:24

14:4

1:24

15:3

6:25

16:3

1:25

17:2

6:26

18:2

1:25

19:1

6:26

20:1

1:26

21:0

6:26

22:0

1:27

22:5

6:27

23:5

1:27

0

100000

200000

300000

400000

500000

600000

700000

0

2000

4000

6000

8000

10000

12000

14000

16000

18000

Disk total KB/s kvhoB2 - 2/1/2011

Disk Read KB/s Disk Write KB/s IO/sec

KB

/sec

IO/s

ec

Overall Disks Performance iops/MBps 5 servers after migrate then to EMC VMAX

Migrating data on storage EMC Symmetrix VMAX 9

16:2

616

:27

16:2

916

:30

16:3

216

:33

16:3

516

:36

16:3

816

:39

16:4

116

:42

16:4

416

:45

16:4

716

:48

16:5

016

:51

16:5

316

:54

06:0

007

:30

09:0

010

:30

12:0

013

:30

15:0

016

:30

0.0

10000.0

20000.0

30000.0

40000.0

50000.0

60000.0

EMC VMAX Disk Transfers/sec by Time of Day (all nodes)

16:2

616

:27

16:2

916

:30

16:3

216

:33

16:3

516

:36

16:3

816

:39

16:4

116

:42

16:4

416

:45

16:4

716

:48

16:5

016

:51

16:5

316

:54

06:0

007

:30

09:0

010

:30

12:0

013

:30

15:0

016

:30

0.0

200000.0

400000.0

600000.0

800000.0

1000000.0

1200000.0

EMC Disk MBytes/sec by Time of Day (all nodes)

Annex

• All hosts running on IBM Power under AIX 5.3• To conduct synthetic tests have been used ndisk64, from the package nstress• For data collection tool used NMON• For processing and visualization of statistical data used NMON Analyser and

NMON Consolidator

Questions?

IT-Expert@Ukr.Nethttp://ua.linkedin.com/pub/oleg-korol/26/920/716

Migrating data on storage EMC Symmetrix VMAX 10