evolution of enterprise services in the statistics canada it environment silver buckler chief,...

29
Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services Division 15 – 16 April 2009

Post on 15-Jan-2016

215 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

Evolution of Enterprise Services in the

Statistics Canada IT Environment

Silver BucklerChief, Managed Storage SectionInformatics Technology Services Division15 – 16 April 2009

Page 2: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

2

Agenda

What is Enterprise Service Enterprise Service Drivers Enterprise Service Challenges Enterprise Service Offerings Enterprise Service Savings New Service offering – EFPS

Page 3: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

3

What is an Enterprise Service?

A purposeful or industrious undertaking

Organization created for business ventures

Readiness to embark on bold new ventures

A group of people who work together

Activity undertaken as part of a commercial enterprise

enterprise

organisation

organization

enterprisingness

go-ahead

initiative

drive

endeavour

endevour

labour

project

task

undertaking

fraudulent scheme

illegitimate enterpriseracket

commercial activity

business activityforlorn hope

Page 4: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

4

What is an Enterprise Service?

Work done by one person or group that benefits another

Act of help or assistance Employment or work for

another To be used by; as of a

utility

divine service

serviceemployment

religious service

accomodation

armed service

military service

disservice

inspection and repairoverhaul

table service

service of process

serving

servicing

activity

availhelp

aid

assist

assistancework

Service

Robert William Service

serve

company

tune tune up

Page 5: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

5

What is an Enterprise Service?

A service offering robust, high availability, and cost effective IT service promoting the use of IT best practices, while lowering the overall IT cost to the organization in the areas of hardware, support, management and risk.

Page 6: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

6

Enterprise Services – Drivers

Lower corporate risk (Security) High availability Lower corporate costs through economies of

scale Best practices Resource realignment Increased performance More effective use of resources Innovation (R&D)

Page 7: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

7

Enterprise Services – Challenges

Acceptance Short term cost Acquisition vehicles Planning Retention of skilled personnel Non-standard client requirements Reactivity (scope and impact of change) Maintaining integrity (data, service, relations) Impact of service failures

Page 8: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

8

Managed Storage Section Services

Enterprise Backup Service (cost recovery)• 7 x 24

• Standard Backup

• Extended Retention

Enterprise Storage Service (cost recovery)• 7 x 24

• Primary storage

• Secondary storage

Enterprise File and Print Service• 7 x 24

• Gateway to our other services

Page 9: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

9

Enterprise Service

Backup (& restore!)

Page 10: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

10

Enterprise Backup – Service

Enterprise Backup Service (EBS) Symantec (Veritas) and Sun (STK) Standard Backup (online) Extended Retention backup (online) Redundant copy in separate building Disk 2 disk capability Separate, dedicated network (Standard,10 GigE)

Page 11: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

11

Enterprise Backup – Evolution

Client Offerings 1999 – Standard backup policy

– 2 month full backup retention– 1 month weekly incremental retention– 1 week daily incremental retention

2003 – Clients allowed more latitude. End of standard backup. 2003 / 04 – Strategic Service Initiative (SSI) 2004 – Introduction of Extended Retention

Service Evolution 5 generations of media technology 3 generations of server technology 2 generations of media housing Several upgrades of network technology Introduction of Disk 2 Disk and data migration Multiple re-architectures

Page 12: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

12

Enterprise Backup

SunFire T2000

Sun

SunFire T2000

Sun

SunFire T2000

Sun

SunFire T2000

Sun

SunFire T2000

Sun

SunFire T2000

Sun

SunFire V480

Sun

Media Server Sun T2000

Tape SiloSun STK SL8500

Master ServerSun M5000

Cisco Switch

Cisco Switch

HDS USPVMDisk Array

Virtual Tape LibrarySun STK 3000

19 20 21 22 23 2417 1815 1613 147 8 9 10 11 125 63 41 2

MDS 9124 MULTILAYER FABRIC SWITCH

DS-C9124-K9RESET

CONSOLESTATUS

P/S

FAN

MGMT 10/100

Main Computer Centre

IBM Disk Arrays

System

Storage

DS

4700

4GB

/s2G

B/s

System

Storage

DS

4700

4GB

/s2G

B/s

19 20 21 22 23 2417 1815 1613 147 8 9 10 11 125 63 41 2

MDS 9124 MULTILAYER FABRIC SWITCH

DS-C9124-K9RESET

CONSOLESTATUS

P/S

FAN

MGMT 10/100

Media Server Sun T2000

Media Server Sun T2000

Media Server Sun T2000

Media Server Sun T2000

Media Server Sun T2000

Tape SiloSun STK SL8500

Jean Talon Building

Page 13: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

13

Enterprise Backup – Subscription

Enterprise Backup Service

0

100,000

200,000

300,000

400,000

500,000

600,000

700,000

800,000

11

-99

02

-00

05

-00

08

-00

11

-00

02

-01

05

-01

08

-01

11

-01

02

-02

05

-02

08

-02

11

-02

02

-03

05

-03

08

-03

11

-03

02

-04

05

-04

08

-04

11

-04

02

-05

05

-05

08

-05

11

-05

02

-06

05

-06

08

-06

11

-06

02

-07

05

-07

08

-07

11

-07

02

-08

05

-08

08

-08

11

-08

02

-09

Da

ta o

n T

ap

e (

Gig

ab

yte

s)

Page 14: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

14

Enterprise Backup – Rate History

EBS - Rate Reductions

100%

86%

69%

30%26%

17% 17% 17% 17% 16% 15%

0%

20%

40%

60%

80%

100%

120%

1999 2000 2001 2002 2003 2004 2005 2006 2007 2008 2009

Page 15: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

15

Enterprise Service

Storage

Page 16: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

16

Enterprise Storage – Service

Enterprise Storage Service (ESS) Hitachi Data System Arrays High speed, redundant fibre infrastructure

(Brocade and Cisco) Redundant connections from server to disks Primary FC/SAS drives, Secondary SATA Symantec Storage Foundation offered on

Windows

Page 17: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

17

Enterprise Storage – Service

Enterprise Storage Service (ESS) HDS (and others) Primary (Tier 1) Secondary (Tier 2)

Page 18: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

18

Enterprise Storage – Evolution

Client Primary Offerings 1999 – HDS 7700e

• Mainly ITSD Corporate clients 15TB at peak. 2002 – HP XP1024 (re-branded Hitachi)

• True beginning of service to all of STC 2005 – HDS USP1100 2008 – HDS USPV

Service Evolution 4 generations of Primary Storage Technology 3 generations of Secondary Storage Technology Individual drives grown from 36GB to 400GB Primary Individual drives grown from 250GB to 1000GB

Page 19: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

19

Enterprise Storage

Cache (More allows faster R/W access)

Raid Group 6+2

8-Port 4Gb FC CHA

AE135A

8-Port 4Gb FC CHA

AE135A

Cache Mem. Adapter AE151ACache Mem. Adapter AE151A

8GB Cache Mem. AE152A8GB Cache Mem. AE152A8GB Cache Mem. AE152A8GB Cache Mem. AE152A8GB Cache Mem. AE152A8GB Cache Mem. AE152A

300F 300F 300F 300F 300F 300F 300F 300F

SAN Array

Disk controller

Disk controller

Client Server

Page 20: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

20

Enterprise Storage – Subscription

ESS - Primary Storage

0

50

100

150

200

250

300

Apr

-02

Jul-0

2

Oct

-02

Jan-

03

Apr

-03

Jul-0

3

Oct

-03

Jan-

04

Apr

-04

Jul-0

4

Oct

-04

Jan-

05

Apr

-05

Jul-0

5

Oct

-05

Jan-

06

Apr

-06

Jul-0

6

Oct

-06

Jan-

07

Apr

-07

Jul-0

7

Oct

-07

Jan-

08

Apr

-08

Jul-0

8

Oct

-08

Jan-

09

TB

Page 21: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

21

Enterprise Storage – Rate History

ESS - Primary Storage Rate Reductions

100%

27% 27% 24%

9% 9% 9% 8% 7%

0%

20%

40%

60%

80%

100%

120%

2001 2002 2003 2004 2005 2006 2007 2008 2009

Page 22: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

22

Enterprise Storage – Rate History

ESS - Port Charge Rate Reductions

100%

81% 81%72%

51% 51% 51%42%

3%

0%

20%

40%

60%

80%

100%

120%

2001 2002 2003 2004 2005 2006 2007 2008 2009

Page 23: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

23

Enterprise Services – Cost Savings

Reduced productivity loss due to failed hardware Cooling, power and space for 10 storage arrays

rather than over 200 individual disk towers Cooling, power and space for 2 silos instead of

70 backup units Total overhead reduced (arrays and media

expansion when required instead of in advance) Storage space and tape media is reusable Resources consolidated

Page 24: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

24

Enterprise Services – Lessons

Management and client buy-in critical Skilled resources Planning and forecasting Accountability Flexibility Procurement vehicles must be established Simplicity

Page 25: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

25

Enterprise Services – File and Print

Service Creation (Lessons Used) Planning Scope User requirements Scalability Simplicity Future requirements EFPS planning used drivers and needs, not

technology

Page 26: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

26

EFS – What did we get?

EFS –What did we get? High availability Performance Flexibility

• Ability to dynamically respond to client disk requirements• Offering two tiers of disk subsystems

Robust• Managing over 90 TB of raw disk from multiple arrays and transparently

aggregating to a single usable system for bureau Consolidation of divisional servers to single pair of file serving devices Proven technology Reduction in server costs Consolidation of unstructured file services

Page 27: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

27

ES – Where are we going?

EBS ESS

Data Growth

4% Monthly

63% Yearly

0.7 PB 2009

1.2 PB 2012

1.6 PB 2015

3.6% Monthly

58% Yearly

0.3 PB 2009

0.5 PB 2012

0.7 PB 2015

Evolution2 - 3 Generations

Information Management

1 – 2 Generations

Information Management

TechnologyHow do we do more with less?

How do we reduce the impact of data growth?

Rates ? ?

Page 28: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

28

Enterprise Service Quality

We are up unless we plan not to be EBS – 98% success rate ESS – 99.999 uptime (5 minutes per year!) EFPS – 99.9% No data loss

We don’t offer Cadillac services – but we do offer a very nice Volvo.

Page 29: Evolution of Enterprise Services in the Statistics Canada IT Environment Silver Buckler Chief, Managed Storage Section Informatics Technology Services

29

Thank you

Questions?