powerha systemmirror for ibm i - schedschd.ws/hosted_files/discover2016/7c/507 - powerha... ·...

PowerHA for IBM i Solutions Portfolio

Allyn Walsh

Consulting IT Specialist

•Power Systems Strategic Initiatives

[email protected]

1

© Copyright IBM Corporation 2016.

Session objectives

• High Availability – General introduction

• PowerHA System Mirror for IBM i concepts

• High level comparison to Logical Replication

• 7.1 PowerHA SystemMirror for I

• 7.2 Enhancements

• PowerHA foundations

• Clusters

• IASP

• PowerHA Technologies

• Switchable IASP – single copy

• Data replication – two or more copies

• FlashCopy

• Mixing technologies

• Summary

2


PowerHA SystemMirror

Power Systems High Availability Solution For mission critical application availability through planned and unplanned outage events

Shared Storage Clustering Technology designed for automation and minimal IT operations.

Multi-Site Clustering for enterprise class availability

Embedded for integrated simplicity and reliability

3


PowerHA SystemMirror

� Complete IBM Power Systems integrated end to end solutions for HA DR

• Focus: 24 x 7 Application availability through planned or unplanned outage events

• Deeply integrated extension of IBM i (implemented in LIC and the OS)

� Clustering technology

• Provides the applications with a complete resiliency infrastructure

• Monitors and manages primary and secondary resources for HA and DR operations

� Storage based data resiliency

• Data resiliency is an extension of the host system storage management architecture

• Storage volumes are either switchable or mirrored between nodes in the cluster

• Hardware based replication services for Multi-Site Operations

• Host Based Replication (Geographic mirroring for IBM i, or GLVM for AIX)

• Storage Base Replication (Metro Mirror or Global Mirror)

� Overall solution characteristic

• Automation, minimal IT operations involvement

• Data between primary and secondary nodes always in sync always ready for a failover event

4


PowerHA Business Value & Objectives

• Provide IBM i Clients With Confidence & Certainly of Outcome

• PowerHA eliminates the classic logical replication dilemmas:

• Have we identified all of the objects that need to be replicated ?

• Are all of those objects in sync ? Should we or should we not failover ?

• ROI Acquisition and Cost of Ownership

• PowerHA is priced per processor core / CBU reduces total number of licenses required

• FlashCopy (save window elimination)

• Minimize operational expense through automation

• Enable best of breed performance and HA/DR metrics

• Provide HA/DR and application performance

• Exploit and integrate modern storage technology

• Eliminate single points of failure

• Enable RPO of 0 and best case RTO

• Native Embedded Technology for HA/DR Solutions

• PowerHA technology is an integrated extension of SLIC and IBM i

5


IBM i HA/DR Customer Profile

• Internal Disk

• Logical replication

• Role-swap = seldom if ever

• Backup window = ranges up to a few hours

• TCO = staffing, SWMA, upgrade charges,

• Staffing = dedicated specialist

• Outage management = complex

• Support = vendor

• IBM Storage or (Internal Disk with Geomirroring)

• Switchable LUNs, Metro or Global Mirroring with IBM SAN

• Role-swap = daily, weekly, monthly, quarterly

• Backup window = minutes (Flash Copy)

• TCO = minimal staffing, SWMA

• Staffing = minutes/week

• Outage management = simple

• Support = IBM

Legacy solution PowerHA

6


PowerHA for IBM i – HA solutions for the 21st Century

PowerHA storage based HA/DR solutions are based on shared storage configurations

PowerHA Solution

� Clustering technology implemented in SLIC eliminates complexity uncertainty

� Designed for automated role swap and failover operations

� Concurrent maintenance for OS upgrades, PTF applies, hardware maintenance

� Flashcopy eliminates backup by enabling save operations concurrent to production

� Operational simplicity staffing is a fraction of what is required with software replication

� IBM service and support

Logical replication solutions

� Complexity and time required to manage software replication

� Fear of failover associated with software replication tools

� Upgrade and maintenance $$$ of software

� Tape Backup takes too long

� Staffing required to manage software replication

� Service and Support

6

7


Who are our PowerHA for IBM i customers ?

• Over 1000 are clients with fewer than four processor cores.

• These customers typically are using PowerHA with geomirroring and internal disk

• About 20% of these are using ihosting i with geomirroring for a full system replication solution. Although the ihosting I with geomirring is classified as a disaster recovery solution, some clients prefer it because its relatively easy to set up and doesn’t require a cluster configuration where the database is separated out into an IASP.

• The customers using PowerHA with geomirroring are represented in every industry; municipalities, retail, distribution, banking, manufacturing

• The other half of the PowerHA on IBM i customers are using IBM storage servers.

• The DS8K implementations are LUG class customers who nearly always have at least two sites involved in the cluster and increasingly, three sites.

• The rest of the customers are using Storwize servers ranging from the V3700 on up to the SVC or the V9000. The V7000 has been the most popular in recent years.

• The motivation behind storage servers ranges from scalability, robustness, flash copy and the capability to support various combinations for HA and DR in a PowerHA cluster.

PowerHA for IBM I is installed in accounts ranging from small to very large enterprises. Virtually all of them (over 95% ) moved off of logical replication solutions.

8


Scotsburn Ice Cream Company is a leading processor of branded and private label ice cream, novelties and frozen desserts throughout Canada.

Scotsburn Ice Cream Company rapidly modernizes web presence using IBM i, DB2, and PHP

The Need

Replace & modernize the company’s web presence using their existing IBM iinfrastructure.

The Solution

• 2 Power S814 Systems• IBM i 7.1• DB2 for IBM i• IBM HTTP Server• PowerHA for high availability• Zend Server V8• All content stored in DB2/IFS

The Results

• New web site created & deployed in six weeks

• Custom, user-driven content management solution.

“We hired an experienced developer, gave

him a crash course in IBM i and managing

DB2 schemas. We were able to deploy our

new web interface in six weeks. It shows

how easy it is to get a developer up,

running, and productive with IBM i.”

- Steve Pitcher, Enterprise Systems Manager,

Scotsburn Ice Cream Company

Wholesale Distribution

9


Holy Name Medical Center provides responsive access to the growing demands of the healthcare system

The Need

� Create a customized comprehensive responsive clinical information system that meets the needs of the HNMC physicians and clinicians.

Solution

� IBM POWER 750 Server � IBM i 7.1� IBM PowerHA� Rational Developer for i, RPG CGI� HNMC WebHIS, MicroHIS (mobile users)

Holy Name Medical Center is a comprehensive, 361 bed acute care facility providing high-quality healthcare across a continuum of services

The Benefits

� Interface that is intuitive, supports mobile access, requires minimal training, high satisfaction by users

� Supports billing, document imaging, physician notes, pharmacy, QR Codes, patient dashboard & current location in clinic

� Able to respond proactively to new requests and functions, using onsite developers

� Provides the scalable, secure, available, recoverable infrastructure HNMC needs.

Healthcare

“We can do everything with IBM i. We haven’t

had to add any other systems to the solution."

Mike Skvarenina, CIO, Holy Name Medical Center

10


Mueller, Inc. deploys a disaster recovery solution that meets their data availability requirements & let’s them sleep at night

The Need

� Update outdated recovery time and data loss requirements in response to rapid expansion to three manufacturing sites and 32 sales branches

Solution

� Power S824, 387GB SSD disk drives, Power 740

� IBM i 7.2, PowerHA’s Geographic Mirroring asynchronous replication for backup and recovery

� Oracle’s JDEdwards EnterpriseOne, OneWorld, Kronos

Mueller, Inc. is a leading manufacturer of pre-engineered metal buildings and roofing products

The Benefits

� Outage exposure reduced from days to less than an hour

� Potential for data loss reduced to minutes from 24 hours

� Solution is automated & self-managing

� Provides data replication in near real-time

� Production applications can be switched from the primary to secondary system in about 10 minutes

Manufacturing

““Our recovery time in the event of an outage has been reduced from days to less than an hour, and our potential for data loss went from a minimum of 24 hours to only a few minutes. Plus, the solution is automated and self-managing. We couldn’t be happier.”

— Evanet Gallant, Corporate IT ManagerITSG - Mueller Case Study

11


Large Bank …some actual stats

• A recent real world example email from one of the lab services guys at a large South American bank.

• Environment: 28 cores, 560GB memory, 5.4TB SYSBAS, 38TB IASP, OS 7.1 TR9

Planned switch time (not including application shut down/start up): 14 minutes, 53 seconds

• Switch makeup:

• Vary off IASP: 6 minutes 58 seconds

• longest step: Writing changes to disk: 5 minutes 51 seconds

• Switch related processes; 3 minutes 5 seconds

• longest step: 2 minute delay to allow disks to report in before multipath reset (may be able to optimize)

• Vary on IASP: 4 minutes 50 seconds

longest step: DB xref merge: 1 minute 20 seconds (may be able to optimize)

• next longest: authority recovery: 1 minute 9 seconds (too many profiles and AUTL)

12


PowerHA Price

PowerHA System Mirror for AIX and IBM i New price table effective March 1st 2016

TierEdition

small price/core medium price/core large price/core

standard - data center $2600 $3650 $4700

Enterprise – multi site $3400 $5250 $6800

PowerHA System Mirror for AIX and IBM i

TierEdition

small price/core medium price/core large price/core

standard - data center $2500 $3500 $4500

Enterprise – multi site $3250 $5000 $6500

License only the IBM i and PowerHA for cores needed on the target system, when using CBU. This could be as little as 1 core when using hardware based replication

13


Small client price example with PowerHA and CBU

• Production server S814 has three cores,CBU server, S814 only needs one core.

• Since Metro or Global mirror consumes no server CBU overhead or Geomirror only a fraction of the CPW you only need one core on the CBU (unlike logical replication which can consume up to 30% or more of available CPW and those cores must be licensed )

• Production site and DR site are 400 miles apart therefore we will need async replication. Geomirroing async mode or Global Mirror costs $3250 per core.

NOTE:

Many customers in this environment typically use internal disk and therefore can not do Switchable LUNs, so we put

Geomirroring sync mode into the standard edition. In all other cases, storage replication requires the Enterprise Edition.

• The $3250 x 4 (3 from Production and 1 for CBU) = $13,000 Plus 1 IBM i license on the CBU

• The T’s & C’s of the CBU offering allow you to run with up to 4 cores of IBM i (and related STG products) to match the Production server when the workload is moved to the CBU and NOT on the Prod Server.

• $13,000 for an HA/DR solution that requires very little baby sitting

Large tier is gone

with Power 8

14


Internal vs External Storage - considerations

• What needs to be considered to determine which type of disk storage is "right" for your IBM i environment?

• Size of data in the enterprise – isolate or consolidate?

• I/O performance

• Availability and Backup requirements

• Frequency of deploying new partitions or workloads

• Appetite for flexibility vs. complexity

• Cost

• Possible advantages of external storage

• Flashcopy to offload backups

• Elimination of hardware maintenance downtime with Live Partition Mobility

• Other virtualization technologies such as Active Memory Sharing, Suspend/Resume

• Recent announcements simplifying external storage deployment

• Storwize models – economical but still full function

• Flash Storage – V9000 or V840, or Flash systems behind a SVC or Storwize

• Native attach options

15


For PowerHA - Who’s Doing the Replication?

IBM i

• Technologies: Synchronous and Asynchronous Geographic Mirroring

• Storage agnostic, although predominantly used with internal storage

• Source and target could be different storage types

• Ie. one side could be SAN and the other side Internal disk.

• Would allow exploiting SAN capabilities (ie. FlashCopy)

• System failure affects production workload and data replication

External Storage Server

• Technologies: Metro Mirror, Global Mirror, LUN switching, FlashCopy

• PowerHA supports specific external storage devices

• DS8K, San Volume Controller (SVC), Storwize storage servers, V840 and V9000

• Data replication independent of IBM i

• Replication overhead offloaded to external storage device

• Additional external storage functionality available, such as FlashCopy

16


PowerHA SystemMirror IASP Replication Technologies

1 site

Shared Storage

External Storage

PROD HA

Network

External Storage

Metro Mirror

External StoragePROD HA

LUN level switching

External Storage

PROD HA/DR

Network

External Storage

Global Mirror

External Storage Replication

External Storage

PROD DR

Network

External Storage

LUN switch + Global Mirror

HA

PROD DR

Network

External Storage

Metro Global Mirror

HA

PROD HA

Network

Synchronous Geographic Mirroring

PROD HA/DR

Network

Asynchronous Geographic Mirroring

2 site Replication

2 site Replication

2 site HA + DR

IBM i replication

3 site Replication(DS8K only)

17

© Copyright IBM Corporation 2016. �17

Geographic Mirroring

• Synch

• Any storage

• Direct attached

• SAN attached

• VIOS or IBM i Hosted storage

IBM i 7.1 / 7.2 PowerHA SystemMirror for i

MetroMirror

• Synch

• DS8000

• SVC

• V7000

• V3700

• V5000

• V840/v9000

FlashCopy

• DS8000

• SVC

• V7000

• V5000

• V3700

• V840

SwitchedIASPs

• Internal or external storage

• IOA

End-to-EndSolution

NPIV and LUN Level Switching was added for SVC, Storwize and Native attach (No VIOS required in 1H 2013 – V840 and V9000 7.1 TR8 IBM i 7.2 TR2

GlobalMirror

• Asynch

• DS8000

• SVC

• V7000

• V5000

• V3700

• V840/V9000


• Asynch

• Any storage

• Direct, VIOS, IBM i Hosted storage

LUN Level Switching

• DS8000

• SVC

• V7000

• V5000

• V3700

• V840/V9000

Extended options for an IBM delivered, end-to-end solution for HA, DR and backups

IBM i Cluster Resource Services

DSCLI DS Command Line Interface

HA Switchable Resources - IBM i option 41 included

PowerHA SystemMirror for i(5770-HAS) – 7.1 /7.2

LabServices

ICSM

18


IBM i Native Attach Storage and Resiliency

Internal SAS/SSD (1)

DS5000 DS8000SVC V7000, V5000 V3700 V840 V9000

Non-IBM SAN (ie EMC) (2)

POWER/7/8 POWER/7/8 POWER7/8 POWER7 or 8 POWER7/8

PowerHA SystemMirror 7.1 or 7.2

FlashCopy No No Yes Yes (3) No (Timefinder) (2)

Metro Mirror No No Yes Yes (3) No (SRDF) (2)

Global Mirror No No Yes Yes (3) No (SRDF) (2)

Switched IASP Yes Yes Yes Yes No

LUN Level Switching No No Yes (7.1) Yes No

Geographic Mirroring Yes Yes Yes Yes Yes

PowerHA SystemMirror 6.1 or 7.1 plus IASP Copy Services Manager (ICSM - formerly Advanced Copy Services (ACS))

FlashCopy No Yes Yes Yes No (Timefinder) (2)

Metro Mirror No Yes Yes Yes (3) No (SRDF) (2)

Global Mirror No Yes Yes Yes (3) No (SRDF) (2)

LUN Level Switching No No Yes (6.1) Yes (3) No

Metro/Global Mirror No No Yes No No

External Storage Full System Copy

FlashCopy No Yes Yes Yes (3) Yes (Timefinder)

Global Mirror No Yes Yes Yes (3) Yes (SRDF)

Metro Mirror No Yes Yes Yes (3) Yes (SRDF)

(1) SSD requires POWER6 or later. (2) EMC (DMX, VMAX) are not supported by PowerHA except with Geographic Mirror(3) Fabric Attach (SAN Switch) requires IBM i 7.1 TR6 + PTF’s, or Direct attach (no SAN switch – 4GB adapter only)V840 and V9000 (Flash) requires IBM i 7.1 TR8 or later (Note: 16GBs one both SVC and Storwize requires IBM i 7.1 TR10 or IBM i 7.2 TR2)Note. Native attach means the partition contains a SCSI, SAS or Fiber Channel card used to connect to the storage

For PowerHA -Storage is a key part of your HA/DR solution decision

19


IBM i - VIOS Storage and Resiliency

PowerHA Supported

configuration options

DS5000 DS8000 XIV SVC / V7000 V5000 V3700 V840 V9000

POWER6/7/8

BladeCenter

POWER6/7/8

BladeCenter

POWER6/7/8

BladeCenter

POWER6/7/8

BladeCenter

PowerHA SystemMirror 7.1 or 7.2

FlashCopy No Yes No Yes 2

Metro Mirror No Yes No Yes 4

Global Mirror No Yes No Yes 4

Switched IASP No No No No

LUN Level Switch No Yes No Yes 3

Geo’mirroring Yes Yes Yes Yes 2

PowerHA SystemMirror 6.1, 7.1 or 7.2 plus IASP Copy Services Manager (ICSM – formerly Advanced Copy Services (ACS))

FlashCopy Yes 1 Yes No Yes

Metro Mirror Yes 1 Yes No No

Global Mirror Yes 1 Yes No No

LUN Level Switch No Yes No No

External Storage Full System Copy

FlashCopy Yes Yes Yes Yes

Metro Mirror Yes Yes Yes Yes

Global Mirror Yes Yes Yes Yes

1 Requires NPIV capable fiber channel adapter / DS5000 NPIV support requires IBM i 7.1 TR22 SVC, V7000 requires IBM i 7.1 TR3 or later (vSCSI). 3 Requires NPIV capable fiber channel and IBM i 7.1 TR6 or later 4 V5000, V3700 support added with IBM i 7.1 TR6 and V840 / V9000 with TR8 or later

20


A PowerHA Technology for Every Storage Type

Internal

SAS/SSD DS8000

SVC

V840,V9000

Storwize

XIV DS5000

Other

Storage


Metro Mirror

Global Mirror

Metro Global Mirror

LUN switching

FlashCopy

HyperSwap ?

Recommend viewing IBM i POWER External Storage Support Matrix Summary – TechDoc - PRS4563 http://www-03.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS4563 andQuick reference - Storage options for PowerHA SystemMirror for IBM i – TechDoc - TD106243 http://www-304.ibm.com/jct03001c/support/techdocs/atsmastr.nsf/WebIndex/TD106243

21


PowerHA and LPM Feature Comparison

PowerHA LPM

Live Partition Mobility between physical frames (IBM i 7.1 TR4) * �

Server Workload Management** �

Energy Management** �

Hardware Maintenance � �

Software Maintenance �

Automated failover upon System Failure (OS or HW) �

Automated failover upon HW failure �

Automated failover upon App failure �

*~ 2 seconds of total interruption time** Require free system resources on target system

22


What Active Partition Mobility Isn’t

• It is not a replacement for PowerHA.

• It is not automatic.

• LPARs cannot be migrated from failed CECs (Remote/Restart)

• Failed OS’s cannot be dynamically migrated.

• It is not a Disaster Recovery Solution.

• For the same reasons as above.

• Mobility across long distances not supported.

• Additional SAN and LAN considerations to treat.

• It is not an OS update solutions

• LPM can help with server firmware updates by evacuating a server but doesn’t help with OS upgrades

23


�23

Unix Linux Windows

Boot & OS

'C'

PGMs

'D''E'

'F'

DB

'G''H'

'I'

'J''K'

'L'

Object B Object C Object DObject A

Storage Management

IBM i

I/O

TIMI

Integrated or SAN

Storage Management Styles – IBM i Compared To...

System ASP

Page

Your IBM i solution is probably already delivering an enterprise class performance solution. Your future storage design should take this into account: for tier-1 storage, design for I/Os not capacity.

24


PowerHA Basic Concepts

• PowerHA SystemMirror creates and manages a cluster topology

• Sysbase volume group is the OS and system based objects

• IASP volume group hosts the DB, IFS application data

• Admin Domain manages the SYSBAS data

Admin domain

Application data

(IASP)

IASP -IndependentAuxiliary Storage Pool

SYSBAS

SYSBAS

25

© Copyright IBM Corporation 2016. 25

Independent Auxiliary Storage Pool

� An IASP is:� A set of disk units which contain a collection of user objects and the necessary system data

(e.g. storage management directories, object ownership, and authorization information)

� Independent of ASP1 (SYSBASE) – This enables the IASP to be taken offline or brought online independent of system activity or other ASPs

� Provides an independent ‘Name Space’ for job and DB isolation

� Can reside on internal or external disk – or a combination of both

� Also known as – Independent Disk Pool

� Availability of the IASP is controlled through varying on / off the associated device description and “attaching” jobs / threads to the IASP

� Included in the base operating system

� IASPs can contain:� User defined file systems

� User libraries – some object types not supported

26


iASP Benefits (vs full system replication)

� Faster switching, no IPL

� No replicating OS, microcode, temp space

� Target system is online – just switch the data

� Better recovery – just data recovery steps

� Reduced bandwidth requirement

� Integrated with clustering

� BRMS networking integration

� Improved flexibility and masking planned outages

� Much simpler, automated switch process

� Consolidate workloads using separate iASPs

� Less impact for planned outages (PTF and OS upgrades)

27


What about Full System Replication

• Common Use: Need protection against (some) planned and unplanned outages for DR

• Less configuration (no IASPs) can be view as easier to implement

• FlashCopy may be an option

Caveats

• There is no active backup server – Target server is offline

• Does not help with reducing software maintenance outage

• Replicating OS and temporary storage (requires more bandwidth)

• Failover is a full system IPL, not just data recovery steps (IASP vary on)

• Requires External storage

28


� Administration Domain (included in PowerHA)

– Changes on one node are propagated to others

• User profiles, System Values, Security, Key configuration data

PowerHA - Environment Resiliency Options

Synchronize non-IASP (SYSBAS)

objects across systems in the cluster

Additional Monitored Resources (6.1)• Subsystem Descriptions (*SBSD)

• Network Server Descriptions (*NWSD) of types *WINDOWSNT, *IXSVR, and *ISCSI.

• NWS Configurations (*NWSCFG)

• NWSH Device Descriptions (*NWSHDEV)

• NWS Storage Spaces (*NWSSTG)

• Tape Device Descriptions (*TAPDEV)

• Optical Device Descriptions (*OPTDEV)

• Ethernet Line Descriptions (*ETHLIN)

• Token-ring Line Descriptions (*TRNLIN)

Additional Monitored Resources (7.1)• Authorization lists (*AUTL)

• Printer Device Descriptions (*PRTDEV)

Monitored Resources (5.4)• User profiles (*USRPRF)

• Class (*CLS)

• Job description (*JOBD)

• ASP device description (*ASPDEV)

• System values (*SYSVAL)

• Network attributes (*NETA)

• Environment variables (*ENVVAR)

• TCP/IP Attributes (*TCPA)

LPAR-1 LPAR-1

IASP IASP

HA (target)PROD (source)

SYSBAS SYSBAS

29


Admin Domain – Review, add or remove Monitored Remove

30


Clustering – at the heart of IBM i and PowerHA

� Cluster:

� provides the communication infrastructure between systems and/or partitions

� Facilitates the execution of cluster events

� Simplified management, single point of control

� Device Domain

� The device domain defines the cluster nodes which may share IASPs

� Each IASP is assigned an unique address space within the device domain

� Can’t allow two IASPs with the same address space to exist on the same IBM i node

OS and other

system data

OS and other

system datacluster

Production

*SYSBAS

Device domain

Application

data

IASP IASP

HA

*SYSBAS

31


Cluster Resource Group

� Cluster Resource Group (CRG) � Defines which IBM i nodes are potential hosts for the IASP

� The recovery domain (list of nodes) is ordered (This determines replication direction)

� A switchable (takeover) IP address can also be defined and PowerHA will activate it on whichever node is currently primary

Cluster resource group

Production

*SYSBAS

HA

*SYSBAS

Primary 1st Backup

IASP IASP

32


Copy Description and ASP Session

� Copy D

� The copy description describes one copy of the IASP

� Gives PowerHA all the information needed to access and control the IASP

� Session:

� Describes the relationship between copy descriptions

� Will determine the type of replication from a system storage perspective

� PowerHA uses the session to control the replication

Copy description

HA

*SYSBAS

Copy description

sessionIASP IASP

Production

*SYSBAS

33


Administrative Domain

� Administrative Domain

- List of cluster nodes to synchronize *SYSBAS objects

- Independent of the data in the IASP

� Monitored Resource Entries (MRE’s)

- Objects in the Admin Domain being synchronized

- Specific attributes of objects being synchronized

HA

*SYSBAS

IASP IASP

Production

*SYSBAS

cluster

Admin Domain

34


Geographic Mirroring – IBM

Synchronous or Asynchronous - long distances and DR

• Two IBM i partitions (different “sites”)

• One IASP, two copies (two sets of disks/LUNs)

• Typically for internal storage but could have SAN at one side or the other

• Replication handled at IBM i SLIC storage management level

Internal Disks *

Internal Disks *GeoMirror

IBM i

IBM iPROD Target

Mirror Copy IASP

Production Copy IASP

High Availability (HA) and Disaster Recovery (DR) solutionReplication handled at SLIC Storage Management level, as opposed to O/S and remote journalingManaged via PowerHATrue asynchronous transmission option at IBM i 7.1Requires sufficient bandwidth between sites to maintain consistent copies and avoid auto-suspend issuesRecommended to have equal quantity, capacity and type of disks at both sites to maintain consistencyReplication ports use random ephemeral (1024+) TCP ports, not specific ports

35


• Synchronous Geographic Mirroring – Local HA

PROD (source) HA (target)

LPAR-1 LPAR-1

IASP IASP

SYSBAS SYSBAS

X X

= Main Storage

= Completed Write

• Synchronous write to target copy means the change must completed on target memory before it can complete on source

– Write at target can be synchronous or asynchronous (shown here as asynchronous)

• Very good RPO – changes are confirmed on target copy before source

• Requires local LAN like network performance: little latency, plenty of capacity

• Requires proper CPU, memory, disk planning for both source and targets to ensure performance expectations are met

X X

Your Network

IBM i Geographic Mirroring

IBM i 6.1 and up

I/O Adapter Cache I/O Adapter Cache

36


Your Network

• Asynchronous Geographic Mirroring - long distances and DR

IBM i Geographic Mirroring IBM i 7.1 and up

PROD (source) HA (target)

LPAR-1 LPAR-1SYSBAS SYSBAS

X X

• Asynchronous write to target copy means network latency will not impact end user and job performance nearly as much as synchronous

– If the network delays writes to target copy, source storage pages wait at source

– Source memory pages will be paged out to disk, just as any other job in system

• Consumes additional source server CPU and memory compared to Synchronous Geographic Mirroring

• Available with PowerHA 7.1 and Enterprise Edition

MemoryPage Copy

= Main Storage

= Completed Write

IASP IASP

X X

I/O Adapter Cache I/O Adapter Cache

37


HA (target)

SYSBAS

PROD (source)

SYSBAS

IBM i Geographic Mirroring

LPAR-1 LPAR-1

IASP IASP

X X

Your Network

• Limited use for on-line backups

– Detach with Tracking

• Replication from source is suspended, changes are tracked

– Requires partial resynchronization once backups are completed

• No HA or DR failovers are possible until that re-sync has completed

– Will this meet your business requirements?

– By itself, can be a viable on-line backup solution, if full time HA/DR is not required. Otherwise, consider the latest version of Save-While-Active

• On-line backups at target site

No data replication during backups

Partial resynchNo HA or DR until resync completes

Detach with tracking

38


LUN Level Switching – IBM External StorageExternal Storage using Switched IASPs technology for local HA

IASP

DS8000SVC/Storwize

PROD (source)

LPAR-1

HA (target)

LPAR-2

LUN Level Switching provides local High Availability

– IASP is switched via fiber connections between partitions

• Great for masking planned outages like release or application upgrades

– Or - IASP is switched via fiber connections between servers

• Great for masking planned and unplanned outages

– Local HA solution which can be used in conjunction with:

• Metro Mirror

• Global Mirror

• FlashCopy

DS8000 with IBM i 7.1 (or IBM i 6.1 with ACS supports LUN Level Switching) IBM i 7.1 TR6 adds NPIV support or direct attach for SVC, Storwize (V7000, V5000 & V3700)IBM i 7.1 TR8 or 7.2 TR2 adds supports for V840 and V9000 Flash

39


LUN-Level Switching

• Local High Availability (HA) solution

• Automated failover through PowerHA, at v 7.1

• Managed via PowerHA (DS8K,SVC,Storwize)

• Limited amount of disk required

• Single copy of data

• Not a Disaster Recovery (DR) Solution

• Supported on DS8000, SVC, V7000, V5000, V3700 and V840/V9000

40


Copy Services

� Copy Services is a real-time remote copy technique that mirrors a primary set of logical volumes (that are being updated by applications) onto a secondary set of logical volumes.

� The secondary volumes can either be in the same or a different IBM System Storage Unit than the primary set of volumes.

� Copy Services is a hardware solution, thus it is application independent. The copy function occurs at the storage subsystem level, the application does not know of its existence.

Copy

Services

System Storage

� PowerHA

� Integrates the storage system copy services functions with IBM i clustering technology to provide an integrated solution

– Copy Services technology does the replication of the IASP

– Cluster technology monitors the health of the IBM i nodes as well as the health of the copy services replication

– PowerHA controls the direction of the replication within the storage server

41


PowerHA - Metro Mirror

PowerHA integrates storage-based replication with IBM i clustering technology

–Synchronous replication ensures new production data is written to target first

–Excellent RPO and very good RTO

–An IASP based solution

–DS8000, SVC/Storwize/V840 and V9000

• Direct attach, VIOS using VSCSI or NPIV

–SVC, Storwize, V9000 and V840

• Requires 7.1 or later

ExternalStorage

HA

ExternalStorage

Local or campus Site

MetroMirror

Production

*SYSBAS

IASP

*SYSBAS

IASP

42


Metro mirror

� Synchronous mirroring:

� Metro Mirror receives a host update to the source volume, it completes the corresponding update to the target volume.

� Guarantees data consistency by ensuring that a write operation that completes is received by the host application after the update has been committed to the target storage unit and acknowledged by both the source and target storage units.

� Metro Mirror supports a maximum distance of 300 km

� Delays in response times are proportional to the distance between the volumes. 100% of the source data is available at the recovery when the copy operation ends.

� Requires

� PowerHA SystemMirror Enterprise Edition (57xx-HAS Option 1)

� A Cluster with at least two nodes in a Device Domain

� A Device - Cluster Resource Group (CRG) with the two nodes in the Recovery Domain

� An IASP using SAN-based storage that are the preferred source volumes

� Identical number and size of SAN-based storage volumes that are the preferred target (preferably in a different storage unit than the preferred source volumes)

� Copy Descriptions for the source and target volumes

� An ASP Session managing the metro mirror relationship

43


PowerHA Express Edition - Full System HyperSwap

� First release (7.2) provides support for DS8000 HyperSwap in full system replication environments (SVC and Storwize with firmware 7.5 in testing)

• HyperSwap by itself is a hardware availability solution

• ‘Zero’ downtime switch for storage planned and unplanned outages

• Single partition solution, although can be combined LPM

• Not a disaster recovery solution

• No protection against software planned or unplanned outages

• Once configured, HyperSwap switch will occur automatically in the case of a DS8K failure, or can be triggered manually before a planned outage

Prod

MetroMirror

SYSBAS SYSBAS

Prod

MetroMirror

SYSBAS SYSBAS

LPM 2nd

server

44


PowerHA Enterprise (IBM i 7.2 & 7.3) - HyperSwap GA – April 2016

• IASP replication plus HyperSwap• HyperSwap for ‘zero’ downtime storage planned and unplanned outages• Live partition mobility for ‘zero’ downtime planned firmware, POWER outages• Challenge – two way replication (2 copies of Sysbase per PowerHA node) • PowerHA vary off/on of IASP for OS planned outage, disaster recovery

MetroMirror

Prod

*SYSBAS

IASP

DS8-A

IASP

DS8-B

*SYSBASHA

*SYSBAS *SYSBAS

MetroMirror

MetroMirror

Current Production environment

Storage outage

45


Global Mirror – Asynchronous - Continuous Copy (SVC Storwize)

• Asynchronous copy; Writes sent sequentially in order

• Requires sufficient bandwidth; Size for peak I/O workload

• Better suited for fiber replication, not IP replication

• Nearly unlimited distance; Maximum 80ms round-trip

PROD BCKP

Production Copy

Mirror Copy

Global Mirror

IBM i IBM i

SVC Storwize SVC Storwize

46


Global Mirror + Change Volumes (SVC Storwize)

• Change volumes hold point-in-time copy that are changed during cycling mode – FlashCopy is performed

• Change volumes required at both source and target site (typically thin-provisioned)

• Requires 4 “sets” of disks/LUNs (two source, two target)

PROD BCKP

Production Copy

Mirror Copy

Global Mirror

IBM i IBM i

SVC Storwize SVC Storwize

Change Volume (FlashCopy)

Change Volume (FlashCopy)

47


Global Mirror + Change Volumes (SVC Storwize)

• Benefits

• High Availability (HA) and Disaster Recovery (DR) solution

• Replication handled at storage level, as opposed to IBM I

• Managed via PowerHA for SVC Storwize

• Does not require bandwidth to meet peaks

• Unlimited distance, up to 80ms round trip latency

• Recommended when performance is poor with metro mirror or global mirror continuous copy on SVC Storwize

• Additional disk capacity required for change volumes (auxiliary volumes)

48


PowerHA DS8000 Global Mirror

Prod LPAR1

Local Site DS8000

IASP

DR Site

DR

DS8000

IASP StandardFlashcopy

ConsistencyGroup

Symmetrical – Enables reverse replication: required for role swap capability

StandardFlashcopy

ConsistencyGroup

Global Mirror

Global Mirror

– Asynchronous replication allows for long distances

– DS8000 (Direct attach or VIOS using NPIV)

�Add copy descriptions for the volumes present in the global mirror environment

� Preferred source

� Preferred target

� Target consistency group flash volumes

� Source consistency group flash volumes for symmetric global mirror

– SVC and Storwize offers two async replications technologies (standard or Change Volume)

49


Metro-Global Mirror

• Three IBM i partitions (three “sites”)

• One IASP, three full copies, plus one additional set of disks/LUNs for Consistency Group (CG) FlashCopy

• Requires DS8000 external storage and TPC-R

IBM i IBM i IBM i

DS8800 DS8800 DS8800

MetroMirror Global Copy

PROD BCKPHA BCKPDR

Production Copy IASP

MMir Target GMir Source

PPRC Target Copy

CG Copy

50


Flashcopy options

• IBM i can leverage FlashCopy to:

� Create a copy of an IASP for backup

� Create a full system copy for backup

• Recommendation is:

• Vary off the IASP or power down the system before taking the Flash

• Known as a “cold Flash” is the best way to guarantee complete data integrity

• IBM i 6.1 added support for the “Quiesce” of IASP

• Known as a “warm Flash”

• suspends transactions & operations to ensure that as much in-flight data as possible is written to disk

• Places transactions at database boundaries if possible

� Best when used with applications running commitment control

• Requires a ‘recovery vary-on’ of the IASP.

• 7.1 and later supports Quiesce with VIOS storage pools

51


FlashCopy Multiple IASPs to Single Target

• Support added at PowerHA 7.2 for multiple source to 1 target

• Provides ability to create point-in-time “copies” of DIFFERENT production sets of data

• Eliminates scheduled outage time for production backups

• Multiple backups can be staggered back-to-back

• Limited amount of disk required – saves on disk space, sharing same target LUNs

• Can be managed through PowerHA or ICSM

• Single target partition has only one “copy” at a time

• Multiple partitions involved

52


IBM I 7.2 with PowerHA - IASP assignment

Enables use of one partition to save multiple production environments

Allows attachment of an IASP to a partition not in the cluster device domain

Only one IASP can be attached to the partition at a time

Eliminate dedicated flash partitions per cluster

Universal FlashCopy target node

Save LPAR

*SYSBAS

Tape Backup

FlashCopy targets

IASP Production cluster 1



53

© Copyright IBM Corporation 2016. �53

PowerHA SystemMirror – combining Technologies

Example: LUN Level Switching on DS8000 or SVC/Storwize, plus remote replication for a second copy of the data at DR location. LPM is possible with VIOS, can evacuate a node for server maintenance/hardware changes etc,

DR (target)

LPAR-4

DS8000SVC/Storwize

IASP

IASP

Metro or Global Mirror

Or GeoMirror

Remote HA or DR – On-line backups

PROD (source)

IASP

DS8000SVC/Storwize

FlashCopy

BU - LPAR-2

On-line backups

PRODLPAR-1

VIOS LPAR1

LUN Level Switching – Local HA (for planned or unplanned) or LPM for work load balancing or planned server maintenance.

Local HALPAR-3 VIOS LPAR3

VIOS LPAR2

FlashCopy

BU - LPAR-5

Local HA &

Server A

Server B

Server C

PRODLPAR-1

LPM LUN level Switching

54


Summary

- Single-site solutions can provide some High Availability (HA) and may save $$, but cannot provide Disaster Recovery (DR)

- Consider internal vs external storage (and what type of external storage), depending on which solution you choose

- Consider connectivity options (Direct-attached, SAN-attached, VIOS, vSCSI, N-PIV) and number of host connections, when deciding which solutions can or cannot be implemented

- Consider the amount of disk needed for multiple copies (Mirror Copy LUNs, FlashCopy LUNs, Consistency Group LUNs, Change Volume LUNs)

- Consider BANDWIDTH requirements between sites to ensure efficient delivery of packets on mirroring solutions

55


Publications and Links (1 of 2)

• PowerHA Wiki

• www.ibm.com/developerworks/ibmi/ha/

• IBM PowerHA SystemMirror for i - Performance Information

• http://ibmurl.hursley.ibm.com/35XN

• PowerHA solutions

• www.ibm.com/systems/power/software/availability

Redbooks at www.redbooks.ibm.com

• PowerHA SystemMirror for IBM i Cookbook - SG24-7994-00 (Feb 2012)

• Implementing PowerHA for IBM i - SG24-7405-00 (Nov 2008)

• IBM i 6.1 Independent ASPs: A Guide to Quick Implementation of Independent ASPs -SG24-7811

• Implementing SAP Applications on the IBM System i with IBM i5/OS - SG24-7166

Publications

• Implementing high availability

• http://publib.boulder.ibm.com/infocenter/iseries/v7r1m0/topic/rzaig/rzaig.pdf

• Resiliency on Power Systems

• www-03.ibm.com/systems/p/hardware/whitepapers/power6_availability.html

• IBM i Virtualization and Open Storage Read-me First

• http://www-03.ibm.com/systems/resources/systems_i_Virtualization_Open_Storage.pdf

56


Publications and Links (2 of 2)

PowerHA System Mirror for IBM i – Data Sheet

• http://public.dhe.ibm.com/common/ssi/ecm/en/pod03024usen/POD03024USEN.PDF

Impact and Cost of Downtime Tools

• IBM: http://www-935.ibm.com/services/us/bcrs/self-assessment/

• GIAC BIA overview: www.giac.org/resources/whitepaper/planning/122.php

Advanced Copy Services for PowerHA

• http://www-03.ibm.com/systems/resources/systems_services_labservices_stgls_advcpysvc_powerha_10.pdf

• http://www.ibm.com/systems/services/labservices

• Email: [email protected]

Business impact analysis (service)

• www-935.ibm.com/services/us/index.wss/offering/bcrs/a1000260

IBM Risk Assessment Tool

– www-935.ibm.com/services/us/gts/managing_risk/self_assessment/index.html

powerha systemmirror for ibm i - schedschd.ws/hosted_files/discover2016/7c/507 - powerha... ·...

Documents