Enterprise Copy Data Management -Primary and Protection Copy Management Best Practices
Brad Linch – Engineering Product TechnologistFrank Gagnon – Engineering Product Technologist
[email protected]@dell.com
© Copyright 2017 Dell Inc.3
Agenda• Storage Integrated Data Protection
• Enterprise Copy Data Management for Primary and Protection Storage
• Customer Environment with ProtectPoint and Enterprise Copy Data Management
• Demonstration of Enterprise Copy Data Management
© Copyright 2017 Dell Inc.5
Storage integrated data protection: ProtectPoint
Integrate VMAX and/or XtremIO with Data Domain:
20x faster backup
10x faster restore
Eliminate impact on application
Eliminate copy sprawl
Reduce cost and complexity
© Copyright 2017 Dell Inc.6
• Oracle, SAP, IBM DB2, SQL and Exchange as well as file system integration
• File system integration – LUN level
Native application integration
(for other apps)
File system
© Copyright 2017 Dell Inc.7
Production Data
FC
App
OSBackup Images
Unique Blocks
Ingested
Deduplication Index
VMAX backup with ProtectPoint
ProtectPointagent
CBT Link eLUNProd FC
© Copyright 2017 Dell Inc.8
App
OS
VMAX rollback & restore with ProtectPoint
ProtectPoint agent
Backup Images
Unique Blocks
Ingested
Deduplication Index
Recovery Copy
Copy
Recovery hosteLUNProd
eLUN
Recover host
FAST.X RestoreDirect Access
FC
Mapping
© Copyright 2017 Dell Inc.9
XtremIO backup with ProtectPoint
App
OSBackup Images
Unique Blocks
Ingested
Via DD Boost
Deduplication Index
RPA cluster(Physical)
Backup
Backup
Backup
Production Data
Backup
SAN via fc
ProtectPointagent
© Copyright 2017 Dell Inc.10
XtremIO rollback & restore with ProtectPoint
App
OSBackup Images
Unique Blocks
IngestedRPA cluster(Physical)
Production Data
SAN via fc
ProtectPointagent
Recovery Copy
Copy
Recovery host
TransferTransferTransfer
Rollback
Direct Access
Granular Recovery Deduplication Index
© Copyright 2017 Dell Inc.12
BACKUP ADMIN
“I have backups!”
APP ADMIN
“I have dumps!”
STORAGE ADMIN
“I have snaps!”
VM ADMIN
“I have clones!”
Complication
© Copyright 2017 Dell Inc.13
Snapshot Problem every customer is facing• Let’s visualize this problem
Primary Storage Provisioned
Backups Local Snapshots Offsite Replicated SnapsOffsite Replicas
Archive
Test & Dev.Data Analytics
1
32A2
66
4
3AProtection Admin
Storage Admin
Test-DevTeam
AnalyticsTeam
Protection Admin
When App and Protection workflows diverge your infrastructure gets complex, you lose control of data and you get too many copies.
App Admin
5
© Copyright 2017 Dell Inc.14
• Data management for the modern data center
Enterprise Copy Data Management
COPY AND STORAGE ASSET DISCOVERY• Build an Inventory of Protectable and “Protect To” Storage Objects• Creates a Catalog of Copies Created by ProtectPoint, SnapVX and XVC• Knows How Many, Where and How Long Copies have Been Around
PROTECTION SERVICE PROVISIONING• Accept user-defined Retention Compliance SLOs to create a Service Plan Catalog• Assign Service Plans to Primary and Protection Storage Assets • Set-Up and Tear Down ProtectPoint Configurations Based on Service Plan Parameters
CUT RISK AND DRIVE PROTECTION EFFICIENCIES• Make Sure The App Admins are Retaining the Copies You Need for Compliance.• Figure Out When The App Admins are Making Too Many Copies to Free Up Space.• Introduced Tiered Protection Service SLOs and Show-Back to Trim Budget.
How many copies do I have? Where are they? How long have they been there?
Build a service catalog. Assign a service plan to your assets and provision protection services.
Only keep what you need without compromising SLO compliance.
© Copyright 2017 Dell Inc.15
Add inventory sources• VMAX SMI-S• XtremIO Management Server• Data Domain Management Center
Find storage assets• Storage arrays (VMAX3, XtremIO, Data Domain)• Objects on those arrays• Basic meta-data for context• Organize and categorize assets
Find copies• VMAX SnapVX• XtremIO XVC• ProtectPoint Backups
• Take an inventory of the storage environment
Discovery
© Copyright 2017 Dell Inc.16
• Protection plans - monitoring and management
Protection SLO Compliance
Protection Plan
STAGES
SLOs
PLAN
Local Snaps Backups
Storage Class
RPO
Number of Copies
Retention
Primary Protection
1 Hour
72
3 Days
24 Hours
30
1 Month
Protection On Off
© Copyright 2017 Dell Inc.17
Export and Recovery• Export for re-use
– Makes the PIT copy available to a host› Ensures that the copy exists on a device
that is masked properly
• Recovery– Rollback production from ProtectPoint
copy– Export for Re-use ProtectPoint copy
• Any copy is available for re-use– Snapshots and ProtectPoint/VMAX
copies exported from primary storage– ProtectPoint/XtremIO copies exported
directly from the Data Domain– eCDM does not have to have created
the copy in order to export it
© Copyright 2017 Dell Inc.18
Under the Hood• Ships as OVA
– Supporting vSphere 5.5+– Running SLES 12 SP2– 600 Gb hard disk– 16 Gb RAM– 4 CPU
• Many Backend Services Based on Open Source– Catalog – Elastic Search– Workflow – Activiti– Scheduler – Quartz– API Docs – Swagger– Install Automation – Puppet– Message Bus - RabbitMQ– Others
• Modern Web-based UI– AngularJS– Node.js– html5
© Copyright 2017 Dell Inc.20
• Not-for-profit health care system• 6 Hospitals• 19 Clinics• 6 Nursing Homes
© Copyright 2017 Dell Inc.21
• Goal: Reduce EPIC production (health care app) DB backup & restore times
• DB is 9TB, and growing
• Storage is on XtremIO
• LVM striping across the vols for the DB (4, 4TB volumes), on a single VG
• Support Linux and XFS file system
• Support VMware with VM raw device mapping (RDM)
• Design Considerations
Requirements
• Extending a volume (LUN) vs adding a volume
© Copyright 2017 Dell Inc.22
Site 2Site 1
Previous environment
Epic(FC)
Database: EPIC CacheSize: 9TB
Backups: 7 hoursRestores: 14 hours
Solution: TSM
(FC)
Backup Storage
Snaps1. Catch up mirrors with a sync2. Freeze Database3. Sync (Flush to disks)4. Sync mirrors again5. Create snapshot session6. Thaw Database7. Activate snap session8. Check file systems9. Mount file systems10.Run backup at file level11.Verify backup status12.Unmount file system13.Deactivate snap session
VNX 7600VNX 7600
VioServers
VioServers
© Copyright 2017 Dell Inc.23
Site 1
Environment with eCDM & ProtectPoint
Site 2
1. Freeze Database2. Sync to disk3. Run ProtectPoint snap4. Thaw Database5. Run ProtectPoint Backup6. Verify backup compliance
with eCDM
EpicRecoverPoint
VM VM
Replication
ESX: RDM
Database: EPIC CacheSize: 9TB
Backups: 35 MinutesRestores: 1 hour
Solution: eCDM/PP(FC)
ESX: RDM
(FC)
VM
ESX: RDM
VM
(FC)
© Copyright 2017 Dell Inc.24
• Check to make sure we are getting good backups.
• 31 Daily• 13 Weekly• 13 Monthly• 7 Yearly
Enterprise Copy Data Management
© Copyright 2017 Dell Inc.26
Demo
• Dashboard overview
• Configuration and settings
• Asset discovery
• Protection Plan
• Compliance monitoring
© Copyright 2017 Dell Inc.27
Learn more: join the conversation
@DellEMCProtectDell EMC Storage and Data ProtectionDell EMC Data Protection CommunityData Protection on EMC.comMozy.comSpanning.com
© Copyright 2017 Dell Inc.28
Want to win a Levitating Death Star Speaker?
• Follow @DellEMCProtect while at Dell EMC World
• 2 Winners will be chosen daily from Monday May 8 to Thursday May 11
• All winners will be notified through Twitter Direct Message
NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/
© Copyright 2017 Dell Inc.30
ProtectPoint technology configurationOperation ProtectPoint eCDM 1.1 DifficultyInstall SAN connectivity, configure VMAX DX ports, zoning Manual Manual 4
Create user Manual Manual 1
Create DDBoost storage unit Manual Manual 1
Create DD vDisk Pool(s) Manual Manual 1
Create vDisk Devices of same geometry and size as primary LUNs Manual Automated 7
Create device group for backup and restore Manual Automated 2
Create access group and add initiators to group Manual Manual 4
Add devices to access group Manual Automated 2
Encapsulate the vDisk Devices to VMAX FAST.X devices Manual Automated 10
Register Data Domain, XtremIO, DD vDisk Pools, and XtremIO in RecoverPoint Manual Manual
2
Install ProtectPoint agent(s) Manual Manual 3
Create and maintain backup configuration file Manual Helps** 9
© Copyright 2017 Dell Inc.31
A Massive ReleaseeCDM 2.0
DBA
NATIVE DBINTERFACE DATABASES
VIRTUALMACHINES
INFRAADMIN
eCDMINTERFACE
DATADOMAIN
STORAGEADMIN
eCDMINTERFACE
In 1.0 We Delivered:• A Basic Platform & UX• Basic ProtectPoint Management• Basic Snapshot Management
In 2.0 We Deliver:• Broad Platform & UX Improvements• Two New Data Paths: DD Boost & PP4VM• DDBEA Automation• Data Domain Automation• ProtectPoint Automation (v2)
PRIMARYSTORAGE
© Copyright 2017 Dell Inc.32
DBANATIVE DBINTERFACE
eCDMData Domain
1Start with DD Boost for SQL• Fast Backups• Lightweight• DBA in Control
2 Automated Onboarding• Automatic Database Discovery• Automatic Configuration of DDBEA
3Data Domain Provisioning• Mtree Setup Including Replication• PP Setup if Necessary• No scripting, All from the eCDM UI/API
Setup• No Scripting• No Trouble Tickets• One UI for the Backup Admin• DBA is Ready to Go
4 Ongoing Discovery• DBA Drives Backups.• eCDM Discovers & Catalogs.
5Protection Compliance• SLOs measured and reported. • Retention Locks Applied on DD.• Backups deleted at end of retention.
Steady State• DBA In Control• Running in Guardrails• Visibility Across the Farm• Full Protection• No Caveats
6Centrally Scheduled Copies• The Backup Admin’s Last Line of Defense• Primary Storage Snapshots• VMW Image Backups
SQL ProtectioneCDM 2.0