epsilon – oracle sharding use case in public cloud · 2018-12-06 · • epsilon is...
TRANSCRIPT
![Page 1: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/1.jpg)
©2014 Epsilon. Private & Confidential
Epsilon– OracleShardingUseCaseinPublicCloud
GairikChakrabortySeniorDirector,DatabaseAdministration,Epsilon
1
![Page 2: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/2.jpg)
Copyright©2018, Oracleand/oritsaffiliates.Allrightsreserved.|
• SnapshotofEpsilon• OracleShardingUseCaseinPublicCloud
Agenda
![Page 3: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/3.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
3
• Epsilonisall-encompassingglobalmarketingcompany,wearegloballeaderinturningdata-drivenmarketingintopersonalizedcustomerexperienceandlastingrelationships
• Morethan9000associatesand70officesworldwide
• Largestpermission-basede-mailerintheworld,deliveringover75billionemailsannually
• World’sleadingsourceofdatawithinformationcoveringover1.5Bindividualrecordsand278Mdevices
• Morethan2,000globalclients,including26oftheFortune10049outof10TopBanks48outof10TopRetailers49outofTop10PharmaceuticalCompanies
EpsilonataGlance
![Page 4: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/4.jpg)
Copyright ©
Epsilon 2017 E
psilon Data M
anagement, LLC
. All rights reserved.
4
Wedeliverpersonalizedconnections,buildloyaltyanddrivebusinessforbrandsaroundtheworld
![Page 5: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/5.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
5
OracleShardingUseCaseinPublicCloud
5
![Page 6: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/6.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
6
• Loyaltyrealtimemarketingsolutionwithextremeavailability,performanceandscalabilityrequirement
• Deploymentshouldsupportanypubliccloudaswellasonpremisesifneeded–productofferingiscloudfirst
• PlatformsupportsrealtimePOSintegrationwithaveragecalltimefrom200-500msaverageandeachAPIcallcanhavemultiple(20–100)SQLsinternally
• Scaleoutsolutionwhichcangrowflexiblybasedonworkloaddemand
• Scalable,reliableandhighlyavailableinfrastructurealongwithindustrystandardsecurityandauditing
HighLevelOLTPApplicationBusinessRequirements
![Page 7: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/7.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
7
WhywelikeOracleSharding
• Loyaltymarketingsolutionincludesprocessingofhighvolumeofcomplexfinancialtransactionwhichrequiresstrongmultiversionconcurrencycontrol,dataprotection,security,etc.§ NoSQLsolutionsarenotverygoodfitforthoseusecases
• Applicationisusingmanycomplexjoinsandasolutionneedstosupporttheexistingcodewithminimalchange
• Useallotherexistingoraclefeaturelikedataconsistency,security,availability,robustperformanceoptimizer,backupandrecoverywhicharekeyforbusinesscriticalapplicationdeploymentandarealreadypartofOracleShardingframework
• UsingOracleSharding,OLTPdatabasecanscaleupandscaleoutandweexpecttouselessernumberofshardsbasedonworkloaddemand
![Page 8: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/8.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
8
ConsiderationbeforeusingOracleSharding
• Applicationdatamodelneedstochangetosupportsharding
• Identifytransactiontableswhichcanbesharded,referencetableneedstobeduplicated
• Selectappropriateshardingkeyandshardingmethod
• NondefaultglobaldatabaseservicecreatedusingGSDCTLneedstobeusedforconnection
• DataaccessforOLTPshoulduseshardingkeyasmuchaspossibletoavoidcrossshardoperationwhichisexpensiveintermsofexecutiontime
• Applicationneedtousedriverwhichhasshardingsupportinbuilt.ExampleincludesOracleJDBC,OCI,ODP.NET(unmanageddriver),OracleUCP,etc.
• Shardcatalogsetupisprotectedwithactivedataguardwithmaximumavailabilityprotectionandfaststartfailoverenabled
![Page 9: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/9.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
9
OLTPSystemDeploymentArchitectureatPublicCloud
![Page 10: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/10.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
10
Application Load Balancer
Web Servers – ODP.NET Connection Pool
Web Service Call
OLTP Batch Reports
OLTP Service
Batch Service
Site 1
Primary DB
Application Load Balancer
Web Servers – ODP.NET Connection Pool
OLTP Batch Reports
Report Service
Site 2
Standby DB
ApplicationServicePlacement:CurrentState
FAN/FCF
ActiveDataGuard
Web Service Call
FAN/FCF
![Page 11: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/11.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
11
Application Load Balancer
Web Servers– ODP.NET Connection Pool
Web Service Call
OLTP Batch Reports
OLTP Service
Batch Service
Site 1
Application Load Balancer
Web Servers – ODP.NET Connection Pool
OLTP Batch Reports
Report Service
Site 2
Standby DB
ApplicationServicePlacement:TargetStatewithSharding
FAN/FCF
ActiveDataGuard
Web Service Call
FAN/FCF
Shard Directors
Shard Catalog
Shard Catalog
Shard Director
Primary Shards Standby Shards
![Page 12: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/12.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
12
POCResult– HorizontalScalability
![Page 13: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/13.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
13
Best Practices
• GlobalserviceusedforODP.NETneedstohave–notificationsettoTRUEusingGDSCTLwhileconfiguringserviceforFAN
• ClientsideTNSshouldpointtomultiplesharddirectorsforhighavailabilityinsteadofshardnodes.
• Backupsshouldnotrunduringchunkmovement(eitherduringre-shardoperationormanualchunkmovement)asthatwillnothavecorrectdatalayout.
• Duringrecovery,validateorrecovershardoptionmaybeneededtosyncitwithshardcatalog
![Page 14: Epsilon – Oracle Sharding Use Case in Public Cloud · 2018-12-06 · • Epsilon is all-encompassing global marketing company, we are global leader in turning data -driven marketing](https://reader033.vdocuments.mx/reader033/viewer/2022041823/5e5f37655cecec0b3a6b2ff3/html5/thumbnails/14.jpg)
©2014 Epsilon D
ata Managem
ent, LLC. Private & C
onfidential
14
Future Plans
• CollaboratewithoracleengineeringteamtoconvertEpsilonloyaltysolutiontobeshardingcapable,configureapplicationforzerodowntimeusingfeatureslikeapplicationcontinuityduringshardfailureorre-shardoperation,etc.
• PlantodeployOracleshardingformanycustomersasnextgenerationtruehorizontallyscalablemultiplecloudglobalsolutionacrossanyregionaspartofEpsilon’sgloballoyaltyplatformdeploymentplan