oracle data integrator 12c - getting started
TRANSCRIPT
![Page 1: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/1.jpg)
OracleDataIntegrator12c:GettingStarted
MichaelRainey|UTOUGTrainingDays2017
![Page 2: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/2.jpg)
• MichaelRainey-TechnicalAdvisor• Spreadingthegoodwordaboutgluentproductswiththeworld
• OracleDataIntegrationexpertise
• OracleACEDirector
• mRainey.co
• gluent.com
2
Introduction
we liberate enterprise data
![Page 3: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/3.jpg)
AboutGluent
We are long term Oracle Database & Data Warehousing guys – long history of performance & scaling
About 20 people in distributed teams in US & UK
The world is changing – we help customers to get the best out of both worlds!
we liberate enterprise data
Gluent Data Platform enables all applications to access all enterprise data, at anytime, on demand, and without any code migration or rewrites
![Page 4: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/4.jpg)
• GluenttobefeaturedintheStartupShowcaseatStrata+HadoopWorld(Tomorrow!)
• HadoopforDatabaseProfessionals one-daytrainingcourse(March21st)
4
Quickannouncements
gluent.com/event/hadoop-for-database-professionals-2
![Page 5: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/5.jpg)
Why“GettingStarted”
![Page 6: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/6.jpg)
6
Manyconferencepresentationsgettootechnical,toofast
![Page 7: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/7.jpg)
WhatisODI?
![Page 8: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/8.jpg)
• E-LT(Extract,Load,Transform)vsETL• Heterogeneoussourcesandtargets• Builttointegratealldata
• Flexibility• Reusablecodetemplates(KnowledgeModules)
• OpenAPI
• ODIwilladapttoyourdatawarehouse-andnottheotherwayaround
• Flowbasedmappings• LogicalvsPhysical
8
WhatisODI?
![Page 9: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/9.jpg)
9
WheredidODIcomefrom?
Early2000s:Sunopsisformed
2006:OracleacquiresSunopsis.
2010:OracleDataIntegrator11greleased.Oracle’sfirstrealupdatetoODI.
Late2013:OracleDataIntegrator12creleased,combiningODIandOWBfeatures.
2012:ODIforBigDatafirstreleased
![Page 10: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/10.jpg)
10
ODI12cArchitectureandComponents
*imagesource:https://docs.oracle.com/middleware/1221/odi/concepts/img/architecture.png
![Page 11: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/11.jpg)
11
TypicalODIrepositorysetup-thebasics
Source:ateam-oracle.com/how-many-odi-master-repositories-should-we-have
![Page 12: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/12.jpg)
12
TypicalODIrepositorysetup-full-blownenvironment
Source:ateam-oracle.com/how-many-odi-master-repositories-should-we-have
![Page 13: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/13.jpg)
InstallationandConfiguration
![Page 14: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/14.jpg)
• Knowthedifferenttypesofinstalls• Standard-usedforStandaloneAgentoronclientmachine(ODIStudioonly)
• Enterprise-JEEAgentorColocatedAgent,ODIConsole,FMCplugin
14
Chooseyourinstallationtypewisely
![Page 15: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/15.jpg)
15
Configurationishalfthebattle
CONFIGURATION
![Page 16: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/16.jpg)
• ODI_HOME/odi/studio/odi.sh|exe• Connecttoexistingrepository• Ifnoneexists,runRCUfirst
• Boom,you’rein!
16
ODIStudioConfiguration
![Page 17: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/17.jpg)
• ODI_HOME/oracle_common/common/bin/config.sh|exe• RuntheWebLogicServerconfigurationwizard
• StandaloneAgent• CreatedomainoutsideofODIOracleHome
• JEEAgent• Addcredentialsmapping
• Create/configureadminserver,nodemanager,topology,etc.
17
StandaloneorJEEAgentConfiguration
![Page 18: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/18.jpg)
18
ODIAgent-howitworks
ODIAgent
ODIrepository
Sourcedatabase
Targetdatabase
1.Executionrequestviahttp(s)
2.AgentcommunicateswithODIrepositorytogeneratecodeandgathersource/targetconnection
3.Agentpassescodetosource/targetdatabasesandupdatesrepositoryexecutionlogs
![Page 19: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/19.jpg)
GettingStarted
![Page 20: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/20.jpg)
• DataServer• Connectiontothedatasource
• PhysicalSchema• Databaseschema
• Workschema
• LogicalSchema• Abstractsthephysicalconnection/schemafromthelogical
• DevelopmentoccursagainsttheLogicalSchema
• Model• MetadataobjecttiedtoLogicalSchema
• Representsdatabaseschema,filedirectory,XMLdocument,etc
• Datastore• Logicalrepresentationoftable,file,XMLelement,etc.
20
Topology,Contexts,Models,andDatastores-Ohmy!
Alloftheseobjectsmustbecreatedandsetuppriortoanymappingdevelopmentcanoccur.
![Page 21: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/21.jpg)
• There’sanotherwaytogetstarted-quickly!• NewModelandTopologyObjectswizard-ODI12.1.3• InODI11g,theODIQuickStartwasa10stepchecklist,whereeachstepledtoanothersectioninthedocumentation
21
Developer’sQuickstart
![Page 22: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/22.jpg)
22
Topology,Contexts,Models,andDatastores
![Page 23: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/23.jpg)
23
LogicalConstraintsonthemetadata
![Page 24: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/24.jpg)
23
LogicalConstraintsonthemetadata
![Page 25: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/25.jpg)
23
LogicalConstraintsonthemetadata
![Page 26: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/26.jpg)
23
LogicalConstraintsonthemetadata
![Page 27: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/27.jpg)
MappingsandKnowledgeModules
![Page 28: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/28.jpg)
25
Mappings-LogicalDatastorecomponent
Joincomponent
Splitoutputtomultipletargettables
MappingsarebuiltfromdatastoreandcomponentstologicallyformtheETL
![Page 29: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/29.jpg)
26
Mappings-Physical
Physicalimplementationsofthemappingsarerepresentedbasedonlocationofthedatastore.KnowledgeModulesareselectedtogeneratethecode.
![Page 30: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/30.jpg)
26
Mappings-Physical
Physicalimplementationsofthemappingsarerepresentedbasedonlocationofthedatastore.KnowledgeModulesareselectedtogeneratethecode.
ODIwilladapttoyourdatawarehouse-andnottheotherwayaround
![Page 31: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/31.jpg)
27
KnowledgeModules-thesecretsauce
*imagesource:FusionMiddlewareDevelopingKnowledgeModuleswithOracleDataIntegrator
![Page 32: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/32.jpg)
27
KnowledgeModules-thesecretsauce
*imagesource:FusionMiddlewareDevelopingKnowledgeModuleswithOracleDataIntegrator
![Page 33: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/33.jpg)
27
KnowledgeModules-thesecretsauce
*imagesource:FusionMiddlewareDevelopingKnowledgeModuleswithOracleDataIntegrator
![Page 34: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/34.jpg)
OrchestrationPackagesandLoadPlans
![Page 35: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/35.jpg)
• Grouplikeobjectstogether• Performspecializedtasks(looping,etc)
29
Packages
![Page 36: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/36.jpg)
• ExecutesScenarios(executionobjectsthatareessentiallycompiledcode)• Stepscanberuninparallelorserially• If-then-elsestepcanevaluateavariabletodeterminepath• Exceptionstepscanbecustomizedandexecutedonfailure
30
LoadPlans-thetoplevelorchestrationobject
![Page 37: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/37.jpg)
MoreflexibilityProcedures
![Page 38: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/38.jpg)
• Reusablecomponentsforadmintasks• DDL,filearchivescripts,exceptionhandling,etc
• Movingortransformingdata,itprobablyshouldbeamapping• Creatingacomplex,recurringtaskfordatamanipulation,probablyaKnowledgeModule
32
Proceduresformaintenancetasksandone-offfunctions
Imagessource:http://ritt.md/9E
![Page 39: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/39.jpg)
• IntegrationwithGoldenGate(changedatacapture)andEnterpriseDataQuality(for…dataquality)• ODIforBigData• ODICloudService
33
Othernotablefeatures
![Page 40: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/40.jpg)
• OracleDataIntegratoris…• anE-LT/dataintegrationtool
• builttointegratealldata
• flexible.ODIwilladapttoyourdatawarehouse-andnottheotherwayaround
• Chooseyourinstallationwiselyandknowconfigurationismoreinvolved• ManyobjectsmustbecreatedpriortoMappingdevelopment
• UsetheDeveloper’sQuickstart!
• Flowbasedmappingsseparatebusinesslogicfromphysicalimplementation• KnowledgeModulesarethe“secretsauce”ofODI• Moreinfo: mRainey.co/odi12c-getting-started ateam-oracle.com/?cat=64 blogs.oracle.com/dataintegration
34
Recap
![Page 41: Oracle Data Integrator 12c - Getting Started](https://reader030.vdocuments.mx/reader030/viewer/2022020119/58d0fc051a28abc00b8b639d/html5/thumbnails/41.jpg)
35
we liberate enterprise data
thank you!