goldengate administration

GoldenGate Administration

Lorena Lobato Pardavila - CERN

Replication Technology Evolution for ATLAS Data Workshop

Outline• GoldenGate installation and integration with RAC• GoldenGate processes management• Data Instantiation• Questions

3Replication Technology Evolution for ATLAS Data Workshop

GoldenGate Overview Most Oracle GoldenGate functionality is controlled by

means of parameters specified in parameter files

OGG uses two types of parameter files: GLOBALS file and runtime parameter files

Database Configuration

o Database running in ARCHIVELOG modeo Enable FORCE LOGGINGo Create supplemental log groups required for conflict

detectiono Configure the Streams Poolo Install the UTL_SPADV package (Optional)


GoldenGate Overview Key GoldenGate configuration

Enable supplemental log groups to ensure conflict detection Recommended to use integrated capture mode Extract to take advantage

of the integration with the log miner server Configure multiple parallel Replicat processes using batched SQL for higher

apply performance


GGSCI

EXTRACT

REPLICAT

DATA PUMP

MANAGER

GLOBALS

GLOBALS file

-- Specifies a default checkpoint table

CHECKPOINTTABLE <owner.tablename>

-- Enable to be monitored by OEM or OGG Monitor (Optional)

ENABLEMONITORING

-- Specifies the name of the schema that contains the database

objects that support DDL synchronization for Oracle

GGSCHEMA <schema_name>


GGSCI > add checkpointtable GGADMIN.CKPTAB

Parameter file:Manager

PORT <port number>

PURGEOLDEXTRACTS <path to the trail file>, USECHECKPOINTS, MINKEEPHOURS <"x" hours>, MINKEEPFILES <"y" number of files>

AUTORESTART EXTRACT *, RETRIES <x>, WAITMINUTES <y>, RESETMINUTES <z>

LAGREPORTMINUTES <x> LAGCRITICALMINUTES <y>


Parameter file:Extract


EXTRACT <Extract name>

SETENV (ORACLE_HOME = "<Oracle home path>”)

USERIDALIAS <username>@<db tns>

EXTTRAIL <extract trail path/two character trail id>

REPORTCOUNT EVERY <n> MINUTES, RATE

TRANLOGOPTIONS INTEGRATEDPARAMS (max_sga_size <n>, parallelism <n>)

DDL INCLUDE ALL, EXCLUDE OBJNAME "<schema name>.<object name>" DDLOPTIONS ADDTRANDATA Table <source schema name>.<table name>;

Parameter file:Data PumpEXTRACT <Pump name> PASSTHRU RMTHOST <Remote hostname>, MGRPORT <Target manager port number>, TCPBUFSIZE <n>, TCPFLUSHBYTES <n>,COMPRESS RMTTRAIL <extract trail path/two character trail id> DISCARDFILE <diacard file path/<discard file name.dsc>, APPEND Megabytes <n> DISCARDROLLOVER AT <hh:mi> on <day of the week> REPORTCOUNT EVERY <n> HOURS, RATE Table <source schema name>.<table name>;


Data Pump: TCP parameters


TCPBUFSIZE and TCPFLUSHBYTES very useful for increasing the buffer sizes and network packets sent by data pump over the Wide Area Network

To determine suitable value, the TCPBUFSIZE and TCPFLUSHBYTES should be equal to BDP = Bandwidth * RoundTimeTrip between source and destination

Several tests executed and no significant changes observed except for compress data as expected

Oracle recommeds to size OS TCP kernel parameters to higher than the value chosen for the GoldenGate TCP parameters above mentioned

o net.core.rmen_maxo net.core.wmen_maxo net.ipv4.tcp_rmemo net.ipv4.tcp_wmemo net.ipv4.tcp_window_scaling = 1

Parameter file:ReplicatREPLICAT <Replicat name> SETENV (ORACLE_HOME = "<Oracle home path>")

USERIDALIAS <username>@<db tns>

ASSUMETARGETDEFS

DBOPTIONS INTEGRATEDPARAMS(PARALLELISM 4)

DISCARDFILE <path discard file name.dsc>, APPEND Megabytes <n> DDL INCLUDE ALL, EXCLUDE/INCLUDE OBJNAME "<schema name>.<object name>"DDLOPTIONS REPORT BATCHSQL REPORTCOUNT EVERY <n> HOURS, RATE

MAP <source schema name>.<table name>, TARGET <target schema name>.<tablename>;


Creation/Running GoldenGate processes

13UKOUG 2013

SOURCEManager GGSCI> start mgr

Credentials

GGSCI> ADD CREDENTIALSTOREGGSCI> ADD CREDENTIALSTORE add user <user_alias>@<db tns>

Extract

GGSCI> dblogin useridalias <user_alias>@<db tns>GGSCI> add extract <extract_name> , integrated tranlog, begin nowGGSCI> add exttrail <trail_path/xx>, extract <extract _name> , megabytes <n>

GGSCI> register extract <extract_name> databaseGGSCI> start extract <extract_name> Data Pump

GGSCI> add extract <extract_name> , exttrailsource <trail_path / xx> GGSCI> add rmttrail <remote_trail_path/yy> ,extract <extract_name> ,megabytes <n> GGSCI> start extract <extract _name>

Creation/Running GoldenGate processesManager GGSCI> start mgr

Credentials

GGSCI> ADD CREDENTIALSTOREGGSCI> ADD CREDENTIALSTORE add user < user_alias >@<db tns>

Replicat

GGSCI> dblogin useridalias <user_alias>@<db tns>GGSCI> add replicat <replicat_name> integrated, exttrail <remote_trail_path/yy> GGSCI> register replicat <replicat_name> databaseGGSCI> start replicat <replicat_name>

And to edit parameter files…

GGSCI> edit params <process_name>GGSCI> send <extract/replicat> <process_name>, <parameter>

14UKOUG 2013

TARGET

Info processes• Info all• Stats <process_name>• View report <process_name>• View params <process_name>

15UKOUG 2013

Outline• GoldenGate installation and integration with RAC• GoldenGate processes management• Data Instantiation• Network performance tuning for GoldenGate• Questions


Data instantiation

Process of getting source and replica data in sync

It is not trivial for a data being updated continuously

Two scenarios

o Configuring a new replicationo Adding schema(s) to an active configuration



Extract , DataPump,

Replicat creation

Start Extract,

DataPump

Start Replicat with HANDLECOLLISIONS

parameter

START MGR

COPY (expdp/impdp)

Remove HANDLECOLLISIONS

Replication creation

COLLISION TIME


Add schema to Extract and

DataPump and Replicat process

COLLISION TIME

Adding schema to active replication

Stop replicat

COPY (expdp/impdp)

Start Replicat with HANDLECOLLISIONS

parameter

Remove HANDLECOLLISIONS

THANK YOU!

[email protected]

Replication Technology Evolution for ATLAS Data Workshop

goldengate administration

Documents