oracle9 i * real application clusters (rac) with red hat linux advanced server* 2.1 powered by intel...

44

Upload: pierce-pitts

Post on 03-Jan-2016

224 views

Category:

Documents


1 download

TRANSCRIPT

Oracle9Oracle9ii* Real Application Clusters (RAC) * Real Application Clusters (RAC) with Red Hat Linux Advanced Server* 2.1 with Red Hat Linux Advanced Server* 2.1 Powered by IntelPowered by Intel®® Itanium Itanium®® 2 Processors 2 Processors

Bill Garner, Sr. Oracle DBABill Garner, Sr. Oracle DBAFirst Trust Corporation First Trust Corporation

Wally Pereira, Sr. Technical ArchitectWally Pereira, Sr. Technical ArchitectIntelIntel®® Solution Services, Intel Solution Services, Intel®® Corporation Corporation

Gary Dodge, Principal Sales ConsultantGary Dodge, Principal Sales ConsultantOracle CorporationOracle Corporation

Session id: 36878

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

3

AgendaAgenda About First TrustAbout First Trust

Oracle9Oracle9ii* Real Application Clusters (RAC) * Real Application Clusters (RAC)

Installing and configuring Oracle9Installing and configuring Oracle9ii RAC on Intel RAC on Intel®® ItaniumItanium®® 2-based servers 2-based servers

Testing resultsTesting results

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

4

About First Trust

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

5

About First TrustAbout First Trust

Serving investors and their financial representatives Serving investors and their financial representatives since 1962since 1962

One of the nation’s largest trustees of self-directed One of the nation’s largest trustees of self-directed retirement accountsretirement accounts

Administers 259,000 retirement and custodial Administers 259,000 retirement and custodial accounts valued at $21.8 billionaccounts valued at $21.8 billion

Another resource from Fiserv, Inc.Another resource from Fiserv, Inc.

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

6

About First Trust’s Choices:About First Trust’s Choices:Why Intel® Architecture-based Solutions?

Business NeedBusiness Need– First Trust was looking for an architecture that could deliver a

price/performance advantage for its securities trading back office processing application

Customer GoalCustomer Goal– High availability: 24x7, 99.999 availability

– High-performance to reconcile an increasing volume of daily trades in a fixed timeframe

– Standby database at disaster recovery site

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

7

About First Trust’s Choices:About First Trust’s Choices:Why Intel® Solution Services?

IntelIntel® ® Solution ServicesSolution Services − Intel Corporation’s professional services organization− Foremost expertise in Intel® architecture and next-generation

technologies− Worldwide consultants design cost-effective, leading-edge

solutions that deliver superior business results

• Services Intel Consultants ProvidedServices Intel Consultants Provided − Evaluated the application and its components for optimization and

availability improvements− Assisted First Trust in porting its application to Red Hat Linux

Advanced Server* 2.1 for Intel® Itanium® 2 microarchitecture

• Business Value for First Trust Business Value for First Trust − Increased performance and availability for key trading solution

and completed a timely deployment

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

8

About First Trust’s Choices: About First Trust’s Choices: Why This Technology Suite?

HP 2600* servers powered by IntelHP 2600* servers powered by Intel®® Itanium Itanium®® 2 2 processorsprocessors

Red Hat Linux Advanced Server* 2.1 for Intel Red Hat Linux Advanced Server* 2.1 for Intel ItaniumItanium 2 microarchitecture2 microarchitecture

Oracle9Oracle9ii * RAC* RAC

XIOTech Magnitude* storage architectureXIOTech Magnitude* storage architecture

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

9

About First Trust’s Choices:About First Trust’s Choices: Simple System Architecture Powered by Intel® Itanium® 2

Processors

Two databases onTwo databases on XIOTech* StorageXIOTech* Storage

Gigabit Switch

First Trust Network

HP 2600Server

HP 2600*Server

HP 2600 Standby Server

Brocade* Switch

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

10

About First Trust’s Choices: About First Trust’s Choices: Why HP 2600* Servers Powered by

Intel® Itanium® 2 Processors?

Investment protectionInvestment protection– Maximize return on investment with

improved price/performance – Easy upgrade to future Intel® Itanium® 2

processors– Greater choices than proprietary

operating systems

Increased power per processorIncreased power per processor – First Trust used 1GHz processor – Now available up to 1.5GHz processor

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

11

IntelIntel®® Itanium Itanium®® 2 microarchitecture enables large 2 microarchitecture enables large inin memory processingmemory processing

– 1024 TB memory addressing– Decreases I/O to disk

Deployed 3MB On-Dye L3 cache for this projectDeployed 3MB On-Dye L3 cache for this project– Decreases memory accesses– 6MB On-Dye cache now available

Explicitly Parallel Instruction Architecture (EPIC)Explicitly Parallel Instruction Architecture (EPIC)– Can issue up to six instructions per clock cycle– Effective branch prediction architecture

6.4GB front side bus bandwidth6.4GB front side bus bandwidth

About First Trust’s Choices:About First Trust’s Choices:Why HP 2600* Servers Powered by

Intel® Itanium® 2 Processors?

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

12

Oracle9i* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

13

Oracle9Oracle9ii* RAC* RAC A single Oracle9A single Oracle9ii* database!* database!

– One set of database files accessed by multiple instances

– First Trust has two instances deployed

– One set of Initialization parameter values

Each instance has its ownEach instance has its own– “Thread” of redo commands (its own redo log files on shared storage)

– Undo tablespace

– Unique instance specific initialization parameter values

Additional components not in a single-instance Oracle9Additional components not in a single-instance Oracle9ii::– A cluster manager

– A “quorum disk” file

– An optional cluster file system

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

14

FailoverFailover– Server-side

RAC instances monitor each other Failover protection - if one instance fails, another does the

housekeeping necessary to recover completed transactions from redo logs

– Client-side Oracle Net Services Transparent Application Failover* can be

configured to automatically reconnect the client to a surviving node

Connection load balancingConnection load balancing– Client-side

Specify in TNSNAMES or in OID

– Server-side Can specify with REMOTE_LISTENER parameter in spfile/init.ora LISTENER attribute of DISPATCHERS parameter

Oracle9Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

15

Installing and Configuring

Oracle9Oracle9ii* RAC with * RAC with

Red Hat Linux Advanced Server* 2.1 Red Hat Linux Advanced Server* 2.1

on Intelon Intel®® Itanium Itanium®® 2-based Servers 2-based Servers

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

16

Installation Installation – Use Red Hat Linux Advanced Server 2.1 for IntelUse Red Hat Linux Advanced Server 2.1 for Intel®® Itanium Itanium®® 2 2

microarchitecturemicroarchitecture

– Use Use Oracle9i* Enterprise Edition for Intel Itanium 2 Enterprise Edition for Intel Itanium 2 microarchitecturemicroarchitecture

As of August 2003As of August 2003– Raw partitions were required when using Oracle9i RAC on Intel

Itanium 2 microarchitecture

– Oracle Cluster File System* (OCFS) for Itanium 2 Linux available as of August 21, 2003; not in time for this project.

– OCFS for Intel® Xeon™ processor-based solution running Linux has been available for over a year.

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

17

Installing Red Hat Linux Advanced Server* 2.1 Installing Red Hat Linux Advanced Server* 2.1 on Intelon Intel®® Itanium Itanium®® 2 Microarchitecture 2 Microarchitecture

Step 1 - Install default installation on each serverStep 1 - Install default installation on each server– Example server names: rac1, rac2, etc.

Step 2 - Set up interconnect networkStep 2 - Set up interconnect network– Create addresses and server names for private interconnect

Use 10.0.0.x address for each server Example private interconnect server names: ic-rac1, ic-rac2, etc.

– Enable trusted relationship on private interconnect for the Oracle user Ensure rcp and rsh (or equivalent) work across the private interconnect Enable telnet and ftp services between servers over the private interconnect

Step 3 - Set up semaphores and open files parametersStep 3 - Set up semaphores and open files parameters– Use /etc/rc.local file, see installation manual for details

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

18

Configuring a Shared Drive

Step 1 - Configure logical unit number (LUN) to Step 1 - Configure logical unit number (LUN) to present to the serverspresent to the servers

– One LUN will allow 15 raw partitions under the current fdisk version

– One raw partition = one Oracle data file

– If more than 15 data files, then more than 1 LUN is required; First Trust used six LUNs

– Future releases of Red Hat Linux Advanced Server* for Intel® Itanium® 2 microarchitecture will increase the number of raw partitions per LUN.

Step 2 - Use fdisk to cut raw partitionsStep 2 - Use fdisk to cut raw partitions– Create two 150MB raw partitions for configuration files (srvcfg and

quorum)

Installing Red Hat Linux Advanced Server* 2.1 Installing Red Hat Linux Advanced Server* 2.1 on Intelon Intel®® Itanium Itanium®® 2 Microarchitecture 2 Microarchitecture

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

19

Configuring a Shared Drive

Step 3 - Use fdisk to cut raw partitions continuedStep 3 - Use fdisk to cut raw partitions continued– Create raw partition slices for

Each data file in the database

Redo log files - at least two for each node

Control files - two or three required

Archive log directory is typically not on raw partitions

Step 4 - Bind raw partitions to the system with Step 4 - Bind raw partitions to the system with ‘make node’ file‘make node’ file

– Example:

mknod /oradata/prod/prod_redo1_2 c 162 134

mknod /oradata/prod/prod_redo1_3 c 162 135

mknod /oradata/prod/prod_redo2_1 c 162 136

Installing Red Hat Linux Advanced Server* 2.1 on Installing Red Hat Linux Advanced Server* 2.1 on IntelIntel®® Itanium Itanium®® 2 Microarchitecture 2 Microarchitecture

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

20

Configuring a Shared Drive

Step 5 - Create ‘make raw’ fileStep 5 - Create ‘make raw’ file– Example:

raw /oradata/prod/prod_redo1_2 /dev/sde5

raw /oradata/prod/prod_redo1_3 /dev/sde6

raw /oradata/prod/prod_redo2_1 /dev/sde9

Step 6 - Create symbolic links to simplify access to raw Step 6 - Create symbolic links to simplify access to raw partitionspartitions

Step 7 – Set up the hangcheck-timer (a memory module)Step 7 – Set up the hangcheck-timer (a memory module)

Installing Red Hat Linux Advanced Server* 2.1 on Installing Red Hat Linux Advanced Server* 2.1 on IntelIntel®® Itanium Itanium®® 2 Microarchitecture 2 Microarchitecture

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

21

Tips for the Hangcheck-timer Parameters

Hangcheck-timer Hangcheck-timer – Enables one node to determine if another node has failed and then

ejects the hung node

Default settings Default settings – NOTE: The system will wait for up to five minutes before determining

that another node had failed

To reduce to one minute, First Trust used these To reduce to one minute, First Trust used these settings:settings:

– In rc.local: /sbin/insmod hangcheck-timer hangcheck_tick=10 hangcheck_margin=30

– In $ORACLE_HOME/oracm/admin/cmcfg.ora MissCount=40

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

22

Setting Up the Oracle Cluster Manager

Step 1 - Copy Oracle Release 9.2.0.2 CDs to /Disk1, Step 1 - Copy Oracle Release 9.2.0.2 CDs to /Disk1, /Disk2, /Disk3 respectively/Disk2, /Disk3 respectively

– Release 9.2.0.2 is the first release for Intel® Itanium® 2 microarchitecture

Step 2 - Change directory to /Disk1 Step 2 - Change directory to /Disk1 – Execute runInstaller* to invoke Oracle Universal Installer* in a Xwindow

Step 3 - Select option to install Oracle Cluster ManagerStep 3 - Select option to install Oracle Cluster Manager– Shared drive is the Quorum disk

Step 4 - Install on both servers and start oracm Step 4 - Install on both servers and start oracm executableexecutable

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

23

Setting Up Oracle Database Software

Step 1 - Choose install Oracle software onlyStep 1 - Choose install Oracle software only– You can chose to install a example database, but this might interfere

with your test database

Step 2 - The OUI (Oracle Universal Installer) installs the Step 2 - The OUI (Oracle Universal Installer) installs the software on all nodessoftware on all nodes

– NOTE: The installer forgets to create two directories– To correct this problem create the following directories:

$ORACLE_HOME/rdbms/audit $ORACLE_HOME/rdbms/log

Step 3 - Separately configure the listener for all nodesStep 3 - Separately configure the listener for all nodes

Step 4 - Use DBCA (Database Configuration Assistant) Step 4 - Use DBCA (Database Configuration Assistant) or a script to create the databaseor a script to create the database

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

24

Configuring the Listener*

SID_LIST_LISTENER =SID_LIST_LISTENER = (SID_LIST =(SID_LIST = (SID_DESC =(SID_DESC = (SID_NAME = PLSExtProc)(SID_NAME = PLSExtProc) (ORACLE_HOME = /oracle/product/9.2.0)(ORACLE_HOME = /oracle/product/9.2.0) (PROGRAM = extproc)(PROGRAM = extproc) ))))LISTENER =LISTENER = (DESCRIPTION_LIST =(DESCRIPTION_LIST = (DESCRIPTION =(DESCRIPTION = (ADDRESS_LIST =(ADDRESS_LIST = (ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC)) )) (ADDRESS_LIST =(ADDRESS_LIST = (ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521))(ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521)) )) )) ))

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

25

Configuring TNSNames* NOTE: There is some sensitivity for specific options and the order.NOTE: There is some sensitivity for specific options and the order. Also, all SIDs, for database and local instances need to be listed in the Also, all SIDs, for database and local instances need to be listed in the

server-side tnsnames file in order for Oracle to start with remote listeners server-side tnsnames file in order for Oracle to start with remote listeners specified in the init.oraspecified in the init.ora

– This configuration workedThis configuration worked: (DESCRIPTION = (ENABLE = BROKEN) (ADDRESS_LIST = (LOAD_BALANCE = ON) (FAILOVER = YES) (ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521)) ) (CONNECT_DATA = (SERVICE_NAME = PROD) (FAILOVER_MODE = (TYPE = SELECT ) (METHOD = BASIC ) (RETRIES = 64) (DELAY = 4) ) ) )

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

26

Creating the Database

Use DBCA or a script to create the database Use DBCA or a script to create the database

If using a script create an init.ora fileIf using a script create an init.ora file

Oracle9Oracle9ii** RAC specific parameters:RAC specific parameters:*.cluster_database=true*.cluster_database=true

*.cluster_database_instances=2*.cluster_database_instances=2

RAC1.instance_name='RAC1'RAC1.instance_name='RAC1'

RAC2.instance_name='RAC2'RAC2.instance_name='RAC2'

RAC2.instance_number=2RAC2.instance_number=2

RAC1.instance_number=1RAC1.instance_number=1

RAC1.local_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521))'RAC1.local_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521))'

RAC2.local_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521))'RAC2.local_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521))'

RAC2.remote_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521))'RAC2.remote_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521))'

RAC1.remote_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521))'RAC1.remote_listener='(ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521))'

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

27

Creating the Database With a script database creation set MAXINSTANCES With a script database creation set MAXINSTANCES

to > the number of instances in the clusterto > the number of instances in the cluster Example can be found at Example can be found at ORACLE_HOME/srvm/admin; ;

edited version below:edited version below:set echo onconnect / as sysdbastartup nomount pfile="/apps/oracle/9.2.0/dbs/initPROD.ora"CREATE DATABASE PRODCONTROLFILE REUSEMAXLOGMEMBERS 3 MAXLOGHISTORY 100MAXDATAFILES 254MAXINSTANCES 32MAXLOGFILES 64DATAFILE '/oradata/PROD/datafiles/systemPROD.dbf' SIZE 600M REUSE AUTOEXTEND ON NEXT 10240K MAXSIZE UNLIMITED EXTENT MANAGEMENT LOCAL DEFAULT TEMPORARY TABLESPACE TEMP_LOCAL TEMPFILE '/oradata/PROD/datafiles/temp_local.dbf' SIZE 2048M REUSE NEXT 640K MAXSIZE UNLIMITEDUNDO TABLESPACE "UNDOTBS1" DATAFILE '/oradata/PROD/datafiles/undotbs1.dbf' SIZE 2048M REUSE NEXT 5120K MAXSIZE UNLIMITEDLOGFILE GROUP 1 ('/oradata/PROD/logfiles/logPROD1_01.dbf') SIZE 110M REUSE,GROUP 2 ('/oradata/PROD/logfiles/logPROD1_02.dbf') SIZE 110M REUSECHARACTER SET US7ASCII ;

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

28

Tips for Creating the Database

For the best performance, all added tablespaces For the best performance, all added tablespaces for a Oracle9for a Oracle9ii** RAC database require:RAC database require:

– EXTENT MANAGEMENT LOCAL

Let Oracle internally manage how extents are allocated using a bitmap in the file header

– SEGMENT SPACE MANAGEMENT AUTO

Uses a bitmap in the segment headers to manage how much free space a block has

0% free, 25% free, 50% free or 75% free

Metalink tests indicate 35% performance improvement over optimally tuned freelists

Not for UNDO tablespaces

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

29

Creating the Database Step 1 - Run the catalog scripts for clusters:Step 1 - Run the catalog scripts for clusters:

– Run the cluster specific script: connect / as sysdba @$ORACLE_HOME/rdbms/admin/catclust.sql

Step 2 - Add a minimum of two log files on shared Step 2 - Add a minimum of two log files on shared disks; for each server:disks; for each server:

– alter database add log file thread 2– group 3 '/oradata/PROD/logfiles/logPROD2_01.dbf' SIZE 110M reuse,– group 4 '/oradata/PROD/logfiles/logPROD2_02.dbf' SIZE 110M reuse;

Step 3 - Add UNDO tablespaces on shared disk, one Step 3 - Add UNDO tablespaces on shared disk, one for each server:for each server:

– CREATE UNDO TABLESPACE "UNDOTBS2" DATAFILE '/oradata/PROD/datafiles/undotbs2.dbf' SIZE 2048M REUSE NEXT 5120K MAXSIZE UNLIMITED EXTENT MANAGEMENT LOCAL;

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

30

Configuring Transparent Application Failover*

NOTE: Transparent Application Failover (TAF) is a part of Oracle Net Services, not Oracle9Oracle9ii* * RAC

Step 1 -TAF is configured in tnsnames.ora file on both the server Step 1 -TAF is configured in tnsnames.ora file on both the server and the clientand the client

Step 2 - Set up the ‘Local Listener’ and the ‘Remote Listener’ in Step 2 - Set up the ‘Local Listener’ and the ‘Remote Listener’ in the init.ora filethe init.ora file

Step 3 - Failover Sessions or SelectsStep 3 - Failover Sessions or Selects– Updates, deletes and inserts don’t failover– For a connection to be re-initiated, the application needs to be coded to

recognize connection failures– OCI (Oracle Call Interface), JDBC thick driver and Microsoft Access*

ODBC SELECT connections support failover

Step 4 – Fast mean time to recover in Init.ora in secondsStep 4 – Fast mean time to recover in Init.ora in seconds– Seconds between checkpoints: fast_start_mttr_target=300

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

31

Configuring Transparent Application Failover* Example of edited version:Example of edited version:prod = (DESCRIPTION = (ENABLE = BROKEN) (ADDRESS_LIST = (LOAD_BALANCE = ON) (FAILOVER = YES) (ADDRESS = (PROTOCOL = TCP)(HOST = rac1)(PORT = 1521)) (ADDRESS = (PROTOCOL = TCP)(HOST = rac2)(PORT = 1521)) ) (CONNECT_DATA = (SERVICE_NAME = PROD) (FAILOVER_MODE = (TYPE = SELECT ) (METHOD = BASIC ) (RETRIES = 64) (DELAY = 4) ) ) )

Installing Oracle9Installing Oracle9ii* RAC* RAC

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

32

Testing Results

Oracle9Oracle9ii* RAC with * RAC with Red Hat Linux Advanced Server* 2.1 on Red Hat Linux Advanced Server* 2.1 on

IntelIntel®® Itanium Itanium®® 2-based Servers 2-based Servers

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

33

Performance Testing and OptimizationPerformance Testing and Optimization

For the best performance some adjustments are For the best performance some adjustments are requiredrequired

– An application certified to run on Oracle9i* will run without modification on Oracle9i RAC

Performance testing for First Trust applicationsPerformance testing for First Trust applications– Performance compared to production servers

Original Production Server – AIX Server Interim Production Server – HP ProLiant DL360* servers with

Intel® Xeon™ processors– Load has two characteristics

Batch load of daily trades into portfolios Interactive users accessing the database via application server

using JBDC* with a JAVA* application

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

34

Instance ParametersInstance Parameters– Set Parallel_Min_Server = 2– Set parallel_max_server = 99– db_writer_processes = 8– Use large db_cache_size

Object Level ParametersObject Level Parameters– parallel degree > 1 on tables and indexes

– set inittrans based on cpu

– set maxtrans = 99

– set cache for sequences to 100

. .

Performance Testing and OptimizationPerformance Testing and Optimization

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

35

Tips For The Best PerformanceTips For The Best Performance

1. Create each tablespace with SEGMENT SPACE MANAGEMENT AUTO

2. Create tables and indexes with INITRANS > 2 (default is 1)

3. Hash partition large tables and indexes or stripe them.

4. Use parallel query– parallel_automatic_tuning=true

5. Automate PGA space management (replaces sort_area_size, hash_area_size etc.)– pga_aggregate_target=209715200

Total aggregate for all users

– workarea_size_policy=auto

6. Match db_block_size*db_file_multiblock_read_count to TCP buffer size for the private cluster interconnect

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

36

Performance Testing ResultsPerformance Testing Results11

Batch load processing runs 1/3 the time than Batch load processing runs 1/3 the time than single instance RISC-based serversingle instance RISC-based server

Overall benchmark performance runs in 1/3 to 1/5 Overall benchmark performance runs in 1/3 to 1/5 the time than single instance RISC-based serverthe time than single instance RISC-based server

– Benchmark is built by First Trust to simulate the load profile of their application. It consists of:

Index builds Batch loads OLTP processing etc.

11Customer savings and results are specific to the Customer savings and results are specific to the client, their business goals and the configuration of client, their business goals and the configuration of their enterprise environment. Differences in their enterprise environment. Differences in business goals, software design, infrastructure or business goals, software design, infrastructure or configuration may affect actual results.configuration may affect actual results.

Performance tests and ratings are measured using specific Performance tests and ratings are measured using specific computer systems and/or components and reflect the computer systems and/or components and reflect the approximate performance of Intel products as measured by approximate performance of Intel products as measured by those tests. Any difference in system hardware or software those tests. Any difference in system hardware or software design or configuration may affect actual performance. design or configuration may affect actual performance.

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

37

Availability Testing and ResultsAvailability Testing and Results11

Instance failure testingInstance failure testing– Performed a shutdown abort on active node– Session failed to second node in average of 10 seconds

Interconnect failure testingInterconnect failure testing– Pulled network interconnect during session– Session paused and continued in 15 seconds

11Customer savings and results are specific to the Customer savings and results are specific to the client, their business goals and the configuration of client, their business goals and the configuration of their enterprise environment. Differences in their enterprise environment. Differences in business goals, software design, infrastructure or business goals, software design, infrastructure or configuration may affect actual results.configuration may affect actual results.

Performance tests and ratings are measured using specific Performance tests and ratings are measured using specific computer systems and/or components and reflect the computer systems and/or components and reflect the approximate performance of Intel products as measured by approximate performance of Intel products as measured by those tests. Any difference in system hardware or software those tests. Any difference in system hardware or software design or configuration may affect actual performance. design or configuration may affect actual performance.

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

38

Availability Testing and ResultsAvailability Testing and Results11

Server failure testingServer failure testing– Pulled power plug on active node– Session failed over to second node in less than one minute

Operating System failure testing Operating System failure testing – Performed shutdown and reboot (init 0 and init 6) on active node– Session failed over to second node in less than one minute

11Customer savings and results are specific to the Customer savings and results are specific to the client, their business goals and the configuration of client, their business goals and the configuration of their enterprise environment. Differences in their enterprise environment. Differences in business goals, software design, infrastructure or business goals, software design, infrastructure or configuration may affect actual results.configuration may affect actual results.

Performance tests and ratings are measured using specific Performance tests and ratings are measured using specific computer systems and/or components and reflect the computer systems and/or components and reflect the approximate performance of Intel products as measured by approximate performance of Intel products as measured by those tests. Any difference in system hardware or software those tests. Any difference in system hardware or software design or configuration may affect actual performance. design or configuration may affect actual performance.

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

39

Tips for High AvailabilityTips for High Availability

1. Duplicate the interconnect with dual NICs (Network Interface Cards) on each server and dual gigabit switches

2. Duplicate the host bus adaptors and the SAN (Storage Area Network) switch

3. Configure data guard for a remote location

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

40

RecommendationRecommendation First Trust Production Architecture Powered by

Intel® Itanium® 2 Microarchitecture

Two Test Databases Two Test Databases on XIOTech* Storageon XIOTech* Storage

Standby DBStandby DB

Brocade Switch

First Trust First Trust NetworkNetwork

Gigabit Switch

Brocade* Switch

Gigabit Switch

HP 2600*Server

HP 2600Server

Standby HP 2600Server

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

41

Important MetalinkImportant Metalink** Notes Notes

232355.1 Hangcheck-timer FAQ232355.1 Hangcheck-timer FAQ 222746.1 RAC Linux 9.2: Configuration of 222746.1 RAC Linux 9.2: Configuration of

cmcfg.ora and ocmargs.oracmcfg.ora and ocmargs.ora 184821.1 Step by Step install of 9.2.0.4 RAC on 184821.1 Step by Step install of 9.2.0.4 RAC on

LinuxLinux 178435.1 PRK% Errors – Cause & Action Required178435.1 PRK% Errors – Cause & Action Required 226880.1 Configuration of Load Balancing and 226880.1 Configuration of Load Balancing and

Transparent Application FailoverTransparent Application Failover

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

42

Reminder – Reminder – please complete the please complete the OracleWorld online session OracleWorld online session surveysurvey

Thank you.Thank you.

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

43

AQ&Q U E S T I O N SQ U E S T I O N S

A N S W E R SA N S W E R S

*Other names and brands may be claimed as the property of others. *Other names and brands may be claimed as the property of others. Material within this presentation is the property of First Trust and Intel Material within this presentation is the property of First Trust and Intel Corporation. Copyright © 2003, Intel Corporation. All rights reserved. Corporation. Copyright © 2003, Intel Corporation. All rights reserved.

44

Thanks for attendingThanks for attending