oracle virtualization installing oracle vm server 3.1.1 ... · pdf fileoracle virtualization...

Oracle Virtualization – Installing Oracle VM Server 3.1.1,

Oracle VM Manager 3.1.1 and Deploying Oracle RAC 11gR2

(11.2.0.3) Oracle VM templates Linux x86 64 bit for test

configuration

In the second post, first is here, for Oracle VM 3.1.1 technology you will

look at how to upgrade the existing Oracle VM server and Oracle VM manager to

version 3.1.1 and deploy Oracle RAC templates to build two node Oracle 11gR2

(11.2.0.3) cluster.

All software can be downloaded from edelivery.oracle.com (Oracle Software

Delivery Cloud) and the templates (version 11.2.0.3) can be downloaded as a

patch from MOS (patch 12694014. The approach described in the article is

applicable on any supported platform although I am using Oracle VirtualBox

for testing.

Software versions used are:

Oracle VirtualBox 4.1.16

Oracle VM Server 3.1.1

Oracle VM Manager 3.1.1

OEL 6.2

Oracle RAC templates (patch 12694014)

The article will cover the following:

VirtualBox configuration for VM Server machine and VMManager

machine

Installation of Oracle VM Server

Installation of Oracle VM Manager

Deployment of Oracle RAC 11gR2 Oracle VM templates Linux x86

64bit for test configuration

In real life Oracle VM server runs on a dedicated set of servers and is

installed as a bare metal product without the need of an Operating system.

Oracle VM Manager is installed on a Linux box. Oracle VirtualBox can be

successfully used for testing and self-study of the new features.

The main components in the architecture are two virtual machines.

Virtual Machine IP Address OS Purpose

OracleVMServer303 192.168.2.21 OEL XEN with Oracle

VM Server 3.0.3

Oracle VM Server

3.0.3

OracleVMManager303 192.168.2.31 OEL 6.2 Oracle VM Manager

3.0.3

Product documentation for Oracle VM server 3.1.1 and Oracle VM Manager 3.1.1

is available here.

1. Upgrade Oracle VM server 3.0.3 to Oracle VM server 3.1.1

http://gjilevski.wordpress.com/2012/06/19/oracle-virtualization-installing-oracle-vm-server-3-0-3-oracle-vm-manager-3-0-3-and-deploying-oracle-rac-11gr2-11-2-0-3-oracle-vm-templates-linux-x86-64-bit-for-test-configuration/

http://docs.oracle.com/cd/E27300_01/index.html

Make the VMserver311 ISO available to the virtual machine

OracleVMserver303 and start the VM. Once the boot screen appears press

Enter.

Press Skip.

Select keyboard.

Accept the license agreement.

Select an UPGRADE option and the Oracle VM server 3.0.3 to upgrade.

Upgrade the boot loader.

Take a note of the log file location and press OK.

Wait for the upgrade to continue.

Reboot.

Press the highlighted selection.

Wait for the boot to complete.

Press Alt-F2 to login

Login

2. Upgrade Oracle VM Manager 3.0.3 to Oracle VM Manager 3.1.1

Transfer to OracleVMManager303 virtual machine OracleVMManager311.iso

image a loop mount it.

[root@vmmgr u01]# ls

app OracleVMManager311.iso r.txt stage t.txt VMManager303.iso

[root@vmmgr u01]# mount -o loop OracleVMManager311.iso /mnt/stage

[root@vmmgr u01]#

From the stage directory invoke the upgrade script.

[root@vmmgr stage]# ./runUpgrader.sh

Stating OVM Manager upgrade on Sun May 20 16:28:43 EEST 2012

Oracle VM Manager 3.1.1.305 upgrade utility

Upgrade logfile : /tmp/upgrade-2012-05-20-28.log

It is highly recommended to do a full database repository backup prior to

upgrading Oracle VM Manager ...

Press any key to continue ...

Oracle VM Manager is running ...

Verifying installation status ...

Read Oracle VM Manager config file ...

Found Oracle VM Manager install files ...

Found Oracle VM Manager upgrader ...

Found Oracle WebLogic Server ...

Found Java ...

Using the following information :

Database Host : localhost

Database SID : XE

Database LSNR : 1521

Oracle VM Schema : ovs

Oracle VM Manager UUID : 0004fb0000010000f8a01f5a1718ffd9

Current Build ID : 3.0.3.126

Upgrade from version : 3.0.3

Upgrade to version : 3.1.1

Using /tmp/workdir.0zgO6hQ9um for backup and export location.

Using /tmp/patchdir.Glh0EQQcD for patching.

Enter password for user ovs :

Undeploying previous version of Oracle VM Manager application ...

Undeploying Oracle VM Manager help ...

Undeploying Oracle VM Manager console ...

Undeploying Oracle VM Manager core ...

Waiting for Oracle VM Manager core to fully undeploy...

Waiting...

Finished undeploying previous version ...

Exporting Oracle VM Manager repository ...

Please wait as this can take a long time ...

Oracle VM Manager repository export completed ...

Creating backup file ...

Oracle VM Manager repository backup in /tmp/ovm-manager-3-backup-2012-05-20.zip

Upgrading Oracle VM Manager ...

Backing up old files to /tmp/ovm-manager-3-backup-2012-05-20-163052...

Removing old files ...

Unpacking Oracle VM Manager 3.1.1.305

`transform_003001001000_010.xsl' ->

`/tmp/patchdir.Glh0EQQcD/transform_003001001000_010.xsl'

`transform_003001001000_020.xsl' ->

`/tmp/patchdir.Glh0EQQcD/transform_003001001000_020.xsl'

`deletedClasses.xml' -> `/tmp/patchdir.Glh0EQQcD/deletedClasses.xml'

Filtering full repository export to the selective export subset at

/tmp/workdir_sel.XRjFLORxBo ...

cp: omitting directory `/tmp/workdir.0zgO6hQ9um/jrnl'

cp: omitting directory `/tmp/workdir.0zgO6hQ9um/objs'

adding: objs/63/639.cl.xml (deflated 81%)

adding: objs/9.cl.xml (deflated 93%)



Selective export is at /tmp/workdir_sel.XRjFLORxBo

4 objects selected (out of 508) to be upgraded

Transform XSL files used:

-rw-r--r--. 1 root root 56678 May 20 16:30

/tmp/patchdir.Glh0EQQcD/transform_003001001000_010.xsl

-rw-r--r--. 1 root root 10079 May 20 16:30

/tmp/patchdir.Glh0EQQcD/transform_003001001000_020.xsl

Changed classes encountered in selective export set:

com.oracle.ovm.mgr.api.manager.BusinessManagerDbImpl

com.oracle.ovm.mgr.api.manager.ModelManagerDbImpl

com.oracle.ovm.mgr.api.manager.RasManagerDbImpl

com.oracle.ovm.mgr.api.physical.ServerDbImpl

Upgrading Oracle VM Manager repository ...

Please wait as this can take a long time ...

Oracle VM Manager repository upgrade completed ...

Validating Oracle VM Manager repository ...

Oracle VM Manager repository validation completed ...

Refresh system-jazn-data.xml file ...

Redeploying Oracle VM Manager core container ...

Redeploying Oracle VM Manager console ...

Redeploying Oracle VM Manager help ...

Install ADF Patch ...

Completed upgrade to 3.1.1.305 ...

Writing updated config in /u01/app/oracle/ovm-manager-3/.config

Restart WebLogic ...

Stopping Oracle VM Manager [ OK ]

Starting Oracle VM Managernohup: ignoring input and redirecting stderr to stdout

[ OK ]

OVM Manager upgrade finished on Sun May 20 16:35:47 EEST 2012

[root@vmmgr stage]#

Let’s test Oracle VM Manager 3.1.1

After login you have.

Starting and Stopping the OVM from OEL.

[root@vmmgr ~]# service ovmm stop

Stopping Oracle VM Manager

[ OK ]

[root@vmmgr ~]#

[root@vmmgr ~]# service ovmm start


[ OK ]

[root@vmmgr ~]#

3. Deploy two node Oracle 11gR2 (11.2.0.3) RAC

3.1 Add a file system /nfs that is to NFS mounted.

Add 50GB disk to the OracleVMManager303 virtual machine. This disk

is visible as /dev/sdb.

Create a volume, file system and mount the file system on this

disk.

[root@vmmgr ~]# fdisk -l /dev/sdb

Disk /dev/sdb: 53.7 GB, 53687091200 bytes

255 heads, 63 sectors/track, 6527 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0x00000000

Disk /dev/sdb doesn't contain a valid partition table

[root@vmmgr ~]#

[root@vmmgr ~]# pvcreate /dev/sdb

Writing physical volume data to disk "/dev/sdb"

Physical volume "/dev/sdb" successfully created

[root@vmmgr ~]#

[root@vmmgr ~]# fdisk /dev/sdb

Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel

Building a new DOS disklabel with disk identifier 0xb618dbd7.

Changes will remain in memory only, until you decide to write them.

After that, of course, the previous content won't be recoverable.

Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)

WARNING: DOS-compatible mode is deprecated. It's strongly recommended to

switch off the mode (command 'c') and change display units to

sectors (command 'u').

Command (m for help): c

DOS Compatibility flag is not set

Command (m for help): u

Changing display/entry units to sectors

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First sector (2048-104857599, default 2048):

Using default value 2048

Last sector, +sectors or +size{K,M,G} (2048-104857599, default 104857599): +50G

Value out of range.

Last sector, +sectors or +size{K,M,G} (2048-104857599, default 104857599): +49G

Command (m for help): t

Selected partition 1

Hex code (type L to list codes): 8e

Changed system type of partition 1 to 8e (Linux LVM)

Command (m for help): w

The partition table has been altered!

Calling ioctl() to re-read partition table.

Syncing disks.

[root@vmmgr ~]#

[root@vmmgr ~]# fdisk -l /dev/sdb

Disk /dev/sdb: 53.7 GB, 53687091200 bytes

171 heads, 46 sectors/track, 13330 cylinders

Units = cylinders of 7866 * 512 = 4027392 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 512 bytes / 512 bytes

Disk identifier: 0xb618dbd7

Device Boot Start End Blocks Id System

/dev/sdb1 1 13065 51380224 8e Linux LVM

[root@vmmgr ~]#

[root@vmmgr ~]# pvcreate /dev/sdb1

Writing physical volume data to disk "/dev/sdb1"

Physical volume "/dev/sdb1" successfully created

[root@vmmgr ~]#

vgcreate NFSVolGroup /dev/sdb1

[root@vmmgr ~]# vgcreate NFSVolGroup /dev/sdb1

Volume group "NFSVolGroup" successfully created

[root@vmmgr ~]#

[root@vmmgr ~]# vgdisplay NFSVolGroup

--- Volume group ---

VG Name NFSVolGroup

System ID

Format lvm2

Metadata Areas 1

Metadata Sequence No 1

VG Access read/write

VG Status resizable

MAX LV 0

Cur LV 0

Open LV 0

Max PV 0

Cur PV 1

Act PV 1

VG Size 49.00 GiB

PE Size 4.00 MiB

Total PE 12543

Alloc PE / Size 0 / 0

Free PE / Size 12543 / 49.00 GiB

VG UUID RnSh8A-fvtJ-97hA-KyX3-Lizm-Dpat-sDcWM9

[root@vmmgr ~]#

lvcreate --size 48G NFSVolGroup

[root@vmmgr ~]# lvcreate --size 48G NFSVolGroup

Logical volume "lvol0" created

[root@vmmgr ~]#

[root@vmmgr ~]# lvdisplay

--- Logical volume ---

LV Name /dev/NFSVolGroup/lvol0

VG Name NFSVolGroup

LV UUID 0M6eKi-2uiG-Chjl-rk6E-8BUc-WngI-SvvZpl

LV Write Access read/write

LV Status available

# open 0

LV Size 48.00 GiB

Current LE 12288

Segments 1

Allocation inherit

Read ahead sectors auto

- currently set to 256

Block device 253:3


LV Name /dev/vg_vmmgr/lv_root

VG Name vg_vmmgr

LV UUID kpXFYY-eAPW-zCXW-wHnN-QuKw-kFxh-vjeaRX


LV Status available

# open 1

LV Size 28.37 GiB

Current LE 7263

Segments 1

Allocation inherit



Block device 253:0


LV Name /dev/vg_vmmgr/lv_home

VG Name vg_vmmgr

LV UUID gaY4wY-aN48-SemS-iUps-L8CX-w27t-OQqPdF


LV Status available

# open 1

LV Size 25.26 GiB

Current LE 6467

Segments 1

Allocation inherit



Block device 253:2


LV Name /dev/vg_vmmgr/lv_swap

VG Name vg_vmmgr

LV UUID f3L33X-DIly-6iO3-hGgu-DrWM-0g1O-mACi0e


LV Status available

# open 1

LV Size 5.88 GiB

Current LE 1504

Segments 1

Allocation inherit



Block device 253:1

[root@vmmgr ~]#

/dev/NFSVolGroup/lvol0

[root@vmmgr ~]# mkfs.ext3 /dev/NFSVolGroup/lvol0

mke2fs 1.41.12 (17-May-2010)

Filesystem label=

OS type: Linux

Block size=4096 (log=2)

Fragment size=4096 (log=2)

Stride=0 blocks, Stripe width=0 blocks

3145728 inodes, 12582912 blocks

629145 blocks (5.00%) reserved for the super user

First data block=0

Maximum filesystem blocks=4294967296

384 block groups

32768 blocks per group, 32768 fragments per group

8192 inodes per group

Superblock backups stored on blocks:

32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,

4096000, 7962624, 11239424

Writing inode tables: done

Creating journal (32768 blocks): done

Writing superblocks and filesystem accounting information:

done

This filesystem will be automatically checked every 21 mounts or

180 days, whichever comes first. Use tune2fs -c or -i to override.

[root@vmmgr ~]#

[root@vmmgr ~]#

# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info

#

/dev/mapper/vg_vmmgr-lv_root / ext4 defaults 1 1

UUID=19fcf4b8-c245-4f71-bd73-5bf56c6dada5 /boot ext4 defaults

1 2

/dev/mapper/vg_vmmgr-lv_home /home ext4 defaults 1 2

/dev/mapper/NFSVolGroup-lvol0 /nfs ext4 defaults 1 2

/dev/mapper/vg_vmmgr-lv_swap swap swap defaults 0 0

tmpfs /dev/shm tmpfs defaults 0 0

devpts /dev/pts devpts gid=5,mode=620 0 0

sysfs /sys sysfs defaults 0 0

proc /proc proc defaults 0 0

[root@vmmgr mapper]#

3.2 Create NFS

Modify /etc/exports as follows.

[root@vmmgr ~]# cat /etc/export

cat: /etc/export: No such file or directory

[root@vmmgr ~]# cat /etc/exports

/nfs/stage *(rw,sync,no_wdelay,insecure_locks,no_root_squash)

/nfs/stage1 *(rw,sync,no_wdelay,insecure_locks,no_root_squash)

[root@vmmgr ~]#

Create /nfs/stage and /nfs/stage1

Enable and start nfs service

[root@vmmgr stage]# chkconfig nfs on

[root@vmmgr stage]# service nfs restart

Shutting down NFS mountd: [FAILED]

Shutting down NFS daemon: [FAILED]

Shutting down NFS quotas: [FAILED]

Starting NFS services: [ OK ]

Starting NFS quotas: [ OK ]

Starting NFS daemon: [ OK ]

Starting NFS mountd: [ OK ]

Starting and Stopping the OVM

[root@vmmgr ~]# service ovmm stop

Stopping Oracle VM Manager

[ OK ]

[root@vmmgr ~]#

[root@vmmgr ~]# service ovmm start


[ OK ]

[root@vmmgr ~]#

3.3 Discover a VM server from the Oracle VM Manager 3.1.1

Click discover servers in the tool bar.

Wait until the server get discovered.

3.4 Create a network

Click the Networking tab, then the Networks subtab. Click Create

New Network + to start.

Select ‘Create a network with bonds/ports only. Press Next.

Specify Name.

Select servers.

Select ports. Make sure ONLY eth0 is selected. Picture is for

illustration and should have only eth0.

Configure IP addresses. Select None and press Finish.

After the network is created it will be displayed.

3.5 Create a file server

On the storage tab select discover file servers and press Next once

filled in the data.

Select server.

Select the nfs from /etc/exports. Here should show one of it and

press Finish. (Instead of nfs:/u01/VM/nfs should be nfs:/nfs/stage

or nfs:/nfs/stage1) /nfs/stage is for the file system and

/nfs/stage1 is for the repository.

You will get something like

3.6 Create a Server pool

From Servers and VMs click Create Server Pool. Press Next.

Select the server press Finish.

You will see the nfs created earlier. Press OK.

Examine the Pool successfully created.

3.7 Create Storage Repository.

Make sure that storage is refreshed. If not refresh from file

servers.

Click Create Repository.

Enter Repository name. Press the magnifier to select a nfs

location.

Press OK and press Next.

Select server.

Verify the result.

3.8 Import the templates.

Templates are not anymore stored directly onto the Oracle VM server

3.1.1. Instead Oracle has provided a way to access them using

either ftp or http.

I will use ftp. So I will configure the ftp service.

[root@vmmgr stage]# service vsftpd start

Starting vsftpd for vsftpd: [ OK ]

[root@vmmgr stage]# chkconfig vsftpd on

[root@vmmgr stage]#

I am using OS user gjilevski on the OEL6.2 linux VM running the

Oracle VM Manager 3.1.1 with home directory /home/gjilevski.

Copy the templates into /home/gjilevski. When specifying the

templates make sure that you list second before the first template.

ftp://gjilevski:[email protected]/OVM_OL5U7_X86_64_11203RAC_PVM-2of2.tgz



In the URL gjilevski is the OS user identified by the password.

File names follows without a path as they are in the default user

directory.

From VM templates import the templates.

In the screen that appear enter



instead of what is displayed.




Wait for the import to completes.

It will looks like this.

If you edit it properties will be as follows.

3.9 Create shared virtual disk

Installing RAC requires 5 shared disks each 2GB. From the screen

click create virtual disk.

Create ASM1

Create ASM2

Create ASM3

Repeat same steps for ASM4 and ASM5. Verify that all are created.

3.10 Create VNIC

From Networking tab click virtual NICs.

Click Auto Fill and Create.

Initially I did not created VNIC and got the error.

begin()

Appended operation 'Adding a queued job operation' to object

'0004fb00001900008ea92f8eb1b6abc2 (Create Statistics Log)'.

com.oracle.odof.exception.ObjectException: Caught during invoke method:

com.oracle.ovm.mgr.api.exception.IllegalOperationException: OVMAPI_8004E There are

no more VNICs available. Create More MAC Addresses.

Mon May 21 17:33:13 EEST 2012

at com.oracle.odof.core.BasicWork.invokeMethod(BasicWork.java:151)

at

com.oracle.odof.command.InvokeMethodCommand.process(InvokeMethodCommand.java:100)

at com.oracle.odof.core.BasicWork.processCommand(BasicWork.java:81)

at

com.oracle.odof.core.TransactionManager.processCommand(TransactionManager.java:773

)

at com.oracle.odof.core.WorkflowManager.processCommand(WorkflowManager.java:401)

at com.oracle.odof.core.WorkflowManager.processWork(WorkflowManager.java:459)

at com.oracle.odof.io.AbstractClient.run(AbstractClient.java:42)

at java.lang.Thread.run(Thread.java:662)

Caused by: com.oracle.ovm.mgr.api.exception.IllegalOperationException:

OVMAPI_8004E There are no more VNICs available. Create More MAC Addresses.

Mon May 21 17:33:13 EEST 2012

at

com.oracle.ovm.mgr.api.manager.VnicManagerDbImpl.getAvailableVnic(VnicManagerDbImp

l.java:353)

at com.oracle.odof.core.AbstractVessel.invokeMethod(AbstractVessel.java:330)


at com.oracle.odof.core.storage.Transaction.invokeMethod(Transaction.java:822)

at com.oracle.odof.core.Exchange.invokeMethod(Exchange.java:245)

at com.oracle.ovm.mgr.api.manager.VnicManagerProxy.getAvailableVnic(Unknown

Source)

at

com.oracle.ovm.mgr.api.virtual.VirtualMachineConfigDbImpl.cloneNetworks(VirtualMac

hineConfigDbImpl.java:1065)

at

com.oracle.ovm.mgr.api.virtual.VirtualMachineConfigDbImpl.clone(VirtualMachineConf

igDbImpl.java:916)

at


igDbImpl.java:860)




... 7 more

rollback()

3.11 Create Virtual Machines

Once both are done you will have.

3.12 Assign NICs to Virtual Machines and make sure that xenbr0 and

xenbr1 networks exists.

In the network you need at the end something like this.

If not create/modify xenbr0 and xenbr1.

For xenbr0 press Next.

Select server.

Select the ports.

Press Next.

Press Next.

For xenbr1

Press Next.

Select server name and press Next.

Select ports and press Next.

Press Finish.

If you do not do so will get similar to

Job Construction Phase

----------------------

begin()

Appended operation 'Adding a queued job operation' to object

'0004fb000019000038ea52da9f8f21ee (Create Statistics Log)'.

Appended operation 'Virtual Disk/Virtual Cdrom Clone' to object

'0004fb00001200001de8348bd5ec83ab.img (System.img (2))'.

Appended operation 'Repository Element files refresh' to object


Appended operation 'Server Copy File' to object


Appended operation 'Virtual Disk/Virtual Cdrom Clone' to object

'0004fb000012000064a859339197b7ee.img (Oracle11203RAC_x86_64-xvdb.img (2))'.

Appended operation 'Repository Element files refresh' to object


Appended operation 'Server Copy File' to object


Appended operation 'Virtual Machine Cfg File Construct' to object

'0004fb0000220000aa9f213a1f521585'.

com.oracle.odof.exception.ObjectException: Caught during invoke method:

com.oracle.ovm.mgr.api.exception.IllegalOperationException: OVMAPI_9039E Cannot

place clone VM: OVM_OL5U7_X86_64_11203RAC_PVM-2of2.tgz, in Server Pool: MyRACPool.

That server pool has no servers that can run the VM

Mon May 21 18:42:36 EEST 2012


at



at


)






OVMAPI_9039E Cannot place clone VM: OVM_OL5U7_X86_64_11203RAC_PVM-2of2.tgz, in

Server Pool: MyRACPool. That server pool has no servers that can run the VM

Mon May 21 18:42:36 EEST 2012

at


igDbImpl.java:939)

at


igDbImpl.java:860)




... 7 more

3.13 Assign ASM shared disks to VM

Make sure that you have the following assignment for the VMs.

For racnode1

For racnode2

The file are as follows.

[root@vmmgr u01]# cat vm.cfg

vif = ['mac=00:21:f6:00:00:2f,bridge=xenbr0',

'mac=00:21:f6:00:00:30,bridge=xenbr1']

OVM_simple_name = 'racnode2'

disk =

['file:/OVS/Repositories/0004fb000003000009747581081557e5/VirtualDisks/0004fb00001

200008699ec66aee7821a.img,xvda,w',

'file:/OVS/Repositories/0004fb000003000009747581081557e5/VirtualDisks/0004fb000012

00006e90573639dac725.img,xvdb,w',


0000cdf8b3cd91c68ebd.img,xvdc,w!',


0000fb986a9247406641.img,xvdd,w!',


00008d3f9019fe32a304.img,xvde,w!',


000046a344c5efa19a02.img,xvdf,w!',


0000c65d6d0a62ec75a0.img,xvdg,w!']

uuid = '0004fb00-0006-0000-a2a3-03e4d1281181'

on_reboot = 'restart'

cpu_weight = 27500

memory = 2048

cpu_cap = 0

maxvcpus = 1

OVM_high_availability = False

maxmem = 2048

OVM_description = 'racnode2'

on_poweroff = 'destroy'

on_crash = 'restart'

bootloader = '/usr/bin/pygrub'

name = '0004fb0000060000a2a303e4d1281181'

guest_os_type = 'default'

vif_other_config = []

vfb = ['type=vnc,vncunused=1,vnclisten=127.0.0.1,keymap=en-us']

vcpus = 1

OVM_os_type = 'None'

OVM_cpu_compat_group = ''

OVM_domain_type = 'xen_pvm'

[root@vmmgr u01]#

[root@vmmgr u01]# cat vm.cfg

vif = ['mac=00:21:f6:00:00:1a,bridge=xenbr0',

'mac=00:21:f6:00:00:05,bridge=xenbr1']

OVM_simple_name = 'racnode1'

disk =

['file:/OVS/Repositories/0004fb000003000009747581081557e5/VirtualDisks/0004fb00001

20000a3949c3f3d394b21.img,xvda,w',


000065511085c4ad6864.img,xvdb,w',


0000cdf8b3cd91c68ebd.img,xvdc,w!',


0000fb986a9247406641.img,xvdd,w!',


00008d3f9019fe32a304.img,xvde,w!',


000046a344c5efa19a02.img,xvdf,w!',


0000c65d6d0a62ec75a0.img,xvdg,w!']

uuid = '0004fb00-0006-0000-cfab-2af11ac1f125'

on_reboot = 'restart'

cpu_weight = 27500

memory = 2048

cpu_cap = 0

maxvcpus = 1

OVM_high_availability = False

maxmem = 2048

OVM_description = 'racnode1'

on_poweroff = 'destroy'

on_crash = 'restart'

bootloader = '/usr/bin/pygrub'

name = '0004fb0000060000cfab2af11ac1f125'

guest_os_type = 'default'

vif_other_config = []

vfb = ['type=vnc,vncunused=1,vnclisten=127.0.0.1,keymap=en-us']

vcpus = 1

OVM_os_type = 'None'

OVM_cpu_compat_group = ''

OVM_domain_type = 'xen_pvm'

[root@vmmgr u01]#

3.14 Start the VMS

3.15 Establish VNC to both nodes

After both VM are started establish a VNC sessions to both nodes

for configuration of GI and RAC.

Select and dedicate which node will be the first and second node.

Enter for each node hostname, public IP and private IP address,

VIP, VIP name, domain, DNS, public and private interface etc as

prompted.

Review and acknowledge by pressing YES.

Press YES

Wait for the installation to complete.

Progress is…

At the end

3.16 Verify Oracle 11gR2 11.2.03 GI and RAC installation.

You can verify the status using sqlplus.

You can verify the status using srvctl.

Some notes.

Acknowledging events may clear some errors after a crash of the

Oracle VM Server 3.1.1 VirtualBox VM.

Verifying the VM properties resolves the error

Unexpected error during login

(com.oracle.ovm.mgr.api.exception.FailedOperationException: OVMAPI_6000E Internal

Error: Connection refused Connection refused Mon May 21 23:18:19 EEST 2012),

please consult logs for details.

Job Construction Phase

----------------------

begin()

Appended operation 'Virtual Machine Start' to object

'0004fb0000060000cfab2af11ac1f125 (racnode1)'.

Appended operation 'Bridge Configure Operation' to object

'0004fb0000200000129d832619e996f5 (network.EthernetPort (4) in vmsrv33.gj.com)'.

Appended operation 'Bridge Configure Operation' to object

'0004fb0000200000604c446c90acae98 (network.EthernetPort (3) in vmsrv33.gj.com)'.

commit()

Completed Step: COMMIT

Objects and Operations

----------------------

Object (IN_USE): [EthernetPort] 0004fb0000200000604c446c90acae98

(network.EthernetPort (3) in vmsrv33.gj.com)

Operation: Bridge Configure Operation

Object (IN_USE): [Vnic] 0004fb000007000047de4cdfa34b0a41 (00:21:f6:00:00:1a)

Object (IN_USE): [Vnic] 0004fb000007000020f4233448d8d770 (00:21:f6:00:00:05)

Object (IN_USE): [VmDiskMapping] 0004fb00001300006e3c1bc79509f857

Object (IN_USE): [VmDiskMapping] 0004fb0000130000ce67b1e5241157d7

Object (IN_USE): [VirtualDisk] 0004fb00001200008d3f9019fe32a304.img (ASM3)

Object (IN_USE): [VmDiskMapping] 0004fb0000130000494d049341598540

Object (IN_USE): [VirtualDisk] 0004fb0000120000c65d6d0a62ec75a0.img (ASM5)

Object (IN_USE): [VmDiskMapping] 0004fb0000130000267c771177271b00

Object (IN_USE): [VirtualMachine] 0004fb0000060000cfab2af11ac1f125 (racnode1)

Operation: Virtual Machine Start

Object (IN_USE): [VirtualDisk] 0004fb0000120000cdf8b3cd91c68ebd.img (ASM1)

Object (IN_USE): [VmDiskMapping] 0004fb00001300002036b8246f86e2c4

Object (IN_USE): [VirtualDisk] 0004fb000012000046a344c5efa19a02.img (ASM4)

Object (IN_USE): [VirtualDisk] 0004fb000012000065511085c4ad6864.img

(Oracle11203RAC_x86_64-xvdb.img (2))

Object (IN_USE): [EthernetPort] 0004fb0000200000129d832619e996f5


Operation: Bridge Configure Operation

Object (IN_USE): [VirtualDisk] 0004fb0000120000fb986a9247406641.img (ASM2)

Object (IN_USE): [VmDiskMapping] 0004fb00001300007b4b45d8dab8f783

Object (IN_USE): [VirtualDisk] 0004fb0000120000a3949c3f3d394b21.img (System.img

(2))

Object (IN_USE): [VmDiskMapping] 0004fb000013000040f7df759023d559

Job Running Phase at 23:27 on Mon, May 21, 2012

----------------------------------------------

Job Participants: [b6:10:7c:ba:39:89:4e:e8:95:b7:ca:1a:61:e9:81:69

(vmsrv33.gj.com)]

Actioner

--------

Starting operation 'Bridge Configure Operation' on object

'0004fb0000200000604c446c90acae98 (network.EthernetPort (3) in vmsrv33.gj.com)'

Bridge [xenbr1] already exists (and should exist) on interface [eth2] on server

[vmsrv33.gj.com]; skipping bridge creation

Completed operation 'Bridge Configure Operation' completed with direction ==> DONE

Starting operation 'Virtual Machine Start' on object

'0004fb0000060000cfab2af11ac1f125 (racnode1)'

Completed operation 'Virtual Machine Start' completed with direction ==> LATER

Starting operation 'Bridge Configure Operation' on object

'0004fb0000200000129d832619e996f5 (network.EthernetPort (4) in vmsrv33.gj.com)'

Bridge [xenbr0] already exists (and should exist) on interface [eth3] on server

[vmsrv33.gj.com]; skipping bridge creation

Completed operation 'Bridge Configure Operation' completed with direction ==> DONE

Starting operation 'Virtual Machine Start' on object


Job Internal Error

(Operation)com.oracle.ovm.mgr.api.exception.FailedOperationException: OVMAPI_4010E

Attempt to send command: dispatch to server: vmsrv33.gj.com failed. OVMAPI_4004E

Server Failed Command: dispatch https://?uname?:[email protected]:8899/api/2

start_vm 0004fb000003000009747581081557e5 0004fb0000060000cfab2af11ac1f125,

Status: org.apache.xmlrpc.XmlRpcException: exceptions.RuntimeError:Command: ['xm',

'create',

'/OVS/Repositories/0004fb000003000009747581081557e5/VirtualMachines/0004fb00000600

00cfab2af11ac1f125/vm.cfg'] failed (1): stderr: Error: Device 51744 (vbd) could

not be connected. /etc/xen/scripts/block failed; error detected.

stdout: Using config file

"/OVS/Repositories/0004fb000003000009747581081557e5/VirtualMachines/0004fb00000600

00cfab2af11ac1f125/vm.cfg".

Mon May 21 23:28:12 EEST 2012

Mon May 21 23:28:12 EEST 2012

at

com.oracle.ovm.mgr.action.ActionEngine.sendCommandToServer(ActionEngine.java:507)

at

com.oracle.ovm.mgr.action.ActionEngine.sendDispatchedServerCommand(ActionEngine.ja

va:444)

at com.oracle.ovm.mgr.action.ActionEngine.sendServerCommand(ActionEngine.java:378)

at

com.oracle.ovm.mgr.action.VirtualMachineAction.sendStartVmCommand(VirtualMachineAc

tion.java:121)

at

com.oracle.ovm.mgr.op.virtual.VirtualMachineStart.asyncAction(VirtualMachineStart.

java:65)

at

com.oracle.ovm.mgr.api.collectable.ManagedObjectDbImpl.executeCurrentJobOperationA

syncAction(ManagedObjectDbImpl.java:999)





at

com.oracle.ovm.mgr.api.virtual.VirtualMachineProxy.executeCurrentJobOperationAsync

Action(Unknown Source)

at com.oracle.ovm.mgr.api.job.JobEngine.objectAsyncStart(JobEngine.java:596)

at

com.oracle.ovm.mgr.op.virtual.VirtualMachineStart.action(VirtualMachineStart.java:

52)

at


ction(ManagedObjectDbImpl.java:1009)





at

com.oracle.ovm.mgr.api.virtual.VirtualMachineProxy.executeCurrentJobOperationActio

n(Unknown Source)

at com.oracle.ovm.mgr.api.job.JobEngine.operationActioner(JobEngine.java:218)

at com.oracle.ovm.mgr.api.job.JobEngine.objectActioner(JobEngine.java:309)

at

com.oracle.ovm.mgr.api.job.InternalJobDbImpl.objectCommitter(InternalJobDbImpl.jav

a:1140)




at



at


)






OVMAPI_4004E Server Failed Command: dispatch

https://?uname?:[email protected]:8899/api/2 start_vm

0004fb000003000009747581081557e5 0004fb0000060000cfab2af11ac1f125, Status:

org.apache.xmlrpc.XmlRpcException: exceptions.RuntimeError:Command: ['xm',

'create',







Mon May 21 23:28:12 EEST 2012

at com.oracle.ovm.mgr.action.ActionEngine.sendAction(ActionEngine.java:798)

at


... 42 more

FailedOperationCleanup

----------

Starting failed operation 'Virtual Machine Start' cleanup on object 'racnode1'

Complete rollback operation 'Virtual Machine Start' completed with

direction=racnode1

Rollbacker

----------

Executing rollback operation 'Bridge Configure Operation' on object

'0004fb0000200000604c446c90acae98 (network.EthernetPort (3) in vmsrv33.gj.com)'

Complete rollback operation 'Bridge Configure Operation' completed with

direction=DONE

Executing rollback operation 'Virtual Machine Start' on object


Complete rollback operation 'Virtual Machine Start' completed with direction=DONE

Executing rollback operation 'Bridge Configure Operation' on object

'0004fb0000200000129d832619e996f5 (network.EthernetPort (4) in vmsrv33.gj.com)'

Complete rollback operation 'Bridge Configure Operation' completed with

direction=DONE

Objects To Be Rolled Back

-------------------------

Object (IN_USE): [EthernetPort] 0004fb0000200000604c446c90acae98


Object (IN_USE): [Vnic] 0004fb000007000047de4cdfa34b0a41 (00:21:f6:00:00:1a)

Object (IN_USE): [Vnic] 0004fb000007000020f4233448d8d770 (00:21:f6:00:00:05)

Object (IN_USE): [VmDiskMapping] 0004fb00001300006e3c1bc79509f857

Object (IN_USE): [VmDiskMapping] 0004fb0000130000ce67b1e5241157d7

Object (IN_USE): [VirtualDisk] 0004fb00001200008d3f9019fe32a304.img (ASM3)

Object (IN_USE): [VmDiskMapping] 0004fb0000130000494d049341598540

Object (IN_USE): [VirtualDisk] 0004fb0000120000c65d6d0a62ec75a0.img (ASM5)

Object (IN_USE): [VmDiskMapping] 0004fb0000130000267c771177271b00

Object (IN_USE): [VirtualMachine] 0004fb0000060000cfab2af11ac1f125 (racnode1)

Object (IN_USE): [VirtualDisk] 0004fb0000120000cdf8b3cd91c68ebd.img (ASM1)

Object (IN_USE): [VmDiskMapping] 0004fb00001300002036b8246f86e2c4

Object (IN_USE): [VirtualDisk] 0004fb000012000046a344c5efa19a02.img (ASM4)

Object (IN_USE): [VirtualDisk] 0004fb000012000065511085c4ad6864.img

(Oracle11203RAC_x86_64-xvdb.img (2))

Object (IN_USE): [EthernetPort] 0004fb0000200000129d832619e996f5


Object (IN_USE): [VirtualDisk] 0004fb0000120000fb986a9247406641.img (ASM2)

Object (IN_USE): [VmDiskMapping] 0004fb00001300007b4b45d8dab8f783

Object (IN_USE): [VirtualDisk] 0004fb0000120000a3949c3f3d394b21.img (System.img

(2))

Object (IN_USE): [VmDiskMapping] 0004fb000013000040f7df759023d559

Write Methods Invoked

-------------------

Class=InternalJobDbImpl vessel_id=10367 method=addTransactionIdentifier

accessLevel=6

Class=VirtualMachineDbImpl vessel_id=9317 method=start accessLevel=6

Class=VnicDbImpl vessel_id=8010 method=lock accessLevel=6


Class=VirtualDiskDbImpl vessel_id=9329 method=lock accessLevel=6









Class=VmDiskMappingDbImpl vessel_id=9334 method=lock accessLevel=6














Class=VirtualMachineStartingEventDbImpl vessel_id=10376 method=notify

accessLevel=6

Class=VirtualMachineStartingEventDbImpl vessel_id=10376 method=setDescription

accessLevel=6

Class=EthernetPortDbImpl vessel_id=1888 method=addJobOperation accessLevel=6

Class=EthernetPortDbImpl vessel_id=1882 method=addJobOperation accessLevel=6

Class=InternalJobDbImpl vessel_id=10367 method=setCompletedStep accessLevel=6

Class=InternalJobDbImpl vessel_id=10367 method=setAssociatedHandles accessLevel=6

Class=EthernetPortDbImpl vessel_id=1882 method=setCurrentJobOperationComplete

accessLevel=6

Class=EthernetPortDbImpl vessel_id=1882 method=nextJobOperation accessLevel=6

Class=InternalJobDbImpl vessel_id=10367 method=setTuringMachineFlag accessLevel=6

Class=VirtualMachineDbImpl vessel_id=9317 method=setCurrentOperationToLater

accessLevel=6

Class=InternalJobDbImpl vessel_id=10367 method=setTuringMachineFlag accessLevel=6

Class=EthernetPortDbImpl vessel_id=1888 method=setCurrentJobOperationComplete

accessLevel=6


Class=VirtualMachineDbImpl vessel_id=9317 method=nextJobOperation accessLevel=6

Class=InternalJobDbImpl vessel_id=10367 method=setFailedOperation accessLevel=6


Class=VnicDbImpl vessel_id=8010 method=nextJobOperation accessLevel=6

Class=VnicDbImpl vessel_id=7888 method=nextJobOperation accessLevel=6

Class=VmDiskMappingDbImpl vessel_id=9741 method=nextJobOperation accessLevel=6


Class=VirtualDiskDbImpl vessel_id=7529 method=nextJobOperation accessLevel=6

















Completed Step: ROLLBACK

Job failed commit (internal) due to OVMAPI_4010E Attempt to send command: dispatch

to server: vmsrv33.gj.com failed. OVMAPI_4004E Server Failed Command: dispatch




'create',







Mon May 21 23:28:12 EEST 2012

Mon May 21 23:28:12 EEST 2012

com.oracle.ovm.mgr.api.exception.FailedOperationException: OVMAPI_4010E Attempt to

send command: dispatch to server: vmsrv33.gj.com failed. OVMAPI_4004E Server

Failed Command: dispatch https://?uname?:[email protected]:8899/api/2 start_vm



'create',







Mon May 21 23:28:12 EEST 2012

Mon May 21 23:28:12 EEST 2012

at


at

com.oracle.ovm.mgr.action.ActionEngine.sendDispatchedServerCommand(ActionEngine.ja

va:444)

at com.oracle.ovm.mgr.action.ActionEngine.sendServerCommand(ActionEngine.java:378)

at

com.oracle.ovm.mgr.action.VirtualMachineAction.sendStartVmCommand(VirtualMachineAc

tion.java:121)

at

com.oracle.ovm.mgr.op.virtual.VirtualMachineStart.asyncAction(VirtualMachineStart.

java:65)

at


syncAction(ManagedObjectDbImpl.java:999)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at

sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:

25)

at java.lang.reflect.Method.invoke(Method.java:597)





at

com.oracle.ovm.mgr.api.virtual.VirtualMachineProxy.executeCurrentJobOperationAsync

Action(Unknown Source)

at com.oracle.ovm.mgr.api.job.JobEngine.objectAsyncStart(JobEngine.java:596)

at

com.oracle.ovm.mgr.op.virtual.VirtualMachineStart.action(VirtualMachineStart.java:

52)

at


ction(ManagedObjectDbImpl.java:1009)

at sun.reflect.GeneratedMethodAccessor886.invoke(Unknown Source)

at


25)






at

com.oracle.ovm.mgr.api.virtual.VirtualMachineProxy.executeCurrentJobOperationActio

n(Unknown Source)

at com.oracle.ovm.mgr.api.job.JobEngine.operationActioner(JobEngine.java:218)

at com.oracle.ovm.mgr.api.job.JobEngine.objectActioner(JobEngine.java:309)

at

com.oracle.ovm.mgr.api.job.InternalJobDbImpl.objectCommitter(InternalJobDbImpl.jav

a:1140)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

at


25)





at



at


)






OVMAPI_4004E Server Failed Command: dispatch




'create',







Mon May 21 23:28:12 EEST 2012

at com.oracle.ovm.mgr.action.ActionEngine.sendAction(ActionEngine.java:798)

at


... 42 more

----------

End of Job

----------

4. Conclusion

You had a look at the steps to upgrade Oracle VM server and Oracle VM Manager

to version 3.1.1. You looked at the step by step guide to install two node

Oracle 11gR2 11.2.0.3 RAC using templates. The errors that I encountered were

also included as well as A way to work it around.

oracle virtualization installing oracle vm server 3.1.1 ... · pdf fileoracle virtualization...

Documents