How to Install Linux Oracle Virtual Server

Information about Installing Linux Oracle RAC Virtual Server

This document will explain how to install a Oracle RAC Dev or Test Virtual Server on VMWare ESXi Server.

After OS Installation follow Go to Prepare Linux Virtual Servers for Oracle RAC to complete required tasks prior to installing Oracle RAC Software.

This includes creating Shared Storage, Post-OS Configurations, Cloning initial Virtual Server Node 1 to additional cluster nodes, and verifying all requirements are met before RAC Software install.

Document Creator ModifiedTodd Walters   10/28/2009

Requirements 

• Oracle Dev Virtual Server Naming standards are srv0dbxdXX where XX is a number starting after 10. For Example the first Oracle Dev Virtual Server is named srv0dbxd11
• Oracle  Virtual Servers will adhere to these specifications on Dell r710 Host:
• 8gb Memory
• 50gb Hard Drive
• 4 Virtual CPU
• Vlan 126 for Test
• Vlan 127 for Dev
• Datasource will be on Storage that start with stor1-vmfs02

Part I: Create, Upload ISO to Datastore and Create Virtual Machine

1.       If needed to create new ks.cfg file follow Partition info below:
Partition space for Oracle RAC Servers are:
# Disk Partition Informationpart /boot --fstype ext3 --size 256 --ondisk=sda --asprimary
part swap  --fstype swap --size 8192 --ondisk=sda
part /     --fstype ext3 --size 5120 --ondisk=sda --asprimary
part /var  --fstype ext3 --size 2048 --ondisk=sda
part /opt  --fstype ext3 --size 4096 --ondisk=sda
part /tmp  --fstype ext3 --size 1024 --ondisk=sda
part /export --fstype ext3 --size 1024 --ondisk=sda
part pv.0 --size 1 --grow --ondisk=sda
volgroup ora_vg --pesize=16384 pv.0
logvol /u00 --fstype ext3 --name=u00_lv --vgname=ora_vg --size=10240

2.       If you created a  new ISO file you will need to copy it to srv0esxd02:/store02vmfs01/ISO/Linux

• Login to VMWare Infrastructure Client from you pc to srv0esxd02
• Go to Configuration tab and then click on Storage
• Right Click on the datastore stor01vmfs02 and choose 'Browse Datastore'
• Click on 'Upload'  files from you local machine and upload to ISO/Linux location
• You can now boot off the iso file and choose the appropriate kickstart.cfg file on the nfs server srv0smx00 to use

Create Virtual Machine

1. Next launch VMWare Infrastructure Client from you pc and login to srv0esxd02 with your user account.
2. Right click on 'srv0esxd02.mydom.com and choose 'New Virtual Machine'
3. On 'New Virtual Machine Wizard' box choose 'Typical' and then click 'Next'
4. On 'Select a Name and Location' box type in the name of the virtual server following naming standard, i.e. srv0dbxd11
5. On 'Choose a Datastore for the Virtual Machine' select d0esxd01vmfs02 datastore and click 'Next'
6. On 'Choost the Guest Operating System' screen choose 'Linux' radio button and then choose 'Red Hat Enterprise Linux 4 (64-bit)' and click 'Next'
7. On 'Virtual CPU' screen leave as default '4' and click 'Next'
8. On 'Memory' screen set 'Memory for this Virtual Machine' to 8096 and click 'Next'
9. On 'Choose Networks' screen use these settings and then click 'Next'
• How many NIC's do you want to connect? 2
• Network for NIC 1: 850_10.67.9.0_24
• Network for NIC 2: RAC_IC
•  Adapter: E1000 (It's required for 64-bit servers)
•  Connect At Power On: Checked
• Note: place on VLAN 850 then once install complete, during reboot change to correct vlan, i.e 125 .
10. On 'Define Virtual Disk Capacity' screen set disk size to 50gb and click 'Next'
11. On 'Ready to Complete New Virtual Machine' screen review your settings to verify everything is correct then click 'Finish'
12.  Click on 'srv0esxd02' and then click on 'Virtual Machines' tab in right side window. 
13.  Locate the new virtual machine you just created and right-click on it and choose 'Edit Notes...'
14.  Enter new virtual machine description in the 'Edit Notes' dialog box.

Part II: Installing Operating System and OS Configuration

1. In Virtual Infrastructure Client go to 'srv0esxd02' and select the New Virtual Machine you just created.
2. Right-click on Virtual Machine and chooose 'Edit Settings' from drop-down menu.
3. On the hostname - Virtual Machine Properties page under Hardware tab select 'CD/DVD Drive 1'
4. Under 'Device Type' select the radio button for 'Datastore ISO file' and click 'Browse'
5. On the 'Browse Datastore' dialog box choose 's0esxd02vmfs01' and click 'Open' 
6. Double-click on 'ISO' Folder then double-click on 'Linux' folder, select the ISO image you will be using and click 'Open'
7. Select 'Connect at Power On' check box in the 'Device Status' section at the top and click 'Ok'
8. Power on the Virtual Machine by clicking 'Power On Virtual Machine' on Summary Tab under 'Basic Tasks'
9. Right click on Virtual Machine name and choose 'Open Console'
10. As systems powers up it should boot off the iso image.
11.  At Red Hat Splash Screen choose 'To install RHEL4 U5 64bit under Cox Communications Standards, press the <ENTER> key'    *note: This will install hands free and reboot the system when complete. 
• The Preferred Method is below where you point to an NFS Server and ks.cfg file.
•  Preferred Method at the 'Red Hat Splash Screen', type linux ks=nfs:10.47.8.169:/home/kickstart/ks_files/orarac_vm_ks.cfg
12. You will also be asked to enter the Hostname, IP, Netmask, and Gateway. Enter the desired settings and continue with the installation.
13. Edit the Virtual Machine Settings again and change the 'CD/DVD Drive 1' to not connect at Power on anymore.
14. Remove Floppy Drive from the configuration as well
15. Continue to Post-Installation Tasks below. 

Part III: Post-Installation Tasks

1.  To connect, login via VMWare Infrastructure Client from you pc and login to srv0esxd02 with your root account, or ssh through putty to new IP.
2. Go to virtual server you created, i.e. srv0dbxd11, and Right-Click and choose 'Open console' 
3.  Login with root account.
4.  vi /etc/motd to update information - Add Unix Admin, DBA, POC and Hostname and Description
• Example
• ###############################################
  # Built on Tue May 20 13:15:27 PDT 2008
  # Built with Kickstart base config: 4.5.0
  # Unix Admin:  Todd Walters
  # DBA: your DBA
  # POC: Todd Walters
  # --- <srv0dbxd11.mydom.com> - <RAC Dev Node1> ---
  ##################################################
5. Verify /etc/sysconfig/network and hostname: (srv0dbxd11.mydom.com)
•  Edit hostname and gateway information if necessaryExample[root@srv0dbxd11 sysconfig]# cat network
  NETWORKING=yes
  HOSTNAME=srv0dbxd11
  GATEWAY=10.47.9.1
  GATEWAYDEV=eth0
6. Verify /etc/syconfig/network-scripts/ifcfg-eth0 is correct, change items as necessary: 
• Example ifcfg-eth0 file[root@srv0dbxd11 network-scripts]# cat ifcfg-eth0
  DEVICE=eth0
  BOOTPROTO=static
  HWADDR=00:0C:29:70:99:C1
  IPADDR=10.47.9.117
  NETMASK=255.255.255.0
  ONBOOT=yes
  TYPE=Ethernet
  MTU=1392
  #ETHTOOL_OPTS="speed 100 duplex full autoneg off"
• Example ifcfg-eth1 file
  [root@srv0dbxd11 network-scripts]# cat ifcfg-eth1
  DEVICE=eth1
  HWADDR=00:0C:29:70:99:CB
  ONBOOT=yes
  BOOTPROTO=STATIC
  IPADDR=192.168.0.11
  NETMASK=255.255.255.0
  TYPE=Ethernet
  MTU=1392
7. Edit the /etc/hosts file to contain all nodes:
   # that require network functionality will fail.
   127.0.0.1               localhost.localdomain localhost
   10.47.9.117             srv0dbxd11
   10.47.9.118             srv0dbxd11-vip
   192.168.0.11            srv0dbxd11-ic
   10.47.9.119             srv0dbxd12
   10.47.9.120             srv0dbxd12-vip
   192.168.0.12            srv0dbxd12-ic
   10.62.232.42            smtpmail.cox.com
8.   Start network service, test and verify:
• Type 'service network restart' to update settings and start network
  Run 'ip route show' to verify. 
•  Example ip route show command: Should see 'default via 10.47.9.1'
  [root@srv0dbxd11 network-scripts]# ip route show
  10.47.9.0/24 dev eth0  proto kernel  scope link  src 10.47.9.117
  169.254.0.0/16 dev eth0  scope link
  default via 10.47.9.1 dev eth0
•  Ping srv0asx01 or any other server to verify connectivity and network is working properly.
9. Login through putty with your user account. Reference: How to Create Linux User Accounts
10. Go to Prepare Linux Virtual Servers for Oracle RAC