OPEN FILLREER RAC 구성 ===1

[생짜초보]

Configure Open filer for RAC installation in VM ware

Hai, in this article I will demonstrate installation and Configuration of OPENFILER for RAC Installation

List of Topics (Linux, Database, RAC, EBS)

I have provided the links for complete installations in following Links:

1. Openfiler Installation and configuration, 
2. Linux Installtion
3. Grid Installation
4. Database Installation

NOTE: Install open filer with 512gbram, 10GB Hard disk, Hostonly N/W, and install s/w.

Before you click on reboot, attach 100GB addtion HDD and click reboot

NOTE: Before proceeding check ping for all IP’s

NOTE: for Rac Installation we need to have Public, Virtual, SCAN, SAN(openfiler) IP’s in same sequence

Assumptions:

Node Name	Adapter Name	IP – Type	IP Number	Netmask
RAC-1	Eth 0	Public	192.168.1.11	255.255.255.0
RAC-1	Eth 1	Private	10.0.0.11	255.0.0.0
RAC-1	hostfile	Virtual	192.168.1.21
-	-	-	-	-
RAC-2	Eth 0	Public	192.168.1.12	255.255.255.0
RAC-2	Eth 1	Private	10.0.0.12	255.0.0.0
RAC-2	hostfile	Virtual	192.168.1.22
-	-	-	-	-
RAC-1 / RAC-2	hostfile	Scan	192.168.1.30
Open Filer	Eth 0	Public	192.168.1.40	255.255.0.0

Steps included :

  1.     Create Virtual Machine with 512mb Memory

  2.     Install openfiler software with one network adapter

  3.     Attach 100gb disk for ASM before reboot

  4.     Configure ASM for Linux

Power on the Virtual Machine

Before reboot add 100gb Disk for ASM Storage

Now reboot the system

Now open the GUI of open filer and prepare the disk for shareable

URL for Configuration of SAN https://192.168.1.40:446

Click on System tab add who can access SAN

Click on Volumes Tab and Create volume disk of 100GB

Create Volume Group for the Disk

Add Disk to Volume Group

Here you can define As per your requirement

1.       OCR

2.       Voting Disk (VD)

3.       Flash Recovery Area (FRA)

I am installing All together in one Disk only as vol 1

Enable and start service of iSCSI TARGET and iSCSI Initiator

Create IQN  for the disk

Note: if you created Different volume disks then create separate IQN’s for VD,OCR, FRA then define it Acc. Here I have used single iqn for all(OCR,VD,FRA) in a single disk as vol-1

You have Successfully Configured the OpenFiler

Now install RAC1, RAC 2 Machines with two Ethernet adapters and Provide the IP and subnet mask as shown in above table

After Successful installation of RAC1 and RAC2 Ping each other along with SAN there should be no network connectivity issue between all

Setting up Host file:

RAC1

RAC2

# login as: root root@192.168.1.11's password: Last login: Tue May 10 09:30:35 2016 [root@rac1 ~]# hostname rac1.dell.com [root@rac1 ~]# vi /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 localhost.localdomain localhost ::1 localhost6.localdomain6 localhost6 ##-- Public-IP 192.168.1.11    rac1.dell.com   rac1 192.168.1.12    rac2.dell.com   rac2 192.168.1.13    rac3.dell.com   rac3 ##-- Private-IP 10.0.0.11 rac1-priv.dell.com rac1-priv 10.0.0.12 rac2-priv.dell.com rac2-priv 10.0.0.13 rac3-priv.dell.com rac3-priv ##-- Virtual-IP 192.168.1.21 rac1-vip.dell.com rac1-vip 192.168.1.22 rac2-vip.dell.com rac2-vip 192.168.1.23 rac3-vip.dell.com rac3-vip ##-- SCAN IP 192.168.1.30 dellc-scan.dell.com dellc-scan 192.168.1.31 dellc-scan.dell.com dellc-scan 192.168.1.32 dellc-scan.dell.com dellc-scan ##-- Storage-IP 192.168.1.40    san.dell.com    san [root@rac1 ~]# [root@rac1 ~]# service network restart Shutting down interface eth0:                              [  OK  ] Shutting down interface eth1:                              [  OK  ] Shutting down loopback interface:                          [  OK  ] Bringing up loopback interface:                            [  OK  ] Bringing up interface eth0:                                [  OK  ] Bringing up interface eth1:                                [  OK  ] [root@rac1 ~]#  [root@rac1 ~]# hostname -i 192.168.1.11 [root@rac1 ~]#

login as: root root@192.168.1.12's password: Last login: Tue May 10 10:44:19 2016 from  [root@rac2 ~]# hostname rac2.dell.com [root@rac2 ~]# vi /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 localhost.localdomain localhost ::1 localhost6.localdomain6 localhost6 ##-- Public-IP 192.168.1.11    rac1.dell.com   rac1 192.168.1.12    rac2.dell.com   rac2 192.168.1.13    rac3.dell.com   rac3 ##-- Private-IP 10.0.0.11 rac1-priv.dell.com rac1-priv 10.0.0.12 rac2-priv.dell.com rac2-priv 10.0.0.13 rac3-priv.dell.com rac3-priv ##-- Virtual-IP 192.168.1.21 rac1-vip.dell.com rac1-vip 192.168.1.22 rac2-vip.dell.com rac2-vip 192.168.1.23 rac3-vip.dell.com rac3-vip ##-- SCAN IP 192.168.1.30 dellc-scan.dell.com dellc-scan 192.168.1.31 dellc-scan.dell.com dellc-scan 192.168.1.32 dellc-scan.dell.com dellc-scan ##-- Storage-IP 192.168.1.40    san.dell.com    san [root@rac2 ~]# [root@rac2 ~]# service network restart Shutting down interface eth0:                              [  OK  ] Shutting down interface eth1:                              [  OK  ] Shutting down loopback interface:                          [  OK  ] Bringing up loopback interface:                            [  OK  ] Bringing up interface eth0:                                [  OK  ] Bringing up interface eth1:                                [  OK  ] [root@rac2 ~]#  [root@rac2 ~]# hostname -i 192.168.1.12 [root@rac2 ~]#

Node 1:-  RAC1	Node 2:- RAC2
[root@rac1 ~]# ping rac2 [root@rac1 ~]# ping rac1 [root@rac1 ~]# ping 192.168.1.40 [root@rac1 ~]# ping 192.168.1.11 [root@rac1 ~]# ping 192.168.1.12 [root@rac1 ~]# ping 10.0.0.11 [root@rac1 ~]# ping 10.0.0.12	[root@rac2 ~]# ping rac1 [root@rac2 ~]# ping rac2 [root@rac2 ~]# ping 192.168.1.40 [root@rac2 ~]# ping 192.168.1.12 [root@rac2 ~]# ping 192.168.1.11 [root@rac2 ~]# ping 10.0.0.12 [root@rac2 ~]# ping 10.0.0.11

Login to your Linux as root user and discover your IQN form all the NODES

Click here for installing Linux FOR RAC

Node-1 Machine: RAC1

login as: root

root@192.168.1.11's password:

Last login: Mon Feb 20 14:45:28 2017

[root@rac1 ~]# hostname

rac1.dell.com

[root@rac1 ~]#

[root@rac1 ~]# hostname -i

192.168.1.11

[root@rac1 ~]#

[root@rac1 ~]# ifconfig

eth0      Link encap:Ethernet  HWaddr 00:0C:29:FB:3F:8D

          inet addr:192.168.1.11  Bcast:192.168.1.255  Mask:255.255.255.0

          inet6 addr: fe80::20c:29ff:fefb:3f8d/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:281 errors:0 dropped:0 overruns:0 frame:0

          TX packets:163 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:47348 (46.2 KiB)  TX bytes:25000 (24.4 KiB)

eth1      Link encap:Ethernet  HWaddr 00:0C:29:FB:3F:97

          inet addr:10.0.0.11  Bcast:10.255.255.255  Mask:255.0.0.0

          inet6 addr: fe80::20c:29ff:fefb:3f97/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:214 errors:0 dropped:0 overruns:0 frame:0

          TX packets:86 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:36007 (35.1 KiB)  TX bytes:17656 (17.2 KiB)

lo        Link encap:Local Loopback

          inet addr:127.0.0.1  Mask:255.0.0.0

          inet6 addr: ::1/128 Scope:Host

          UP LOOPBACK RUNNING  MTU:16436  Metric:1

          RX packets:3758 errors:0 dropped:0 overruns:0 frame:0

          TX packets:3758 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0

          RX bytes:8380416 (7.9 MiB)  TX bytes:8380416 (7.9 MiB)

virbr0    Link encap:Ethernet  HWaddr EA:A2:66:7A:21:4C

          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:0 errors:0 dropped:0 overruns:0 frame:0

          TX packets:20 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0

          RX bytes:0 (0.0 b)  TX bytes:3647 (3.5 KiB)

[root@rac1 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes

255 heads, 63 sectors/track, 130541 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1       38245   307202931   83  Linux

/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris

/dev/sda3           41433       43982    20482875   83  Linux

/dev/sda4           43983      130541   695285167+   5  Extended

/dev/sda5           43983      130541   695285136   83  Linux

[root@rac1 ~]#

[root@rac1 ~]#

Your Disk is Not Available. So, Discover your IQN

[root@rac1 ~]# 

[root@rac1 ~]#  iscsiadm -m discovery -t st -p 192.168.1.40

192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0

[root@rac1 ~]#

[root@rac1 ~]# service iscsi restart

iscsiadm: No matching sessions found

Stopping iSCSI daemon:

iscsid is stopped                                          [  OK  ]

Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)

FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)

                                                           [  OK  ]

                                                           [  OK  ]

Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)

Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.

                                                           [  OK  ]

[root@rac1 ~]# chkconfig iscsi on
[root@rac1 ~]# 

[root@rac1 ~]# chkconfig --list | grep iscsi
iscsi           0:off   1:off   2:on    3:on    4:on    5:on    6:off

iscsid          0:off   1:off   2:off   3:on    4:on    5:on    6:off
[root@rac1 ~]#

[root@rac1 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes

255 heads, 63 sectors/track, 130541 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1       38245   307202931   83  Linux

/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris

/dev/sda3           41433       43982    20482875   83  Linux

/dev/sda4           43983      130541   695285167+   5  Extended

/dev/sda5           43983      130541   695285136   83  Linux

Disk /dev/sdb: 102.3 GB, 102374572032 bytes

255 heads, 63 sectors/track, 12446 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table

[root@rac1 ~]#

Node-2 Machine: RAC2

login as: root

root@192.168.1.12's password:

Last login: Mon Feb 20 14:47:45 2017

[root@rac2 ~]#

[root@rac2 ~]#

[root@rac2 ~]# hostname

rac2.dell.com

[root@rac2 ~]# hostname -i

192.168.1.12

[root@rac2 ~]#

[root@rac2 ~]# ifconfig

eth0      Link encap:Ethernet  HWaddr 00:0C:29:36:9C:16

          inet addr:192.168.1.12  Bcast:192.168.1.255  Mask:255.255.255.0

          inet6 addr: fe80::20c:29ff:fe36:9c16/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:200 errors:0 dropped:0 overruns:0 frame:0

          TX packets:151 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:39700 (38.7 KiB)  TX bytes:26672 (26.0 KiB)

eth1      Link encap:Ethernet  HWaddr 00:0C:29:36:9C:20

          inet addr:10.0.0.12  Bcast:10.255.255.255  Mask:255.0.0.0

          inet6 addr: fe80::20c:29ff:fe36:9c20/64 Scope:Link

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:216 errors:0 dropped:0 overruns:0 frame:0

          TX packets:95 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:1000

          RX bytes:37580 (36.6 KiB)  TX bytes:19182 (18.7 KiB)

lo        Link encap:Local Loopback

          inet addr:127.0.0.1  Mask:255.0.0.0

          inet6 addr: ::1/128 Scope:Host

          UP LOOPBACK RUNNING  MTU:16436  Metric:1

          RX packets:4374 errors:0 dropped:0 overruns:0 frame:0

          TX packets:4374 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0

          RX bytes:9177312 (8.7 MiB)  TX bytes:9177312 (8.7 MiB)

virbr0    Link encap:Ethernet  HWaddr 0E:D4:79:B6:C8:15

          inet addr:192.168.122.1  Bcast:192.168.122.255  Mask:255.255.255.0

          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1

          RX packets:0 errors:0 dropped:0 overruns:0 frame:0

          TX packets:27 errors:0 dropped:0 overruns:0 carrier:0

          collisions:0 txqueuelen:0

          RX bytes:0 (0.0 b)  TX bytes:4405 (4.3 KiB)

[root@rac2 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes

255 heads, 63 sectors/track, 130541 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1       38245   307202931   83  Linux

/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris

/dev/sda3           41433       43982    20482875   83  Linux

/dev/sda4           43983      130541   695285167+   5  Extended

/dev/sda5           43983      130541   695285136   83  Linux

[root@rac2 ~]#

[root@rac2 ~]#

Your Disk is Not Available. So, Discover your IQN

[root@rac2 ~]# 

[root@rac2 ~]#  iscsiadm -m discovery -t st -p 192.168.1.40

192.168.1.40:3260,1 iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0

[root@rac2 ~]#

[root@rac2 ~]# service iscsi restart

iscsiadm: No matching sessions found

Stopping iSCSI daemon:

iscsid is stopped                                          [  OK  ]

Starting iSCSI daemon: FATAL: Error inserting cxgb3i (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko): Unknown symbol in module, or unknown parameter (see dmesg)

FATAL: Error inserting ib_iser (/lib/modules/2.6.32-300.10.1.el5uek/kernel/drivers/infiniband/ulp/iser/ib_iser.ko): Unknown symbol in module, or unknown parameter (see dmesg)

                                                           [  OK  ]

                                                           [  OK  ]

Setting up iSCSI targets: Logging in to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] (multiple)

Login to [iface: default, target: iqn.2006-01.com.openfiler:tsn.5debe1b1c4b0, portal: 192.168.1.40,3260] successful.

                                                           [  OK  ]

[root@rac2 ~]# chkconfig iscsi on

[root@rac2 ~]# 

[root@rac2 ~]#
[root@rac2 ~]# chkconfig --list | grep iscsi
iscsi           0:off   1:off   2:on    3:on    4:on    5:on    6:off

iscsid          0:off   1:off   2:off   3:on    4:on    5:on    6:off
[root@rac2 ~]#
[root@rac1 ~]# cat /etc/inittab

#
# inittab       This file describes how the INIT process should set up
#               the system in a certain run-level.
#
# Author:       Miquel van Smoorenburg, <miquels@drinkel.nl.mugnet.org>
#               Modified for RHS Linux by Marc Ewing and Donnie Barnes
#

# Default runlevel. The runlevels used by RHS are:
#   0 - halt (Do NOT set initdefault to this)
#   1 - Single user mode
#   2 - Multiuser, without NFS (The same as 3, if you do not have networking)
#   3 - Full multiuser mode
#   4 - unused
#   5 - X11
#   6 - reboot (Do NOT set initdefault to this)
#
id:5:initdefault:

# System initialization.
si::sysinit:/etc/rc.d/rc.sysinit

l0:0:wait:/etc/rc.d/rc 0
l1:1:wait:/etc/rc.d/rc 1
l2:2:wait:/etc/rc.d/rc 2
l3:3:wait:/etc/rc.d/rc 3
l4:4:wait:/etc/rc.d/rc 4
l5:5:wait:/etc/rc.d/rc 5
l6:6:wait:/etc/rc.d/rc 6

# Trap CTRL-ALT-DELETE
ca::ctrlaltdel:/sbin/shutdown -t3 -r now

# When our UPS tells us power has failed, assume we have a few minutes
# of power left.  Schedule a shutdown for 2 minutes from now.
# This does, of course, assume you have powerd installed and your
# UPS connected and working correctly.
pf::powerfail:/sbin/shutdown -f -h +2 "Power Failure; System Shutting Down"

# If power was restored before the shutdown kicked in, cancel it.
pr:12345:powerokwait:/sbin/shutdown -c "Power Restored; Shutdown Cancelled"


# Run gettys in standard runlevels
1:2345:respawn:/sbin/mingetty tty1
2:2345:respawn:/sbin/mingetty tty2
3:2345:respawn:/sbin/mingetty tty3
4:2345:respawn:/sbin/mingetty tty4
5:2345:respawn:/sbin/mingetty tty5
6:2345:respawn:/sbin/mingetty tty6

# Run xdm in runlevel 5
x:5:respawn:/etc/X11/prefdm -nodaemon

h1:35:respawn:/etc/init.d/init.ohasd run >/dev/null 2>&1 </dev/null

[root@rac1 ~]#
[root@rac1 ~]# who -r
         run-level 5  2018-01-30 07:57                   last=S

[root@rac1 ~]#

[root@rac2 ~]# fdisk -l

Disk /dev/sda: 1073.7 GB, 1073741824000 bytes

255 heads, 63 sectors/track, 130541 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

   Device Boot      Start         End      Blocks   Id  System

/dev/sda1   *           1       38245   307202931   83  Linux

/dev/sda2           38246       41432    25599577+  82  Linux swap / Solaris

/dev/sda3           41433       43982    20482875   83  Linux

/dev/sda4           43983      130541   695285167+   5  Extended

/dev/sda5           43983      130541   695285136   83  Linux

Disk /dev/sdb: 102.3 GB, 102374572032 bytes

255 heads, 63 sectors/track, 12446 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Disk /dev/sdb doesn't contain a valid partition table

[root@rac2 ~]#

This article helps those who want to install grid Infrastructure in VMWARE using openfiler.

Click here for installing GRID infra-structure

Follow the same steps for Grid installation as shown in above link, in which i have installed Grid on VirtualBox. Skip those creation of Machine, Shareable Disk and Installation of Linux Steps 

Thanks for Reading

Regards,

Mohammed Areefuddin.

Suggested Topics :

Linux	DATABASE	RMAN	RAC	EBS
5.7 Install	DATABASE Install		11201 Install	R1226 Install
Open Filer Instl	Active DataGaurd	Rman DataGuard	12102 RAC INSTAL	EBS DataGuard
	WIN-LINUX MIGRATE	RMAN DB CLONE	RAC DataGuard	R1226 Clone
	ASMCMD ASM Migrt	RMAN ASM Migrt	RAC DB Clone	RMAN Clone
	11204 M-Upgrade		RAC - RAC Clone	11202 EBS Upgrade
	12102 M-Upgrade		12C-19C RAC UPGRADE	12102 EBS UPGRADE
Linux Basics	DATABASE Basics	RMAN Basics	RAC Basic	EBS BasicsBasic Linux Stuff

Posted by Mohammed Areefuddin at 11:14 PM 

Email ThisBlogThis!Share to TwitterShare to FacebookShare to Pinterest

Labels: ASM, DATABASE, Installation, Linux, RAC