OEL6.5_X86平台部署oracle11gR2RAC配置ACFS

Posted

tags:

篇首语:本文由小常识网(cha138.com)小编为大家整理,主要介绍了OEL6.5_X86平台部署oracle11gR2RAC配置ACFS相关的知识,希望对你有一定的参考价值。

ACFS, oracle官方定义:

Oracle AutomaticStorage Management Cluster File System (Oracle ACFS) is a multi-platform,scalable file system, and storage management technology that extends OracleAutomatic Storage Management (Oracle ASM) functionality to support customerfiles maintained outside of Oracle Database. Oracle ACFS supports many databaseand application files, including executables,database trace files, databasealert logs, application reports, BFILEs, and configuration files. Othersupported files are video, audio, text, images, engineering drawings, and othergeneral-purpose application file data.

下面来介绍下11G RAC环境下ACFS的使用,当前系统环境操作系统版本为OEL6.5,数据库版本为ORACLE11204。

1.  查看ACFS相关的服务

查看acfs/advm驱动是否加载

[[email protected] bin]#lsmod |grep oracle

[[email protected] bin]#

[[email protected] bin]#lsmod |grep oracle

[[email protected] bin]#

查看集群资源

[[email protected] ~]# su- grid -c crs_stat|grep acfs

[[email protected] ~]#

[[email protected] ~]# su- grid -c crs_stat|grep acfs

[[email protected] ~]#

 

使用acfsload加载驱动

[[email protected] bin]#./acfsload start -s

ACFS-9459:ADVM/ACFS is not supported on this OS version: ‘3.8.13-16.2.1.el6uek.x86_64‘

[[email protected] bin]#uname -a

Linux jxcw13.8.13-16.2.1.el6uek.x86_64 #1 SMP Thu Nov 7 17:01:44 PST 2013 x86_64 x86_64x86_64 GNU/Linux

[[email protected] bin]#

从报错信息中可以看出,OEL6.5操作系统11204数据库并未被支持。升级数据库版本,打补丁11204.7后驱动可以被加载,但不能被系统自动加载。处理如下:

[[email protected] ~]# cat/etc/init.d/acfsload

#!/bin/sh

# chkconfig: 234530 21

# description: LoadOracle ASM volume driver on system startup 

ORACLE_HOME=/u01/app/11.2.0/grid

export ORACLE_HOME

$ORACLE_HOME/bin/acfsloadstart -s

[[email protected] ~]# chkconfigadd acfsload

 

 

 

[[email protected] ~]#chkconfig --list|grep acfsload

acfsload        0:off  1:off   2:on    3:on   4:on    5:on    6:off

[[email protected] ~]#

[[email protected] bin]#./acfsload start -s

[[email protected] bin]#lsmod |grep oracle

oracleacfs            877320  0

oracleadvm            221760  0

oracleoks             276880  2 oracleacfs,oracleadvm

[[email protected]]#  lsmod |grep oracle

oracleacfs            877192  0

oracleadvm            221504  0

oracleoks             277008  2 oracleacfs,oracleadvm

[[email protected] bin]#

添加资源ora.registry.acfs

[[email protected] ~]#/u01/app/11.2.0/grid/bin/crsctl add type ora.registry.acfs.type -basetypeora.local_resource.type -file/u01/app/11.2.0/grid/crs/template/registry.acfs.type

[[email protected] ~]# /u01/app/11.2.0/grid/bin/crsctladd resource ora.registry.acfs -attrACL=\‘owner:root:rwx,pgrp:oinstall:r-x,other::r--\‘ -typeora.registry.acfs.type -f

[[email protected] ~]#

查看是否添加成功

[[email protected] ~]# su- grid -c crs_stat | grep acfs

NAME=ora.registry.acfs

TYPE=ora.registry.acfs.type

[[email protected] ~]#

[[email protected] ~]# su- grid -c crs_stat | grep acfs

NAME=ora.registry.acfs

TYPE=ora.registry.acfs.type

[[email protected] ~]#

查看添加的资源状态。

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME          TARGET  STATE        SERVER                   STATE_DETAILS      

Local Resources

---------------------------------------------------------------------

ora.ARCH.dg

               ONLINE ONLINE       jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE  ONLINE      jxcw1                   Started            

               ONLINE  ONLINE      jxcw2                   Started            

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

Cluster Resources

---------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw2                                        

ora.cvu

      1       ONLINE  ONLINE       jxcw2                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw2                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw2  

[[email protected] ~]$

 添加的ora.registry.acfs资源默认offline,需手工启动。                    

[[email protected] ~]$crsctl start resource ora.registry.acfs -n jxcw1

CRS-2672:Attempting to start ‘ora.registry.acfs‘ on ‘jxcw1‘

CRS-2676: Start of‘ora.registry.acfs‘ on ‘jxcw1‘ succeeded

[[email protected] ~]$crsctl start resource ora.registry.acfs -n jxcw2

CRS-2672:Attempting to start ‘ora.registry.acfs‘ on ‘jxcw2‘

CRS-2676: Start of‘ora.registry.acfs‘ on ‘jxcw2‘ succeeded

启动后查看状态如下,已为online状态。

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS       

---------------------------------------------------------------------

Local Resources

ora.ARCH.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE  ONLINE      jxcw1                   Started            

               ONLINE  ONLINE      jxcw2                   Started            

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

               ONLINE  ONLINE      jxcw1                                       

               ONLINE ONLINE       jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

---------------------------------------------------------------------ClusterResources

---------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw2                                       

ora.cvu

      1       ONLINE  ONLINE       jxcw2                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE      jxcw1                                       

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw2                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw2                                       

[[email protected] ~]$

2.  使用ASMCMD命令创建ACFS

(1)、使用volcreate命令创建vol01,大小为30G;

ASMCMD>volcreate -G data -s 30G testvol

(2)、使用volinfo查看vol01的相关信息

ASMCMD> volinfo-G data testvol

Diskgroup Name:DATA

 

         Volume Name: TESTVOL

         Volume Device: /dev/asm/testvol-347

         State: ENABLED

         Size (MB): 30720

         Resize Unit (MB): 32

         Redundancy: UNPROT

         Stripe Columns: 4

         Stripe Width (K): 128

         Usage:

         Mountpath:

 

ASMCMD>

(2)、使用操作系统命令查看设备名,这里的/dev/asm/ testvol-347相当于裸设备。

[[email protected] ~]$ cd/dev/asm/

[[email protected] asm]$ls -l

total 0

brwxrwx--- 1 rootasmadmin 251, 177665 Oct 28 13:20 testvol-347

[[email protected] asm]$

(3)、在v$asm_volume视图中使用sql查看volume相关信息

[[email protected] asm]$sqlplus / as sysasm

 

SQL*Plus: Release11.2.0.4.0 Production on Fri Oct 28 13:22:33 2016

 

Copyright (c) 1982,2013, Oracle.  All rights reserved.

Connected to:

Oracle Database 11gEnterprise Edition Release 11.2.0.4.0 - 64bit Production

With the RealApplication Clusters and Automatic Storage Management options

 

SQL> selectvolume_name,volume_device,size_mb from v$asm_volume;

 

VOLUME_NAME          VOLUME_DEVICE                                      SIZE_MB

---------------------------------------------------------

TESTVOL              /dev/asm/testvol-347                                 30720

 

SQL>

(4)、格式化卷,创建文件系统

[[email protected] ~]#mkfs.acfs /dev/asm/testvol-347

mkfs.acfs:version                   = 11.2.0.4.0

mkfs.acfs: on-diskversion           = 39.0

mkfs.acfs:volume                    =/dev/asm/testvol-347

mkfs.acfs: volumesize               = 32212254720

mkfs.acfs: Formatcomplete.

[[email protected] ~]#

(5)、注册ACFS文件系统,相当于定义挂载点,仅在节点1注册一次即可

[[email protected]~]#acfsutil registry -a /dev/asm/testvol-347/u01/app/grid/acfsmounts/data_testvol/

acfsutil registry:mount point /u01/app/grid/acfsmounts/data_testvol successfully added to OracleRegistry

查看文件系统信息

[[email protected] ~]#acfsutil info fs

/u01/app/grid/acfsmounts/data_testvol

    ACFS Version: 11.2.0.4.0

    flags:        MountPoint,Available

    mount time:   Fri Oct 28 13:37:27 2016

    volumes:      1

    total size:   32212254720

    total free:   32068386816

    primary volume: /dev/asm/testvol-347

        label:                

        flags:                 Primary,Available,ADVM

        on-disk version:       39.0

        allocation unit:       4096

        major, minor:          251, 177665

        size:                  32212254720

        free:                  32068386816

        ADVM diskgroup         DATA

        ADVM resize increment: 33554432

        ADVM redundancy:       unprotected

        ADVM stripe columns:   4

        ADVM stripe width:     131072

    number of snapshots:  0

    snapshot space usage: 0

    replication status: DISABLED

[[email protected] ~]#

(6)、注册成功后自动挂载文件系统,两节点查看如下:

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G  255M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  254M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G  138M  30G   1%/u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

图形界面查看状态如下

技术分享

再次查看集群资源状态

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS      

---------------------------------------------------------------------

Local Resources

---------------------------------------------------------------------ora.ARCH.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE ONLINE       jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE  ONLINE      jxcw1                   Started            

               ONLINE  ONLINE      jxcw2                   Started            

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

              ONLINE  ONLINE       jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

---------------------------------------------------------------------

Cluster Resources

---------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw2                                        

ora.cvu

      1       ONLINE  ONLINE       jxcw2                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw2                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw2                                       

[[email protected] ~]$

3.  asmca图形界面创建

切换到grid用户下,执行asmca启动图形界面进行配置

技术分享

启动图形界面后,点击asm instance可以看到advm driver状态为loaded。若acfs与advm驱动未加载时,状态为installed,volumes与asmcluster file systems标签栏为灰色无法点击。点击volumes标签,创建卷。

技术分享

图中为使用命令创建成功的卷。再次点击create

技术分享

指定卷名为jxcwvol,大小为25G,点击OK。

技术分享

创建成功,点击ok退出,显示如下:

技术分享

点击asm clusterfile systems标签

技术分享

点击create,选择刚才创建的卷,选择database home file system选项,并指定图中所示挂载点。选择该选项该文件系统将作为集群资源被注册在集群中,由集群进行管理。

技术分享

技术分享

点击ok,创建ACFS文件系统。点击ok执行的命令如下

Create ACFSCommand:

/sbin/mkfs -t acfs/dev/asm/jxcw-347

Following commandsshould be run as privileged user :

/u01/app/11.2.0/grid/bin/srvctladd filesystem -d /dev/asm/jxcw-347 -g ‘DATA‘ -v jxcwvol -m/u01/app/grid/acfsmounts/data_jxcwvol -u grid

/u01/app/11.2.0/grid/bin/srvctlstart filesystem -d /dev/asm/jxcw-347

chown grid:oinstall/u01/app/grid/acfsmounts/ data_jxcwvol

chmod 775/u01/app/grid/acfsmounts/data_jxcwvol

技术分享

根据提示使用root账户在ASMCA图形界面启动的节点上执行途中所示命令,如下:

[[email protected] ~]#/u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh

ACFS file system isrunning on jxcw1,jxcw2

[[email protected] ~]#

技术分享

备注:途中所执行脚本内容如下:

[[email protected] ~]# vi/u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh

 

#!/bin/sh

 

/u01/app/11.2.0/grid/bin/srvctlstop filesystem -d /dev/asm/jxcwvol-347

/u01/app/11.2.0/grid/bin/srvctlremove filesystem -d /dev/asm/jxcwvol-347

/u01/app/11.2.0/grid/bin/srvctladd filesystem -d /dev/asm/jxcwvol-347 -g ‘DATA‘ -v JXCWVOL -m/u01/app/grid/acfsmounts/data_jxcwvol -u grid

if [ $? ="0" -o $? = "2" ]; then

   /u01/app/11.2.0/grid/bin/srvctl startfilesystem -d /dev/asm/jxcwvol-347

   if [ $? = "0" ]; then

      chown grid:oinstall/u01/app/grid/acfsmounts/data_jxcwvol

      chmod 775/u01/app/grid/acfsmounts/data_jxcwvol

      /u01/app/11.2.0/grid/bin/srvctl statusfilesystem -d /dev/asm/jxcwvol-347

      exit 0

   fi

   /u01/app/11.2.0/grid/bin/srvctl statusfilesystem -d /dev/asm/jxcwvol-347

fi

执行成功在两节点分别查看,新加ACFS文件系统已被挂载。

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G  258M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_testvol

/dev/asm/jxcwvol-347           25G 128M   25G   1% /u01/app/grid/acfsmounts/data_jxcwvol

[[email protected] ~]#

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  255M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_testvol

/dev/asm/jxcwvol-347           25G 128M   25G   1% /u01/app/grid/acfsmounts/data_jxcwvol

[[email protected] ~]#

再次看集群资源状态,新创建的ACFS文件系统被作为资源加入集群。

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS      

---------------------------------------------------------------------

Local Resources

---------------------------------------------------------------------

ora.ARCH.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE ONLINE       jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE  ONLINE      jxcw1                   Started            

               ONLINE  ONLINE      jxcw2                   Started            

ora.data.jxcwvol.acfs

               ONLINE  ONLINE      jxcw1                    mountedon /u01/app

                                                            /grid/acfsmounts/dat

                                                            a_jxcwvol          

               ONLINE  ONLINE      jxcw2                    mountedon /u01/app

                                                            /grid/acfsmounts/dat

                                                            a_jxcwvol          

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

---------------------------------------------------------------------ClusterResources

---------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw2                                       

ora.cvu

      1       ONLINE  ONLINE       jxcw2                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw2                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw2                                       

[[email protected] ~]$

再次查看注册信息如下:

[[email protected] ~]#acfsutil info fs

/u01/app/grid/acfsmounts/data_testvol

    ACFS Version: 11.2.0.4.0

    flags:        MountPoint,Available

    mount time:   Fri Oct 28 13:37:27 2016

    volumes:      1

    total size:   32212254720

    total free:   32068386816

    primary volume: /dev/asm/testvol-347

        label:                

        flags:                 Primary,Available,ADVM

        on-disk version:       39.0

        allocation unit:       4096

        major, minor:          251, 177665

        size:                  32212254720

        free:                  32068386816

        ADVM diskgroup         DATA

        ADVM resize increment: 33554432

        ADVM redundancy:       unprotected

        ADVM stripe columns:   4

        ADVM stripe width:     131072

    number of snapshots:  0

    snapshot space usage: 0

    replication status: DISABLED

 

/u01/app/grid/acfsmounts/data_jxcwvol

    ACFS Version: 11.2.0.4.0

    flags:        MountPoint,Available

    mount time:   Fri Oct 28 13:45:44 2016

    volumes:      1

    total size:   26843545600

    total free:   26710327296

    primary volume: /dev/asm/jxcwvol-347

        label:                

        flags:                 Primary,Available,ADVM

        on-disk version:       39.0

        allocation unit:       4096

        major, minor:          251, 177666

        size:                  26843545600

        free:                  26710327296

        ADVM diskgroup         DATA

        ADVM resize increment: 33554432

        ADVM redundancy:       unprotected

        ADVM stripe columns:   4

        ADVM stripe width:     131072

    number of snapshots:  0

    snapshot space usage: 0

    replication status: DISABLED

[[email protected] ~]#

4.  删除ACFS文件系统

(1)、当前状态查看

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G 256M   16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/jxcwvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_jxcwvol

/dev/asm/testvol-347           15G 107M   15G   1% /u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

 

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  254M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/jxcwvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_jxcwvol

/dev/asm/testvol-347           15G 107M   15G   1% /u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

 

[[email protected] ~]# su -grid

[[email protected] ~]$crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ARCH.dg

               ONLINE  ONLINE      jxcw1                                        

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                        

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE  ONLINE      jxcw1                                        

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE  ONLINE      jxcw1                   Started            

               ONLINE  ONLINE      jxcw2                    Started            

ora.data.jxcwvol.acfs

               ONLINE  ONLINE      jxcw1                    mountedon /u01/app

                                                            /grid/acfsmounts/dat

                                                             a_jxcwvol          

               ONLINE  ONLINE      jxcw2                    mountedon /u01/app

                                                            /grid/acfsmounts/dat

                                                             a_jxcwvol          

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw1                                        

ora.cvu

      1       ONLINE  ONLINE       jxcw2                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw2                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw1                                       

[[email protected] ~]$

(2)、卸载磁盘

节点1

[[email protected] ~]#umount /dev/asm/testvol-347

[[email protected] ~]#umount /dev/asm/jxcwvol-347

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G  257M  16G   2% /dev/shm

/dev/sda1                     477M   55M  397M  13% /boot

[[email protected] ~]#

节点2

[[email protected] ~]#umount /dev/asm/testvol-347

[[email protected] ~]#umount /dev/asm/jxcwvol-347

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  254M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

[[email protected] ~]#

再次查看资源状态

[[email protected] ~]$crsctl stat res -t

-------------------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS      

-------------------------------------------------------------------------------

Local Resources

-------------------------------------------------------------------------------

ora.ARCH.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE ONLINE       jxcw1                    Started            

               ONLINE  ONLINE      jxcw2                   Started            

ora.data.jxcwvol.acfs

               OFFLINE OFFLINE      jxcw1                    admin unmounted /u0

                                                            1/app/grid/acfsmount

                                                            s/data_jxcwvol     

               OFFLINE OFFLINE      jxcw2                    admin unmounted /u0

                                                             1/app/grid/acfsmount

                                                            s/data_jxcwvol     

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

-------------------------------------------------------------------------------

Cluster Resources

-------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw2                                       

ora.cvu

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE       jxcw1                                        

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw1                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw2                                        

[[email protected] ~]$

可以看出图形界面创建的jxcwvol卷,卸载文件系统后,ora.data.jxcwvol.acfs

资源自动offline,卷为umounted状态;testvol关联与ora.registry.acfs资源,该资源状态正常。

(3)、停止ora.registry.acfs资源

[[email protected] ~]$crsctl stop resource ora.registry.acfs -n jxcw1

CRS-2673: Attemptingto stop ‘ora.registry.acfs‘ on ‘jxcw1‘

CRS-2677: Stop of‘ora.registry.acfs‘ on ‘jxcw1‘ succeeded

[[email protected] ~]$crsctl stop resource ora.registry.acfs -n jxcw2

CRS-2673: Attemptingto stop ‘ora.registry.acfs‘ on ‘jxcw2‘

CRS-2677: Stop of‘ora.registry.acfs‘ on ‘jxcw2‘ succeeded

[[email protected] ~]$crsctl stat res -t

-------------------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS      

-------------------------------------------------------------------------------

Local Resources

-------------------------------------------------------------------------------

ora.ARCH.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.DATA.dg

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

               ONLINE  ONLINE      jxcw1                                        

               ONLINE  ONLINE      jxcw2                                       

ora.asm

               ONLINE  ONLINE      jxcw1                   Started            

               ONLINE  ONLINE      jxcw2                    Started            

ora.data.jxcwvol.acfs

               OFFLINE OFFLINE      jxcw1                    admin unmounted /u0

                                                            1/app/grid/acfsmount

                                                             s/data_jxcwvol     

               OFFLINE OFFLINE      jxcw2                    admin unmounted /u0

                                                            1/app/grid/acfsmount

                                                            s/data_jxcwvol     

ora.gsd

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

               ONLINE  ONLINE      jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.ons

               ONLINE  ONLINE      jxcw1                                        

               ONLINE  ONLINE      jxcw2                                       

ora.registry.acfs

               OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                        

-------------------------------------------------------------------------------

Cluster Resources

-------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1       ONLINE  ONLINE       jxcw2                                       

ora.cvu

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw.db

      1       ONLINE  ONLINE       jxcw1                    Open               

      2       ONLINE  ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1       ONLINE  ONLINE       jxcw1                                       

ora.jxcw2.vip

      1       ONLINE  ONLINE       jxcw2                                       

ora.oc4j

      1       ONLINE  ONLINE       jxcw1                                       

ora.scan1.vip

      1       ONLINE  ONLINE       jxcw2                                       

[[email protected] ~]$

(4)、删除注册信息

仅在一个节点执行

[[email protected] ~]#acfsutil registry -d /u01/app/grid/acfsmounts/data_testvol/

acfsutil registry: successfully removed ACFS mount point/u01/app/grid/acfsmounts/data_testvol from Oracle Registry

[[email protected] ~]#

上一步中已ora.data.jxcwvol.acfs资源offline,移除注册信息报错正常。

[[email protected] ~]#acfsutil registry -d /u01/app/grid/acfsmounts/data_jxcwvol/

acfsutil registry:ACFS-03143: The specified mount point does not exist and therefore cannot bedeleted.

[[email protected] ~]#

(5)、删除ACFS文件系统

仅在一个节点执行删除

[[email protected] ~]#acfsutil rmfs /dev/asm/testvol-347

[[email protected] ~]#acfsutil rmfs /dev/asm/jxcwvol-347

(6)、禁用volume

需要在两节点执行

节点1禁止

[[email protected] ~]$asmcmd

ASMCMD>voldisable -G data testvol

ASMCMD>voldisable -G data jxcwvol

ASMCMD>

节点2禁止

[[email protected] ~]$asmcmd

ASMCMD>voldisable -G data testvol

ASMCMD> voldisable-G data jxcwvol

ASMCMD> exit

[[email protected] ~]$

(7)、删除卷

仅在一个节点执行。

[[email protected] ~]$asmcmd

ASMCMD> ls           

ASMCMD> voldelete-G data testvol

ASMCMD> voldelete-G data jxcwvol

(8)、删除资源对象

[[email protected]~]#/u01/app/11.2.0/grid/bin/srvctl remove filesystem-d /dev/asm/jxcwvol-347

[[email protected] ~]$ crsctl stat res -t

---------------------------------------------------------------------

NAME          TARGET  STATE        SERVER                   STATE_DETAILS      

---------------------------------------------------------------------

Local Resources

ora.ARCH.dg

              ONLINE  ONLINE       jxcw1                                       

              ONLINE  ONLINE       jxcw2                                       

ora.CRS.dg

               ONLINE  ONLINE      jxcw1                                       

              ONLINE  ONLINE       jxcw2                                       

ora.DATA.dg

              ONLINE  ONLINE       jxcw1                                       

               ONLINE  ONLINE      jxcw2                                       

ora.LISTENER.lsnr

              ONLINE  ONLINE       jxcw1                                       

              ONLINE  ONLINE       jxcw2                                       

ora.asm

              ONLINE  ONLINE       jxcw1                    Started            

              ONLINE  ONLINE       jxcw2                    Started            

ora.gsd

              OFFLINE OFFLINE      jxcw1                                       

               OFFLINE OFFLINE      jxcw2                                       

ora.net1.network

              ONLINE  ONLINE       jxcw1                                       

              ONLINE  ONLINE       jxcw2                                        

ora.ons

              ONLINE  ONLINE       jxcw1                                       

              ONLINE  ONLINE       jxcw2                                       

ora.registry.acfs

              ONLINE  ONLINE       jxcw1                                        

              ONLINE  ONLINE       jxcw2                                       

---------------------------------------------------------------------ClusterResources

---------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE ONLINE       jxcw2                                       

ora.cvu

      1        ONLINE ONLINE       jxcw2                                       

ora.jxcw.db

      1        ONLINE ONLINE       jxcw1                    Open               

      2        ONLINE ONLINE       jxcw2                    Open               

ora.jxcw1.vip

      1        ONLINE ONLINE       jxcw1                                       

ora.jxcw2.vip

      1        ONLINE ONLINE       jxcw2                                       

ora.oc4j

      1        ONLINE ONLINE       jxcw2                                       

ora.scan1.vip

      1        ONLINE ONLINE       jxcw2                                       

[[email protected] ~]$


本文出自 “技术成就梦想!” 博客,请务必保留此出处http://dreamsanqin.blog.51cto.com/845412/1866798

以上是关于OEL6.5_X86平台部署oracle11gR2RAC配置ACFS的主要内容,如果未能解决你的问题,请参考以下文章

SUSE11 Oracle 11g RAC双机集群环境部署

如何在CentOS6.5系统上安装Oracle11gR2数据库

Oracle RAC + ASM + Grid安装

CentOS7安装Oracle11gR2

oracle 11.2.0.4for LINUX X86_64的下载地址是啥?

RHEL Oracle11G部署