Huaiyao Jin

Huaiyao Jin

Test acfs/ggs vip/xag in my local VM

Learn and test acfs/ggs vip/xag in my local VM.

[oracle@ccg15xxdb141 ~]$ cat /etc/redhat-release
Red Hat Enterprise Linux Server release 7.9 (Maipo)
[oracle@ccg15xxdb141 ~]$ uname -a
Linux ccg15xxdb141 5.4.17-2102.201.3.el7uek.x86_64 #2 SMP Fri Apr 23 09:05:55 PDT 2021 x86_64 x86_64 x86_64 GNU/Linux

[oracle@ccg15xxdb141 dbs]$ srvctl status database -d ORCL19C
Instance ORCL19C1 is running on node ccg15xxdb141
Instance ORCL19C2 is running on node ccg15xxdb142

SQL> select mount_status, header_status, mode_status, state, total_mb, free_mb, name,REDUNDANCY, path, label from v$asm_disk where header_status='CANDIDATE';

MOUNT_S HEADER_STATU MODE_ST STATE	TOTAL_MB    FREE_MB
------- ------------ ------- -------- ---------- ----------
NAME			       REDUNDA
------------------------------ -------
PATH
--------------------------------------------------------------------------------
LABEL
-------------------------------
CLOSED	CANDIDATE    ONLINE  NORMAL	       0	  0
			       UNKNOWN
/dev/asmdisk/OGG01


SQL> select GROUP_NUMBER,NAME from v$asm_diskgroup;

GROUP_NUMBER NAME
------------ ------------------------------
           1 DATA
           2 FRA

SQL> select * from v$asm_attribute where name like '%com%';

NAME                 VALUE                GROUP_NUMBER ATTRIBUTE_INDEX ATTRIBUTE_INCARNATION READ_ON SYSTEM_     CON_ID
-------------------- -------------------- ------------ --------------- --------------------- ------- ------- ----------
compatible.asm       19.0.0.0.0                      1             100                     1 N       Y                0
compatible.rdbms     10.1.0.0.0                      1             102                     1 N       Y                0
compatible.asm       19.0.0.0.0                      2             100                     1 N       Y                0
compatible.rdbms     10.1.0.0.0                      2             102                     1 N       Y                0


sqlplus / as sysasm

create diskgroup OGG external redundancy disk '/dev/asmdisk/OGG01' 
attribute 'compatible.asm'='19.0.0.0.0','compatible.asm'='19.0.0.0.0';

SQL> select * from v$asm_attribute where name like '%com%';

NAME                 VALUE                GROUP_NUMBER ATTRIBUTE_INDEX ATTRIBUTE_INCARNATION READ_ON SYSTEM_     CON_ID
-------------------- -------------------- ------------ --------------- --------------------- ------- ------- ----------
compatible.asm       19.0.0.0.0                      1             100                     1 N       Y                0
compatible.rdbms     10.1.0.0.0                      1             102                     1 N       Y                0
compatible.asm       19.0.0.0.0                      2             100                     1 N       Y                0
compatible.rdbms     10.1.0.0.0                      2             102                     1 N       Y                0
compatible.asm       19.0.0.0.0                      3             100                     1 N       Y                0
compatible.rdbms     10.1.0.0.0                      3             102                     1 N       Y                0


SQL> select trunc(free_mb/1024)  from v$asm_diskgroup where name='OGG';

TRUNC(FREE_MB/1024)
-------------------
                 19


ASMCMD> volcreate -G OGG -s 19G acfs_vol
ORA-15032: not all alterations performed
ORA-15477: cannot communicate with the volume driver (DBD ERROR: OCIStmtExecute)

[oracle@ccg15xxdb141 ~]$ crsctl status res ora.OGG.dg -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.OGG.dg(ora.asmgroup)
      1        OFFLINE OFFLINE                               STABLE
      2        OFFLINE OFFLINE                               STABLE
      3        OFFLINE OFFLINE                               STABLE
--------------------------------------------------------------------------------

[oracle@ccg15xxdb141 ~]$ crsctl start res ora.OGG.dg
CRS-4995:  The command 'Start  resource' is invalid in crsctl. Use srvctl for this command.

[oracle@ccg15xxdb141 ~]$ crsctl start res ora.OGG.dg -unsupported
CRS-2672: Attempting to start 'ora.OGG.dg' on 'ccg15xxdb142'
CRS-2672: Attempting to start 'ora.OGG.dg' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.OGG.dg' on 'ccg15xxdb142' succeeded
CRS-2676: Start of 'ora.OGG.dg' on 'ccg15xxdb141' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl status res ora.OGG.dg -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.OGG.dg(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             STABLE
      3        ONLINE  OFFLINE                               STABLE
--------------------------------------------------------------------------------


Still

ASMCMD> volcreate -G OGG -s 19G acfs_vol
ORA-15032: not all alterations performed
ORA-15477: cannot communicate with the volume driver (DBD ERROR: OCIStmtExecute)

How To Install/Reinstall Or Deinstall ACFS Modules/Installation Manually? (Doc ID 1371067.1)	

[oracle@ccg15xxdb142 dbs]$ lsmod | grep oracle


[root@ccg15xxdb141 bin]# ls -ltr acfsroot
-rwxr-xr-x 1 root dba 945 Jun 20  2016 acfsroot
[root@ccg15xxdb141 bin]# ./acfsroot install
ACFS-9459: ADVM/ACFS is not supported on this OS version: '5.4.17-2102.201.3.el7uek.x86_64'

[root@ccg15xxdb141 bin]# ./acfsdriverstate supported -v
ACFS-9459: ADVM/ACFS is not supported on this OS version: '5.4.17-2102.201.3.el7uek.x86_64'
ACFS-9201: Not Supported
ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf

ACFS-9553: Operating System: linux
ACFS-9554: Machine Architecture: x86_64-linux-thread-multi
ACFS-9555: Operating system name and information: Linux ccg15xxdb141 5.4.17-2102.201.3.el7uek.x86_64 #2 SMP Fri Apr 23 09:05:55 PDT 2021 x86_64 x86_64 x86_64 GNU/Linux
ACFS-9556: Release package: oraclelinux-release-7.9-1.0.9.el7.x86_64
ACFS-9557: Version: ADVM/ACFS is not supported on 5.4.17-2102.201.3.el7uek.x86_64
ACFS-9558: Variable _ORA_USM_NOT_SUPPORTED is defined: no

DISCLAIMER:
The determination of whether the current system configuration is supported
or not is based on the list of approved kernels and OS versions at the time
of shipment of the base code, together with any installed patches. At times,
specific kernel or OS versions may be unsupported due to known issues or OS
bugs.
For the latest information and notes on ACFS, including the most up to date
support information with patches and PSU information, consult MOS note
(Doc ID 1369107.1): ACFS Support On OS Platforms (Certification Matrix).


ACFS and AFD Support On OS Platforms (Certification Matrix). (Doc ID 1369107.1)	

https://oraontap.blogspot.com/2020/06/oracle-acfs-asm-filter-driver-and.html

Try to apply patch 29963428

[root@ccg15xxdb141 bin]# /x/home/grid/19.0.0.0/OPatch/opatchauto apply /home/oracle/29963428
[root@ccg15xxdb142 bin]# /x/home/grid/19.0.0.0/OPatch/opatchauto apply /home/oracle/29963428

after applying Patch for Bug# 29963428 for Linux-x86-64 platform

[root@ccg15xxdb141 bin]# pwd
/x/home/grid/19.0.0.0/bin
[root@ccg15xxdb141 bin]# ./acfsroot install
ACFS-9459: ADVM/ACFS is not supported on this OS version: '5.4.17-2102.201.3.el7uek.x86_64'
 
Oracle Database 19c Proactive Patch Information (Doc ID 2521164.1)
Patch 35642822: GI RELEASE UPDATE 19.21.0.0.0


[root@ccg15xxdb141 x86_64]# /x/home/grid/19.0.0.0/OPatch/opatchauto apply /home/oracle/35642822 -analyze;

OPatchauto session is initiated at Fri Dec 29 19:05:05 2023

System initialization log file is /x/home/grid/19.0.0.0/cfgtoollogs/opatchautodb/systemconfig2023-12-29_07-05-11PM.log.

Session log file is /x/home/grid/19.0.0.0/cfgtoollogs/opatchauto/opatchauto2023-12-29_07-05-30PM.log
The id for this session is FKZ1
OPATCHAUTO-72043: Patch collection failed.
OPATCHAUTO-72043: Failed to create bundle patch object.
OPATCHAUTO-72043: Please verify the patch supplied.
OPatchAuto failed.

OPatchauto session completed at Fri Dec 29 19:05:42 2023
Time taken to complete the session 0 minute, 32 seconds

 opatchauto failed with error code 42


Upgrade opatch 


cd /x/home/grid/19.0.0.0
chown -R oracle:dba OPatch

make db is up and running

[root@ccg15xxdb141 19.0.0.0]# /x/home/grid/19.0.0.0/OPatch/opatchauto apply /home/oracle/35642822
[root@ccg15xxdb142 19.0.0.0]# /x/home/grid/19.0.0.0/OPatch/opatchauto apply /home/oracle/35642822

after applying Patch 35642822

[root@ccg15xxdb141 19.0.0.0]# pwd
/x/home/grid/19.0.0.0
[root@ccg15xxdb141 bin]#  ./acfsroot install
ACFS-9544: Invalid files or directories found: 'missing[], extra[4.1.12]'
ACFS-9300: ADVM/ACFS distribution files found.
ACFS-9314: Removing previous ADVM/ACFS installation.
ACFS-9315: Previous ADVM/ACFS components successfully removed.
ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf
ACFS-9307: Installing requested ADVM/ACFS software.
ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9321: Creating udev for ADVM/ACFS.
ACFS-9323: Creating module dependencies - this may take some time.
ACFS-9154: Loading 'oracleoks.ko' driver.
ACFS-9154: Loading 'oracleadvm.ko' driver.
ACFS-9154: Loading 'oracleacfs.ko' driver.
ACFS-9327: Verifying ADVM/ACFS devices.
ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
ACFS-9156: Detecting control device '/dev/ofsctl'.
ACFS-9309: ADVM/ACFS installation correctness verified.

[root@ccg15xxdb141 bin]#  lsmod | grep oracle
oracleacfs           5210112  0
oracleadvm            729088  0
oracleoks             757760  2 oracleadvm,oracleacfs

[root@ccg15xxdb142 19.0.0.0]# lsmod | grep oracle
oracleacfs           5210112  0
oracleadvm            729088  0
oracleoks             757760  2 oracleadvm,oracleacfs

[root@ccg15xxdb141 bin]# ./acfsload start
ACFS-9391: Checking for existing ADVM/ACFS installation.
ACFS-9392: Validating ADVM/ACFS installation files for operating system.
ACFS-9393: Verifying ASM Administrator setup.
ACFS-9308: Loading installed ADVM/ACFS drivers.
ACFS-9325:     Driver OS kernel version = 5.4.17-2011.0.7.el7uek.x86_64.
ACFS-9326:     Driver build number = 230925.
ACFS-9231:     Driver build version = 19.0.0.0.0 (19.21.0.0.0).
ACFS-9547:     Driver available build number = 230925.
ACFS-9232:     Driver available build version = 19.0.0.0.0 (19.21.0.0.0).
ACFS-9549:     Kernel and command versions.
Kernel:
    Build version: 19.0.0.0.0
    Build full version: 19.21.0.0.0
    Build hash:    9256567290
    Bug numbers:   NoTransactionInformation
Commands:
    Build version: 19.0.0.0.0
    Build full version: 19.21.0.0.0
    Build hash:    9256567290
    Bug numbers:   NoTransactionInformation
ACFS-9327: Verifying ADVM/ACFS devices.
ACFS-9156: Detecting control device '/dev/asm/.asm_ctl_spec'.
ACFS-9156: Detecting control device '/dev/ofsctl'.
ACFS-9294: updating file /etc/sysconfig/oracledrivers.conf
ACFS-9322: completed


[root@ccg15xxdb141 bin]# lsmod | grep oracle
oracleacfs           5210112  0
oracleadvm            729088  0
oracleoks             757760  2 oracleadvm,oracleacfs


[oracle@ccg15xxdb141 ~]$ asmcmd
ASMCMD> volcreate -G OGG -s 19G acfs_vol
ASMCMD> volinfo --all
Diskgroup Name: OGG

	 Volume Name: ACFS_VOL
	 Volume Device: /dev/asm/acfs_vol-130
	 State: ENABLED
	 Size (MB): 19456
	 Resize Unit (MB): 64
	 Redundancy: UNPROT
	 Stripe Columns: 8
	 Stripe Width (K): 1024
	 Usage:
	 Mountpath:

[oracle@ccg15xxdb141 ~]$ /sbin/mkfs -t acfs /dev/asm/acfs_vol-130
mkfs.acfs: version                   = 19.0.0.0.0
mkfs.acfs: on-disk version           = 46.0
mkfs.acfs: volume                    = /dev/asm/acfs_vol-130
mkfs.acfs: volume size               = 20401094656  (  19.00 GB )
mkfs.acfs: Format complete.


[root@ccg15xxdb141 ~]# mkdir /goldengate
[root@ccg15xxdb141 ~]# chown oracle:dba /goldengate/
[root@ccg15xxdb141 ~]# /bin/mount -t acfs /dev/asm/acfs_vol-130 /goldengate/

[root@ccg15xxdb141 ~]# df -h /goldengate
Filesystem             Size  Used Avail Use% Mounted on
/dev/asm/acfs_vol-130   19G  348M   19G   2% /goldengate
[root@ccg15xxdb141 ~]# su - oracle
Last login: Sat Dec 30 08:48:07 CST 2023
[oracle@ccg15xxdb141 ~]$ touch /goldengate/aaa
touch: cannot touch /goldengate/aaa: Permission denied
[oracle@ccg15xxdb141 ~]$ ls -ltrd /goldengate/
drwxr-xr-x 4 root root 32768 Dec 30 09:11 /goldengate/
[oracle@ccg15xxdb141 ~]$ cd /goldengate/
[oracle@ccg15xxdb141 goldengate]$ touch a
touch: cannot touch a: Permission denied

[root@ccg15xxdb141 ~]# chown oracle:dba /goldengate/
[root@ccg15xxdb141 ~]# ls -ltr /goldengate
total 64
drwx------ 2 root root 65536 Dec 30 09:11 lost+found
[root@ccg15xxdb141 ~]# ls -ltrd /goldengate
drwxr-xr-x 4 oracle dba 32768 Dec 30 09:11 /goldengate

[root@ccg15xxdb141 ~]# su - oracle
Last login: Sat Dec 30 09:12:20 CST 2023 on pts/0
[oracle@ccg15xxdb141 ~]$ cd /goldengate/
[oracle@ccg15xxdb141 goldengate]$ touch a
[oracle@ccg15xxdb141 goldengate]$

ASMCMD> volinfo --all
Diskgroup Name: OGG

	 Volume Name: ACFS_VOL
	 Volume Device: /dev/asm/acfs_vol-130
	 State: ENABLED
	 Size (MB): 19456
	 Resize Unit (MB): 64
	 Redundancy: UNPROT
	 Stripe Columns: 8
	 Stripe Width (K): 1024
	 Usage: ACFS
	 Mountpath: /goldengate

[root@ccg15xxdb142 bin]# mkdir /goldengate
[root@ccg15xxdb142 bin]# chown oracle:dba /goldengate/
[root@ccg15xxdb142 bin]#  /bin/mount -t acfs /dev/asm/acfs_vol-130 /goldengate/
[root@ccg15xxdb142 bin]# ls -ltrd /goldengate
drwxr-xr-x 4 oracle dba 32768 Dec 30 09:14 /goldengate

[root@ccg15xxdb142 bin]# ./srvctl add filesystem -d /dev/asm/acfs_vol-130 -v ACFS_VOL -m /goldengate -u oracle -g OGG
[root@ccg15xxdb142 bin]# ./srvctl config filesystem
Volume device: /dev/asm/acfs_vol-130
Diskgroup name: ogg
Volume name: acfs_vol
Canonical volume device: /dev/asm/acfs_vol-130
Accelerator volume devices:
Mountpoint path: /goldengate
Mount point owner: oracle
Mount point group: dba
Mount permissions: owner:oracle:rwx,pgrp:dba:r-x,other::r-x
Mount users:
Type: ACFS
Mount options:
Description:
ACFS file system is enabled
ACFS file system is individually enabled on nodes:
ACFS file system is individually disabled on nodes:

[root@ccg15xxdb141 bin]# ./srvctl status filesystem
ACFS file system /goldengate is mounted on nodes ccg15xxdb141,ccg15xxdb142

[root@ccg15xxdb142 bin]# ./crsctl status res -t |grep gg
ora.ogg.acfs_vol.acfs

[root@ccg15xxdb142 bin]# ./crsctl status res ora.ogg.acfs_vol.acfs
NAME=ora.ogg.acfs_vol.acfs
TYPE=ora.acfs.type
TARGET=OFFLINE, OFFLINE
STATE=OFFLINE, OFFLINE

[root@ccg15xxdb142 bin]# ./crsctl status res ora.ogg.acfs_vol.acfs -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               OFFLINE OFFLINE      ccg15xxdb141             STABLE
               OFFLINE OFFLINE      ccg15xxdb142             STABLE
--------------------------------------------------------------------------------

[root@ccg15xxdb142 bin]# ./crsctl start res ora.ogg.acfs_vol.acfs
CRS-4995:  The command 'Start  resource' is invalid in crsctl. Use srvctl for this command.
[root@ccg15xxdb142 bin]# ./crsctl start res ora.ogg.acfs_vol.acfs -unsupported
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142'
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
There are files under the mount path '/goldengate'. Stop the filesystem in order to backup the files.
There are files under the mount path '/goldengate'. Stop the filesystem in order to backup the files.
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142' succeeded
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded

[root@ccg15xxdb142 bin]# ./crsctl status res ora.ogg.acfs_vol.acfs -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               ONLINE  ONLINE       ccg15xxdb142             mounted on /goldenga
                                                             te,STABLE
--------------------------------------------------------------------------------




[oracle@ccg15xxdb142 trace]$ crsctl status resource -p -attr NAME,USR_ORA_SUBNET -w "TYPE = ora.network.type"
NAME=ora.net1.network
USR_ORA_SUBNET=10.0.0.0

USR_ORA_SUBNET=10.0.0.0


-- create application vip 
[root@ccg15xxdb141 bin]# ./appvipcfg create -network=1 -ip=10.0.0.146 -vipname=xag.ggs_vip.vip -user=oracle
Using configuration parameter file: /x/home/grid/19.0.0.0/crs/install/crsconfig_params
The log of current session can be found at:
  /x/home/oracle/swbase/crsdata/ccg15xxdb141/scripts/appvipcfg.log
  
[root@ccg15xxdb141 bin]# ./crsctl status res xag.ggs_vip.vip
NAME=xag.ggs_vip.vip
TYPE=app.appviptypex2.type
TARGET=OFFLINE
STATE=OFFLINE

-- xag(Oracle Grid Infrastructure Agents), use above app vip for goldengate

[oracle@ccg15xxdb141 ~]$ which agctl
/x/home/grid/19.0.0.0/bin/agctl

[root@ccg15xxdb141 bin]# ./agctl add goldengate ggs_app \
> --gg_home /goldengate/191 \
> --instance_type source \
> --nodes ccg15xxdb141,ccg15xxdb142 \
> --vip_name xag.ggs_vip.vip \
> --filesystems ora.ogg.acfs_vol.acfs \
> --oracle_home /x/home/oracle/product/19.0.0.0 \
> --user oracle

[root@ccg15xxdb141 bin]# ./agctl config goldengate ggs_app
Instance name: ggs_app
Application GoldenGate location is: /goldengate/191
Goldengate MicroServices Architecture environment: no
GoldenGate instance type is: source
EXTRACT groups to monitor:
REPLICAT groups to monitor:
Critical EXTRACT groups:
Critical REPLICAT groups:
Autostart on DataGuard role transition to PRIMARY: no
Autostart JAgent: no
Configured to run on Nodes: ccg15xxdb141 ccg15xxdb142
ORACLE_HOME location is: /x/home/oracle/product/19.0.0.0
File System resources needed: ora.ogg.acfs_vol.acfs
VIP name: xag.ggs_vip.vip
XAG_HOME location is: %CRS_HOME%/


[root@ccg15xxdb141 bin]# ./crsctl setperm resource xag.ggs_app.goldengate -o "oracle"
[root@ccg15xxdb141 bin]# ./crsctl setperm resource xag.ggs_app.goldengate -g "dba"

[root@ccg15xxdb141 bin]# ./crsctl status res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       ccg15xxdb141             STABLE
               ONLINE  ONLINE       ccg15xxdb142             STABLE
ora.OGG.ACFS_VOL.advm
               ONLINE  ONLINE       ccg15xxdb141             STABLE
               ONLINE  ONLINE       ccg15xxdb142             STABLE
ora.chad
               ONLINE  ONLINE       ccg15xxdb141             STABLE
               ONLINE  ONLINE       ccg15xxdb142             STABLE
ora.net1.network
               ONLINE  ONLINE       ccg15xxdb141             STABLE
               ONLINE  ONLINE       ccg15xxdb142             STABLE
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               ONLINE  ONLINE       ccg15xxdb142             mounted on /goldenga
                                                             te,STABLE
ora.ons
               ONLINE  ONLINE       ccg15xxdb141             STABLE
               ONLINE  ONLINE       ccg15xxdb142             STABLE
ora.proxy_advm
               ONLINE  ONLINE       ccg15xxdb141             STABLE
               ONLINE  ONLINE       ccg15xxdb142             STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             STABLE
      3        ONLINE  OFFLINE                               STABLE
ora.DATA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.FRA.dg(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
ora.OGG.dg(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asm(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             Started,STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             Started,STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.asmnet1.asmnetwork(ora.asmgroup)
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             STABLE
      3        OFFLINE OFFLINE                               STABLE
ora.ccg15xxdb141.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
ora.ccg15xxdb142.vip
      1        ONLINE  ONLINE       ccg15xxdb142             STABLE
ora.cvu
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
ora.orcl19c.db
      1        ONLINE  ONLINE       ccg15xxdb141             Open,HOME=/x/home/or
                                                             acle/product/19.0.0.
                                                             0,STABLE
      2        ONLINE  ONLINE       ccg15xxdb142             Open,HOME=/x/home/or
                                                             acle/product/19.0.0.
                                                             0,STABLE
ora.qosmserver
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        OFFLINE OFFLINE                               STABLE
--------------------------------------------------------------------------------

[root@ccg15xxdb141 bin]# ./crsctl status resource ora.ogg.acfs_vol.acfs
NAME=ora.ogg.acfs_vol.acfs
TYPE=ora.acfs.type
TARGET=ONLINE                , ONLINE
STATE=ONLINE on ccg15xxdb141, ONLINE on ccg15xxdb142

[root@ccg15xxdb141 bin]# ./crsctl stop resource ora.ogg.acfs_vol.acfs -unsupported
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142' succeeded
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded

[root@ccg15xxdb141 bin]# ./crsctl status resource xag.ggs_vip.vip
NAME=xag.ggs_vip.vip
TYPE=app.appviptypex2.type
TARGET=OFFLINE
STATE=OFFLINE


-- under root  

./crsctl modify resource xag.ggs_app.goldengate -attr "START_DEPENDENCIES='hard(ora.ogg.acfs_vol.acfs)'" -unsupported
./crsctl modify resource xag.ggs_app.goldengate -attr "STOP_DEPENDENCIES='hard(ora.ogg.acfs_vol.acfs)'" -unsupported

./crsctl modify resource ora.ogg.acfs_vol.acfs -attr "START_DEPENDENCIES='hard(ora.OGG.dg,xag.ggs_vip.vip)'" -unsupported
./crsctl modify resource ora.ogg.acfs_vol.acfs -attr "STOP_DEPENDENCIES='hard(intermediate:ora.OGG.dg,xag.ggs_vip.vip)'" -unsupported
./crsctl modify resource ora.ogg.acfs_vol.acfs -attr "STOP_TIMEOUT=30" -unsupported

./crsctl modify resource xag.ggs_vip.vip -attr "HOSTING_MEMBERS=ccg15xxdb141 ccg15xxdb142" -unsupported

[root@ccg15xxdb141 bin]# ./crsctl start resource xag.ggs_app.goldengate -n ccg15xxdb141
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
open3: exec of /goldengate/191/ggsci failed: No such file or directory at /x/home/grid/19.0.0.0/xag/aggoldengateas.pm line 1090.
CRS-2674: Start of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' failed
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
CRS-34913: Restored the state of resource group 'ora.asmgroup' on server 'ccg15xxdb141'
CRS-2673: Attempting to stop 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
CRS-4000: Command Start failed, or completed with errors.

need install ogg

GUI:
cd /home/oracle/fbo_ggs_Linux_x64_shiphome/Disk1
./runInstaller

cannot install because of no ogg directory

[root@ccg15xxdb141 bin]# ./crsctl status res ora.ogg.acfs_vol.acfs -p -attr "START_DEPENDENCIES"
NAME=ora.ogg.acfs_vol.acfs
START_DEPENDENCIES=hard(ora.OGG.dg,xag.ggs_vip.vip)

./crsctl modify res ora.ogg.acfs_vol.acfs -attr "START_DEPENDENCIES=''" -unsupported

[root@ccg15xxdb141 bin]# ./crsctl start  resource ora.ogg.acfs_vol.acfs -unsupported
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142' succeeded

install ogg again, all good

then
./crsctl modify resource ora.ogg.acfs_vol.acfs -attr "START_DEPENDENCIES='hard(ora.OGG.dg,xag.ggs_vip.vip)'" -unsupported


[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_app.goldengate -p
NAME=xag.ggs_app.goldengate
TYPE=xag.goldengate.type
ACL=owner:oracle:rwx,pgrp:dba:rwx,other::r--
ACTIONS=
ACTION_SCRIPT=%CRS_HOME%/bin/aggoldengateas
ACTION_TIMEOUT=60
ACTIVE_PLACEMENT=0
AGENT_FILENAME=%CRS_HOME%/bin/scriptagent
AUTO_START=never
CARDINALITY=1
CHECK_INTERVAL=30
CHECK_TIMEOUT=0
CLEAN_TIMEOUT=60
CRITICAL_EXTRACTS=
CRITICAL_REPLICATS=
CRS_ATTRIBUTES=
CSS_CRITICAL=no
DATABASES=
DATAGUARD_AUTOSTART=no
DB_SERVICES=
DELETE_TIMEOUT=60
DESCRIPTION="Oracle GoldenGate Clusterware Resource"
ENABLED=1
ENVIRONMENT_VARS=
FAILOVER_DELAY=0
FAILURE_INTERVAL=600
FAILURE_THRESHOLD=5
FILESYSTEMS=ora.ogg.acfs_vol.acfs
FILESYSTEMS_ALWAYS=
GG_HOME=/goldengate/191
GG_INSTANCE_TYPE=source
HOSTING_MEMBERS=ccg15xxdb141 ccg15xxdb142
IGNORE_TARGET_ON_FAILURE=no
INSTANCE_FAILOVER=1
INTERMEDIATE_TIMEOUT=0
JAGENT_AUTOSTART=no
LOAD=1
LOGGING_LEVEL=1
MODIFY_TIMEOUT=60
MONITOR_EXTRACTS=
MONITOR_REPLICATS=
OFFLINE_CHECK_INTERVAL=0
ORACLE_CLIENT_HOME=
ORACLE_HOME=/x/home/oracle/product/19.0.0.0
PLACEMENT=restricted
RELOCATE_BY_DEPENDENCY=1
RELOCATE_KIND=offline
RESOURCE_GROUP=
RESTART_ATTEMPTS=5
RESTART_DELAY=0
SCRIPT_TIMEOUT=60
SERVER_CATEGORY=
SERVER_POOLS=
START_CONCURRENCY=0
START_DEPENDENCIES=hard(ora.ogg.acfs_vol.acfs)
START_TIMEOUT=300
STOP_CONCURRENCY=0
STOP_DEPENDENCIES=hard(ora.ogg.acfs_vol.acfs)
STOP_TIMEOUT=300
TARGET_DEFAULT=default
UPTIME_THRESHOLD=10m
USER_WORKLOAD=no
USE_LOCAL_SERVICES=0
USE_STICKINESS=0
VERSION=2
VIP_CREATED=0
VIP_NAME=xag.ggs_vip.vip
WORKLOAD_CPU=0
WORKLOAD_CPU_CAP=0
WORKLOAD_MEMORY_MAX=0
WORKLOAD_MEMORY_TARGET=0



[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               OFFLINE OFFLINE      ccg15xxdb141             admin unmounted /gol
                                                             dengate,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        OFFLINE OFFLINE                               STABLE
--------------------------------------------------------------------------------


[oracle@ccg15xxdb141 ~]$ crsctl start res xag.ggs_app.goldengate
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded
[oracle@ccg15xxdb141 ~]$
[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------


[oracle@ccg15xxdb141 ~]$ ps -ef|grep mgr
postfix   1700  1695  0 Jan01 ?        00:00:00 qmgr -l -t unix -u
oracle   18168     1  0 13:25 ?        00:00:00 ./mgr PARAMFILE /goldengate/191/dirprm/mgr.prm REPORTFILE /goldengate/191/dirrpt/MGR.rpt PROCESSID MGR
oracle   18446 22683  0 13:25 pts/1    00:00:00 grep --color=auto mgr


-- some tests

[oracle@ccg15xxdb141 ~]$ crsctl stop res xag.ggs_app.goldengate
CRS-2673: Attempting to stop 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------


ora.ogg.acfs_vol.acfs and xag.ggs_vip.vip are still ONLINE.

only mgr is down

[oracle@ccg15xxdb141 ~]$ ps -ef|grep mgr
postfix   1700  1695  0 Jan01 ?        00:00:00 qmgr -l -t unix -u
oracle   20351 22683  0 13:28 pts/1    00:00:00 grep --color=auto mgr
[oracle@ccg15xxdb141 ~]$ df -h /goldengate
Filesystem             Size  Used Avail Use% Mounted on
/dev/asm/acfs_vol-130   19G  1.4G   18G   8% /goldengate

try to stop xag.ggs_vip.vip:

[oracle@ccg15xxdb141 ~]$ crsctl stop res xag.ggs_vip.vip
CRS-2974: unable to act on resource 'xag.ggs_vip.vip' on server 'ccg15xxdb141' because that would require stopping or relocating resource 'ora.ogg.acfs_vol.acfs' but the appropriate force flag was not specified
CRS-4000: Command Stop failed, or completed with errors.

add force option:

[oracle@ccg15xxdb141 ~]$ crsctl stop res xag.ggs_vip.vip -f
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
CRS-2673: Attempting to stop 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded


[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               OFFLINE OFFLINE      ccg15xxdb141             volume /goldengate i
                                                             s unmounted,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        OFFLINE OFFLINE                               STABLE
--------------------------------------------------------------------------------


now try start ora.ogg.acfs_vol.acfs

[oracle@ccg15xxdb141 ~]$ crsctl start res ora.ogg.acfs_vol.acfs
CRS-4995:  The command 'Start  resource' is invalid in crsctl. Use srvctl for this command.
[oracle@ccg15xxdb141 ~]$ crsctl start res ora.ogg.acfs_vol.acfs -unsupported
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded

it will start ora.ogg.acfs_vol.acfs.


[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               ONLINE  OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------

and ora.ogg.acfs_vol.acfs on ccg15xxdb142, "Target" will become "ONLINE"


now stop ora.ogg.acfs_vol.acfs

[oracle@ccg15xxdb141 ~]$ crsctl stop res ora.ogg.acfs_vol.acfs
CRS-4995:  The command 'Stop  resource' is invalid in crsctl. Use srvctl for this command.

[oracle@ccg15xxdb141 ~]$ crsctl stop res ora.ogg.acfs_vol.acfs -unsupported
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               OFFLINE OFFLINE      ccg15xxdb141             volume /goldengate i
                                                             s unmounted,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------


ora.ogg.acfs_vol.acfs are all OFFLINE.


now stop xag.ggs_vip.vip:

[oracle@ccg15xxdb141 ~]$ crsctl stop res xag.ggs_vip.vip
CRS-2673: Attempting to stop 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               OFFLINE OFFLINE      ccg15xxdb141             admin unmounted /gol
                                                             dengate,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        OFFLINE OFFLINE                               STABLE
--------------------------------------------------------------------------------


now start xag.ggs_vip.vip

[oracle@ccg15xxdb141 ~]$ crsctl start res xag.ggs_vip.vip
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb142'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb142' succeeded

it will start on ccg15xxdb142.

[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip -p | egrep '(PLACEMENT|HOSTING_MEMBERS)'
ACTIVE_PLACEMENT=0
HOSTING_MEMBERS=ccg15xxdb141 ccg15xxdb142
PLACEMENT=balanced

[oracle@ccg15xxdb141 ~]$ crsctl stop res xag.ggs_vip.vip
CRS-2673: Attempting to stop 'xag.ggs_vip.vip' on 'ccg15xxdb142'
CRS-2677: Stop of 'xag.ggs_vip.vip' on 'ccg15xxdb142' succeeded


[oracle@ccg15xxdb141 ~]$ crsctl start res xag.ggs_vip.vip -n ccg15xxdb141
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded


[oracle@ccg15xxdb141 ~]$ crsctl start res ora.ogg.acfs_vol.acfs
CRS-4995:  The command 'Start  resource' is invalid in crsctl. Use srvctl for this command.
[oracle@ccg15xxdb141 ~]$ crsctl start res ora.ogg.acfs_vol.acfs -unsupported
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
[oracle@ccg15xxdb141 ~]$ df -h /goldengate/
Filesystem             Size  Used Avail Use% Mounted on
/dev/asm/acfs_vol-130   19G  1.4G   18G   8% /goldengate


[oracle@ccg15xxdb141 ~]$ crsctl start res xag.ggs_app.goldengate
CRS-2672: Attempting to start 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded
[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               ONLINE  OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------

again ora.ogg.acfs_vol.acfs on ccg15xxdb142, "Target" becomes "ONLINE"

 
[oracle@ccg15xxdb141 ~]$ crsctl stop res ora.ogg.acfs_vol.acfs
CRS-4995:  The command 'Stop  resource' is invalid in crsctl. Use srvctl for this command.
[oracle@ccg15xxdb141 ~]$ crsctl stop res ora.ogg.acfs_vol.acfs -unsupported
CRS-2974: unable to act on resource 'ora.ogg.acfs_vol.acfs' on server 'ccg15xxdb141' because that would require stopping or relocating resource 'xag.ggs_app.goldengate' but the appropriate force flag was not specified
CRS-4000: Command Stop failed, or completed with errors.
[oracle@ccg15xxdb141 ~]$
[oracle@ccg15xxdb141 ~]$ crsctl stop res ora.ogg.acfs_vol.acfs -unsupported -f
CRS-2673: Attempting to stop 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
[oracle@ccg15xxdb141 ~]$
[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               OFFLINE OFFLINE      ccg15xxdb141             volume /goldengate i
                                                             s unmounted,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------

here start ora.ogg.acfs_vol.acfs on ccg15xxdb141 only:

[oracle@ccg15xxdb141 ~]$ crsctl start res ora.ogg.acfs_vol.acfs -n ccg15xxdb141 -unsupported
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded


[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        OFFLINE OFFLINE                               STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------

[oracle@ccg15xxdb141 ~]$ crsctl start res xag.ggs_app.goldengate
CRS-2672: Attempting to start 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------



test relocate ggs vip

[oracle@ccg15xxdb141 ~]$ crsctl relocate res xag.ggs_vip.vip -n ccg15xxdb142
CRS-2974: unable to act on resource 'xag.ggs_vip.vip' on server 'ccg15xxdb141' because that would require stopping or relocating resource 'ora.ogg.acfs_vol.acfs' but the appropriate force flag was not specified
CRS-4000: Command Relocate failed, or completed with errors.
[oracle@ccg15xxdb141 ~]$ crsctl relocate res xag.ggs_vip.vip -n ccg15xxdb142 -f
CRS-2673: Attempting to stop 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
CRS-2673: Attempting to stop 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb142'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb142' succeeded


[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  OFFLINE      ccg15xxdb141             volume /goldengate i
                                                             s unmounted,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        ONLINE  OFFLINE                               STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb142             STABLE
--------------------------------------------------------------------------------

ora.ogg.acfs_vol.acfs and xag.ggs_app.goldengate are offline State.

make it online manually

[oracle@ccg15xxdb141 ~]$ crsctl start res ora.ogg.acfs_vol.acfs -unsupported -n ccg15xxdb141
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl start res xag.ggs_app.goldengate
CRS-2672: Attempting to start 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2676: Start of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  ONLINE       ccg15xxdb141             mounted on /goldenga
                                                             te,STABLE
               OFFLINE OFFLINE      ccg15xxdb142             volume /goldengate o
                                                             ffline,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb141             STABLE
--------------------------------------------------------------------------------


try below:

[oracle@ccg15xxdb141 ~]$ crsctl relocate res xag.ggs_app.goldengate -n ccg15xxdb142
CRS-2527: Unable to start 'xag.ggs_app.goldengate' because it has a 'hard' dependency on 'ora.ogg.acfs_vol.acfs'
CRS-0222: Resource 'ora.ogg.acfs_vol.acfs' has dependency error.
CRS-2527: Unable to start 'ora.ogg.acfs_vol.acfs' because it has a 'hard' dependency on 'xag.ggs_vip.vip'
CRS-2525: All instances of the resource 'xag.ggs_vip.vip' are already running; relocate is not allowed because the force option was not specified
CRS-4000: Command Relocate failed, or completed with errors.

[oracle@ccg15xxdb141 ~]$ crsctl relocate res xag.ggs_app.goldengate -n ccg15xxdb142 -f
CRS-2673: Attempting to stop 'xag.ggs_app.goldengate' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_app.goldengate' on 'ccg15xxdb141' succeeded
CRS-2673: Attempting to stop 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141'
CRS-2677: Stop of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb141' succeeded
CRS-2673: Attempting to stop 'xag.ggs_vip.vip' on 'ccg15xxdb141'
CRS-2677: Stop of 'xag.ggs_vip.vip' on 'ccg15xxdb141' succeeded
CRS-2672: Attempting to start 'xag.ggs_vip.vip' on 'ccg15xxdb142'
CRS-2676: Start of 'xag.ggs_vip.vip' on 'ccg15xxdb142' succeeded
CRS-2672: Attempting to start 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142'
CRS-2676: Start of 'ora.ogg.acfs_vol.acfs' on 'ccg15xxdb142' succeeded
CRS-2672: Attempting to start 'xag.ggs_app.goldengate' on 'ccg15xxdb142'
CRS-2676: Start of 'xag.ggs_app.goldengate' on 'ccg15xxdb142' succeeded

[oracle@ccg15xxdb141 ~]$ crsctl status res xag.ggs_vip.vip ora.ogg.acfs_vol.acfs xag.ggs_app.goldengate -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ogg.acfs_vol.acfs
               ONLINE  OFFLINE      ccg15xxdb141             admin unmounted /gol
                                                             dengate,STABLE
               ONLINE  ONLINE       ccg15xxdb142             mounted on /goldenga
                                                             te,STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
xag.ggs_app.goldengate
      1        ONLINE  ONLINE       ccg15xxdb142             STABLE
xag.ggs_vip.vip
      1        ONLINE  ONLINE       ccg15xxdb142             STABLE
--------------------------------------------------------------------------------
Oracle