2
Concepts, Architecture, Deployment, Management and performance monitoring
Guenadi N. Jilevski: OCP 7,8,8i,9i,10g 11g OCM 9i
ACFS is General Purpose Cluster Multi OS file system integrated with Grid Infrastructure. (Linux,Windows, AIX, Solaris in Oracle 11.2 and Oracle 11.2.0.2) ACFS can be dynamically re-sized online. ACFS can be managed with ASMCA, ASMCMD, OEM, sqlplus, Linux/UNIX command line. ACFS is extend based. ACFS in build on top of ASM.
Oracle Database
Supported OS
ASM ASM files Disk group (storage for files and volumes)
ASM contains files ASM files are striped not disk volumes in case of LVM ASM mirrors extends based on redundancy level Online disk reconfiguration and rebalancing For fast mirror resynch tracks the changed extends. On extended clusters read from a preferred mirror extent that is local Cluster aware Part of Grid Infrastructure
ASM volumes are ALSO ASM files. Exposed to the OS via ADVM by /dev/asm/<Volumenumber>-<number>. Created once a volume is created. Inherit properties of disk group and behaves like ASM file. Rebalanced with add/remove disk to disk group. ADVM represents the ASM volume to OS. Behaves like any block devices.
VDBG Volume Driver Background forwards ASM requests to the dynamic volume manager driver. Death of VBDG kills ASM instance. VBGn Volume Background processes wait for requests from dynamic volume manager driver that need to be coordinated with ASM instance. Death of VBGn does NOT kill ASM instance. VMB Volume Membership Background coordinates cluster membership with ASM instance. Death of VMB does NOT kill ASM instance.
ADVM volumes can not be used as boot devices or root file system. ADVM volumes can not be used for RAW devices. ADVM volumes can not be used with ASMlib ADVM volumes can not be partitioned with fdisk. ADVM volumes are not to be used for Oracle Grid Infrastructure installation.
Example: if stripe is 4 and AU is 1MB than VAU=4X64=256MB. Space is allocated in multiples of VAU. For a requested volume of 300MB a volume of 512MB consisting of 2 VAU will be created. In case of re-size space will be added in multiple of 256MB (VAU).
Volume is created with Stripe column number of stripes. Default 4. From 1 to 8. If 1 no striping. Stripe width size of each stripe. Default 128K. Range from 4K, 8K,16K,32K,64K, 128K, 256K, 512K,1M. Space for the volume is allocated as explained in VAU from ASM disk group. Space within the volume, when a file is created/resized on the ACFS, is allocated in chunks: size of VAU the size of the strip width round-robin across all of the VE in the VAU.
Prerequisites:
compatible.asm>=11.2 compatible.advm>=11.2, compatible.asm>=compatible.advm Load ADVM drivers $GI_HOME/bin/acfsload start s as root on Oracle Restart only. For clustered Oracle GI in ASM RAC is automatically loaded.
Create the ASM volume Create the mount point Make the file system as root Mount the file system as root Register the file system. For the file system to persists reboot register it similarly to /etc/fstab with acfsutil. Registering the File System automatically mounts the file system on restart/reboot. GI owner for /sbin/acfsutil.
Note:
ACFSUTIL registers and mounts the ACFS. After restart ACFS will be mounted. Similar to /etc/fstab functionality DB Home FS=GP FS + Register Mount Point
Register the file system using acfsutil a. It mounts the ACFS automatically.
Recovery as of the snapshot time Consistent backup of the files in the snapshot
SQL> select * from v$asm_filesystem; FS_NAME AVAILABLE BLOCK_SIZE STATE CORRU NUM_VOL TOTAL_SIZE TOTAL_FREE TOTAL_SNAP_SPACE_USAGE -------------------- --------- ---------- ------------- ----- ---------- ---------- ---------- --------------------/u03 11-JUL-11 4 AVAILABLE FALSE 1 10240 9008.67969 0 /u04 11-JUL-11 4 AVAILABLE TRUE 1 10240 10091.6523 .046875 /u06 11-JUL-11 4 AVAILABLE TRUE 1 29696 29476.8047 0 SQL>
Oracle 11gR2 ACFS Replication New feature in 11.2.0.2 Designate a primary ACFS and DR standby ACFS asynchronously replicating changes across the network using Oracle Net. Capture changes into a log change file on the primary ACFS. Transfer the changes to similar log change file to the DR ACFS. After application on the DR ACFS changes are purged. Size properly ACFS to accommodate changes. Make sure that the network have sufficient bandwidth. Refer to the docs how to gather sizing statistics.
Prerequisites
Create a user on ASM with sysasm and sysdba privileges (oracle in the example) Create a service for the primary site (prim) and secondary site(sec). +ASMn will not work. Initiate the standby ACFS [root@raclinux1 bin]# /sbin/acfsutil repl init standby -p oracle/oracle@prim -c sec /u06
Where prim is the service created in bullet two and oracle is the user created in bullet one. Note that before starting the initiation the standby and primary site you need to have the ACFS mounted on only one node ,that is, you need to dismount the both /u05 and /u06 on raclinux2 node.
4.
Initiate the primary ACFS while as root ( In case of failure re-Initiate the standby)
[root@raclinux1 bin]# /sbin/acfsutil repl init primary -s oracle/oracle@sec -m /u06 -c prim /u05 validating the remote connection validating the remote connection validating the remote connection acfsutil repl init: ACFS-05050: remote connection cannot be established acfsutil repl init: ACFS-05052: standby replication site requires reinitialization [root@raclinux1 bin]# /sbin/acfsutil repl init standby -p oracle/oracle@prim -c sec /u06 [root@raclinux1 bin]# [root@raclinux1 bin]# /sbin/acfsutil repl init primary -s oracle/oracle@sec -m /u06 -c prim /u05 remote connection has been established Registering with user specified service name-prim waiting for the standby replication site to initialize waiting for the standby replication site to initialize The standby replication site is initialized. ACFS replication will begin. [root@raclinux1 bin]#
5.
Step 4 starts the processes for ACFS replication and we can use already the ACFS replication. The replication can be validated and configuration checked with the following commands.
Validation
[root@raclinux1 bin]# /sbin/acfsutil repl info -c -v /u06 Site: Standby Standby status: Online Standby mount point: /u06 Standby Oracle Net service name: sec Primary mount point: /u05 Primary Oracle Net service name: PRIM Primary Oracle Net alias: oracle/****@prim Replicated tags: Log compression: Off Debug log level: 0 [root@raclinux1 bin]# [root@raclinux1 bin]# /sbin/acfsutil repl bg info /u06 Resource: ora.repl.transport.sec.sec.acfs Target State: ONLINE Current State: ONLINE on raclinux1 Resource: ora.repl.main.sec.sec.acfs Target State: ONLINE Current State: ONLINE on raclinux1 Resource: ora.repl.apply.sec.sec.acfs Target State: ONLINE Current State: ONLINE on raclinux1 [root@raclinux1 bin]#
Managing Replication Check replication configuration & statistics # /sbin/acfsutil repl info -c -v /u06 # /sbin/acfsutil repl info -c -v /u05 # /sbin/acfsutil repl info -s -v /u05 Start & Stop replication : Although ACFS replication is automatically started after initiation and registered with Grid Infrastructure as a resource for automatic restart the acfsutil repl bg command can be used to start and stop the background processes and daemons implementing the replication. # /sbin/acfsutil repl bg stop /u06 # /sbin/acfsutil repl bg start /u06 Suspending and resuming ACFS replication. ACFS replication can be manually suspended and resumed. Prior to pausing the replication the sync must be executed. Pausing and resuming ACFS replication are done using the acfsutl repl [ pause | resume] /standby_fs command. Here we are going to suspend replication, resume replication create a file in the primary ACFS to synchronize with the standby ACFS file system.
Q &A