Contents

List of Examples

List of Figures

List of Tables

Title and Copyright Information

Preface

• Audience
• Documentation Accessibility
• Related Documents
• Conventions

1 Introduction to High Availability Best Practices

• 1.1 Oracle Database High Availability Architecture
• 1.2 Oracle Database High Availability Best Practices
• 1.3 Oracle Maximum Availability Architecture

2 Operational Prerequisites to Maximizing Availability

• 2.1 Understand Availability and Performance SLAs
• 2.2 Implement a High Availability Environment
• 2.3 Validate Your Performance and Availability SLAs
• 2.4 Set up and Use Security Best Practices
• 2.5 Establish Change Control Procedures
• 2.6 Provide a Plan to Test and Upgrade for Recommended Patches and Software
• 2.7 Use Proper Testing and Patching Practices
  • 2.7.1 Configuring the Test System and QA Environments
  • 2.7.2 Performing Pre-production Validation Steps
• 2.8 Execute Data Guard Role Transitions
• 2.9 Establish Escalation Management Procedures
• 2.10 Configure Monitoring and Service Request Infrastructure for High Availability
  • 2.10.1 Configure Monitoring Infrastructure for High Availability
  • 2.10.2 Configure Service Request Infrastructure
• 2.11 Check the Latest MAA Best Practices

3 Overview of Configuration Best Practices

4 Configuring Storage

• 4.1 Evaluate Database Performance and Storage Capacity Requirements
• 4.2 Use Automatic Storage Management (Oracle ASM) to Manage Database Files
  • 4.2.1 Use Clustered Oracle ASM to Enable the Storage Grid
  • 4.2.2 Use Oracle Restart for Oracle ASM Instances (non-clustered Oracle Database)
• 4.3 Oracle ASM Strategic Best Practices
  • 4.3.1 Use a Simple Disk and Disk Group Configuration
  • 4.3.2 Use Redundancy to Protect from Disk Failure
    • 4.3.2.1 Storage Array Based RAID
    • 4.3.2.2 Oracle ASM Redundancy
  • 4.3.3 Oracle ASM in the Grid Infrastructure Home
  • 4.3.4 Ensure Disks in the Same Disk Group Have the Same Characteristics
  • 4.3.5 Use Failure Groups When Using Oracle ASM Redundancy
  • 4.3.6 Use Intelligent Data Placement
  • 4.3.7 Use Oracle ACFS to Manage Files Outside the Database
• 4.4 Oracle ASM Configuration Best Practices
  • 4.4.1 Use Disk Multipathing Software to Protect from Path Failure
  • 4.4.2 Use Automatic Memory Management with MEMORY_TARGET Parameter
  • 4.4.3 Set the PROCESSES Initialization Parameter
  • 4.4.4 Use Disk Labels
  • 4.4.5 Set the DISK_REPAIR_TIME Disk Group Attribute Appropriately
  • 4.4.6 Use ASMLib On Supported Platforms
  • 4.4.7 Disable Variable Sized Extents
• 4.5 Oracle ASM Operational Best Practices
  • 4.5.1 Use SYSASM for Oracle ASM Authentication
  • 4.5.2 Set Rebalance to the Maximum Limit that Does Not Affect Service Levels
  • 4.5.3 Use a Single Command to Mount Multiple Disk Groups
  • 4.5.4 Use a Single Command to Add or Remove Storage
  • 4.5.5 Check Disk Groups for Imbalance
  • 4.5.6 Proactively Mine Vendor Logs for Disk Errors
  • 4.5.7 Use ASMCMD Utility to Ease Manageability of Oracle ASM
  • 4.5.8 Use Oracle ASM Configuration Assistant (ASMCA)
• 4.6 Use Oracle Storage Grid
  • 4.6.1 Oracle Storage Grid Best Practices for Unplanned Outages
  • 4.6.2 Oracle Storage Grid Best Practices for Planned Maintenance

5 Configuring Oracle Database

• 5.1 Database Configuration High Availability and Fast Recoverability Best Practices
  • 5.1.1 Set the Database ARCHIVELOG Mode and FORCE LOGGING Mode
  • 5.1.2 Configure the Size of Redo Log Files and Groups Appropriately
  • 5.1.3 Use a Fast Recovery Area
  • 5.1.4 Enable Flashback Database
  • 5.1.5 Set FAST START MTTR TARGET Initialization Parameter
  • 5.1.6 Protect Against Data Corruption
    • 5.1.6.1 Preventing Widespread Data Corruption
    • 5.1.6.2 Detecting and Monitoring Data Corruption
  • 5.1.7 Set DISK_ASYNCH_IO Initialization Parameter
  • 5.1.8 Set LOG_BUFFER Initialization Parameter to a Minimum 8 MB
  • 5.1.9 Use Automatic Shared Memory Management
  • 5.1.10 Disable Parallel Recovery for Instance Recovery
• 5.2 Recommendations to Improve Manageability
  • 5.2.1 Use Oracle Clusterware with Oracle RAC or Oracle Restart
  • 5.2.2 Use Data Recovery Adviser to Detect, Analyze and Repair Data Failures
  • 5.2.3 Use Automatic Performance Tuning Features
  • 5.2.4 Use a Server Parameter File
  • 5.2.5 Use Automatic Undo Management
  • 5.2.6 Use Locally Managed Tablespaces
  • 5.2.7 Use Automatic Segment Space Management
  • 5.2.8 Use Temporary Tablespaces and Specify a Default Temporary Tablespace
  • 5.2.9 Use Resumable Space Allocation
  • 5.2.10 Use Database Resource Manager

6 Configuring Oracle Database with Oracle Clusterware

• 6.1 About Oracle Clusterware Best Practices
  • 6.1.1 Client Configuration and Migration Concepts
    • 6.1.1.1 Services
    • 6.1.1.2 Fast Application Notification (FAN)
    • 6.1.1.3 Single Client Access Name (SCAN)
• 6.2 Oracle Clusterware Configuration Best Practices
  • 6.2.1 Use the Cluster Verification Utility (CVU)
  • 6.2.2 Use a Local Home for Oracle Database and Oracle Clusterware with Oracle ASM
  • 6.2.3 Ensure Services are Highly Available
  • 6.2.4 Client Configuration and FAN Best Practices
  • 6.2.5 Connect to Database Using Services and Single Client Access Name (SCAN)
  • 6.2.6 Use Client-Side and Server-Side Load Balancing
  • 6.2.7 Mirror Oracle Cluster Registry (OCR) and Configure Multiple Voting Disks with Oracle ASM
  • 6.2.8 Use Company Wide Cluster Time Management
  • 6.2.9 Verify That Oracle Clusterware, Oracle RAC, and Oracle ASM Use the Same Interconnect Network
  • 6.2.10 Use Redundant Interconnect with Highly Available IP (HAIP)
  • 6.2.11 Configure Failure Isolation with Intelligent Management Platform Interface (IPMI)
• 6.3 Oracle Clusterware Operational Best Practices
  • 6.3.1 Capacity Planning
  • 6.3.2 Regularly Back Up OCR to Tape or Offsite

7 Configuring Oracle Database with Oracle RAC

• 7.1 Configuring Oracle Database with Oracle RAC
  • 7.1.1 Optimize Instance Recovery Time
  • 7.1.2 Maximize the Number of Processes Performing Transaction Recovery
  • 7.1.3 Ensure Asynchronous I/O Is Enabled
  • 7.1.4 Redundant Dedicated Connection Between the Nodes
• 7.2 Configuring Oracle Database with Oracle RAC One Node
• 7.3 Configuring Oracle Database with Oracle RAC on Extended Clusters
  • 7.3.1 Spread the Workload Evenly Across the Sites in the Extended Cluster
  • 7.3.2 Add a Third Voting Disk to Host the Quorum Disk
  • 7.3.3 Configure the Nodes to Be Within the Proximity of a Metropolitan Area
  • 7.3.4 Use Host-Based Storage Mirroring with Oracle ASM Normal or High Redundancy
  • 7.3.5 Additional Deployment Considerations for Extended Clusters

8 Configuring Oracle Data Guard

• 8.1 Oracle Data Guard Configuration Best Practices
• 8.2 Determine Protection Mode and Data Guard Transport
  • 8.2.1 Use Redo Transport Services Best Practices
  • 8.2.2 Assess Performance with Proposed Network Configuration
• 8.3 General Data Guard Configuration Best Practices
  • 8.3.1 Use Oracle Data Guard Broker with Oracle Data Guard
  • 8.3.2 Use Recovery Manager to Create Standby Databases
  • 8.3.3 Use Flashback Database for Reinstatement After Failover
  • 8.3.4 Use FORCE LOGGING Mode
  • 8.3.5 Use a Simple, Robust Archiving Strategy and Configuration
  • 8.3.6 Use Standby Redo Logs and Configure Size Appropriately
  • 8.3.7 Use Data Guard Transport and Network Configuration Best Practices
    • 8.3.7.1 Set the LOG_ARCHIVE_MAX_PROCESSES Parameter
    • 8.3.7.2 Set the Network Configuration and Highest Network Redo Rates
  • 8.3.8 Use Data Guard Redo Apply Best Practices
    • 8.3.8.1 Maximize I/O Rates on Standby Redo Logs and Archived Redo Logs
    • 8.3.8.2 Assess Recovery Rate
    • 8.3.8.3 Use DB_BLOCK_CHECKING=OFF and Set DB_BLOCK_CHECKSUM=FULL
    • 8.3.8.4 Set DB_CACHE_SIZE to a Value Greater than on the Primary Database
    • 8.3.8.5 Assess Database Wait Events
    • 8.3.8.6 Tune I/O Operations
    • 8.3.8.7 Assess System Resources
  • 8.3.9 Implement Multiple Standby Databases
• 8.4 Oracle Data Guard Role Transition Best Practices
  • 8.4.1 Oracle Data Guard Switchovers Best Practices
  • 8.4.2 Oracle Data Guard Failovers Best Practices
    • 8.4.2.1 Comparing Fast-Start Failover and Manual Failover
    • 8.4.2.2 Failover Best Practices (Manual Failover and Fast-Start Failover)
    • 8.4.2.3 Fast-Start Failover Best Practices
    • 8.4.2.4 Manual Failover Best Practices
• 8.5 Use Oracle Active Data Guard Best Practices
• 8.6 Use Snapshot Standby Database Best Practices
• 8.7 Assessing Data Guard Performance

9 Configuring Backup and Recovery

• 9.1 Oracle Database Backup and Recovery Products and Features
  • 9.1.1 Understand When to Use Backups
  • 9.1.2 Use Recovery Manager (RMAN) to Backup Database Files
  • 9.1.3 Use Oracle Secure Backup for Backups to Tape
    • 9.1.3.1 Using Oracle Secure Backup for Backups to Amazon S3 Storage
  • 9.1.4 Use Restore Points for Creating Database Snapshots
• 9.2 Backup and Recovery Configuration and Administration Best Practices
  • 9.2.1 Determine a Backup Frequency and Retention Policy
  • 9.2.2 Use an RMAN Recovery Catalog
  • 9.2.3 Create Backups in NOCATALOG Mode and Then RESYNC CATALOG
  • 9.2.4 Enable Block Change Tracking for Incremental Backups
  • 9.2.5 Enable Autobackup for the Control File and Server Parameter File
  • 9.2.6 Offload Backups to a Physical Standby Database
  • 9.2.7 Set UNDO Retention for Flashback Query and Flashback Table Needs
• 9.3 Backup to Disk Best Practices
• 9.4 Backup to Tape Best Practices
  • 9.4.1 Initial RMAN Oracle Secure Backup Configuration
  • 9.4.2 Define Oracle Secure Backup Media Policies for Tape Backups
  • 9.4.3 Create Tape Backups from the Fast Recovery Area
  • 9.4.4 Managing Offsite Backup Tapes
• 9.5 Backup and Recovery Operations and Maintenance Best Practices
  • 9.5.1 Diagnose Data Failures and Present Repair Options
  • 9.5.2 Regularly Check Database Files for Corruption
  • 9.5.3 Periodically Test Recovery Procedures
  • 9.5.4 Backup the RMAN and Oracle Secure Backup Catalogs on a Regular Basis
  • 9.5.5 Use Procedures to Backup Files Outside the Database
• 9.6 Backup Files Outside the Database
  • 9.6.1 ACFS Snapshots
  • 9.6.2 Oracle Sun ZFS Storage Appliance Snapshots
  • 9.6.3 Tape Backups

10 Configuring Oracle GoldenGate

• 10.1 Oracle GoldenGate Overview
  • 10.1.1 Oracle GoldenGate and Oracle Streams
  • 10.1.2 Oracle GoldenGate and Oracle RAC
  • 10.1.3 Oracle GoldenGate and Oracle Data Guard/Oracle Active Data Guard
  • 10.1.4 Oracle GoldenGate and Edition-Based Redefinition
• 10.2 Oracle GoldenGate Configuration Best Practices
  • 10.2.1 Use of a Clustered File System
  • 10.2.2 Improved ASM Log File Read API
  • 10.2.3 Replicat Commit Behavior
  • 10.2.4 Oracle Clusterware Configuration
  • 10.2.5 Additional Oracle GoldenGate Best Practices
• 10.3 Oracle GoldenGate Operational Best Practices

11 Configuring Fast Connection Failover

• 11.1 Configure JDBC and OCI Clients for Failover
• 11.2 Configure Oracle RAC Databases for Failover
  • 11.2.1 Configure Database Services
  • 11.2.2 Optionally Configure FAN Server Side Callouts
• 11.3 Configure the Oracle Data Guard Environment
  • 11.3.1 Configure Database Services
  • 11.3.2 Use Data Guard Broker
• 11.4 Client Transition During Switchover Operations
• 11.5 Preventing Login Storms
• 11.6 Application support

12 Monitoring for High Availability

• 12.1 Overview of Monitoring and Detection for High Availability
• 12.2 Using Enterprise Manager for System Monitoring
  • 12.2.1 Oracle Enterprise Manager Home Page
  • 12.2.2 Configure Metrics and Notification Rules for Each System
  • 12.2.3 Use Database Target Views to Monitor Health, Availability, and Performance
  • 12.2.4 Use Metrics to Monitor Data Guard System Availability
• 12.3 Managing the High Availability Environment with Enterprise Manager
  • 12.3.1 Check Enterprise Manager Policy Violations
  • 12.3.2 Use Enterprise Manager to Manage Oracle Patches and Maintain System Baselines
  • 12.3.3 Manage Database Availability with the High Availability Console
  • 12.3.4 Configure High Availability Solutions with MAA Advisor
• 12.4 Using Cluster Health Monitor

13 Recovering from Unscheduled Outages

• 13.1 Overview of Unscheduled Outages
  • 13.1.1 Managing Unscheduled Outages on the Primary Site Best Practices
  • 13.1.2 Managing Unscheduled Outages on the Standby Site Best Practices
• 13.2 Recovering from Unscheduled Outages
  • 13.2.1 Complete Site Failover (Failover to Secondary Site)
    • 13.2.1.1 When to Use Complete Site Failover
    • 13.2.1.2 Best Practices for Complete Site Failover
    • 13.2.1.3 Repair Solution
  • 13.2.2 Database Failover with a Standby Database
    • 13.2.2.1 When To Perform a Data Guard Failover
    • 13.2.2.2 Best Practices for Implementing Fast-Start Failover
    • 13.2.2.3 Best Practices for Performing Manual Failover
  • 13.2.3 Oracle RAC Recovery for Unscheduled Outages (for Node or Instance Failures)
    • 13.2.3.1 Automatic Instance Recovery for Failed Instances
    • 13.2.3.2 Automatic Service Relocation
    • 13.2.3.3 Oracle Cluster Registry Recovery
  • 13.2.4 Application Failover
  • 13.2.5 Oracle ASM Recovery After Disk and Storage Failures
    • 13.2.5.1 Oracle ASM Instance Failure
    • 13.2.5.2 Oracle ASM Disk Failure
    • 13.2.5.3 Data Area Disk Group Failure
    • 13.2.5.4 Fast Recovery Area Disk Group Failure
  • 13.2.6 Recovering from Data Corruption
    • 13.2.6.1 Use Data Recovery Advisor
    • 13.2.6.2 Use Active Data Guard
    • 13.2.6.3 Use RMAN and Block Media Recovery
    • 13.2.6.4 Perform a Data Guard Role Transition
    • 13.2.6.5 Use RMAN and Datafile Media Recovery
  • 13.2.7 Recovering from Human Error (Recovery with Flashback)
    • 13.2.7.1 Resolving Table Inconsistencies
    • 13.2.7.2 Resolving Row and Transaction Inconsistencies
    • 13.2.7.3 Resolving Database-Wide Inconsistencies
    • 13.2.7.4 Resolving One or More Tablespace Inconsistencies
  • 13.2.8 Recovering Databases in a Distributed Environment
• 13.3 Restoring Fault Tolerance
  • 13.3.1 Restoring Failed Nodes or Instances in Oracle RAC and Oracle RAC One Node
    • 13.3.1.1 Recovering Service Availability for Oracle RAC
    • 13.3.1.2 Recovering Service Availability for Oracle RAC One Node
    • 13.3.1.3 Considerations for Client Connections After Restoring an Oracle RAC Instance
  • 13.3.2 Restoring a Standby Database After a Failover
    • 13.3.2.1 Reinstating the Original Primary Database After a Fast-Start Failover
    • 13.3.2.2 Reinstating a Standby Database Using Enterprise Manager After a Failover
  • 13.3.3 Restoring Oracle ASM Disk Groups after a Failure
  • 13.3.4 Restoring Fault Tolerance After Planned Downtime on Secondary Site or Cluster
  • 13.3.5 Restoring Fault Tolerance After a Standby Database Data Failure
  • 13.3.6 Restoring Fault Tolerance After the Primary Database Was Opened Resetlogs
  • 13.3.7 Restoring Fault Tolerance After Dual Failures

14 Reducing Downtime for Planned Maintenance

• 14.1 Overview of Scheduled Outages
  • 14.1.1 Managing Scheduled Outages on the Primary Site
  • 14.1.2 Managing Scheduled Outages On the Secondary Site
• 14.2 Eliminating or Reducing Downtime for Scheduled Outages
  • 14.2.1 Site, Hardware, and Software Maintenance Using Database Switchover
    • 14.2.1.1 When to Perform a Data Guard Switchover
    • 14.2.1.2 Best Practices for Configuring Data Guard Switchover
    • 14.2.1.3 How to Perform Data Guard Switchover
  • 14.2.2 Online Patching
  • 14.2.3 Data Guard Standby-First Patch Apply
  • 14.2.4 Oracle RAC Patches
    • 14.2.4.1 Best Practices to Minimize Downtime for All Database Patch Upgrades
    • 14.2.4.2 Best Practices to Minimize Downtime for Database Rolling Upgrades
    • 14.2.4.3 Out-of-place Software Installation and Patching
    • 14.2.4.4 Using OPlan for Patching
  • 14.2.5 Grid Infrastructure Maintenance
    • 14.2.5.1 Grid Infrastructure Rolling Upgrade
    • 14.2.5.2 Storage Maintenance
  • 14.2.6 Database Upgrades
    • 14.2.6.1 Upgrading with Database Upgrade Assistant (DBUA)
    • 14.2.6.2 Upgrading with Data Guard SQL Apply or Transient Logical Standby Database
    • 14.2.6.3 Upgrading with Oracle GoldenGate
    • 14.2.6.4 Upgrading with Transportable Tablespaces
  • 14.2.7 Database Platform or Location Migration
    • 14.2.7.1 Consider Your Options and Your Migration Strategy
    • 14.2.7.2 Plan Your Migration
    • 14.2.7.3 Oracle Features for Platform Migration and Upgrades
    • 14.2.7.4 Physical Standby Databases for Platform Migration
    • 14.2.7.5 Transportable Database for Platform Migration
    • 14.2.7.6 Oracle GoldenGate for Platform Migration
    • 14.2.7.7 Oracle Data Pump for Platform Migration
    • 14.2.7.8 Transportable Tablespaces for Platform Migration
    • 14.2.7.9 Data Guard Redo Apply (Physical Standby Database) for Location Migration
  • 14.2.8 Edition-Based Redefinition for Online Application Maintenance and Upgrades
  • 14.2.9 Oracle GoldenGate for Online Application Upgrades
  • 14.2.10 Data Reorganization and Redefinition
  • 14.2.11 Automatic Workload Management for System Maintenance

Glossary

Index