|
| 1 | +--- |
| 2 | +layout: post |
| 3 | +title: "Alert Log of the Primary Database Shows Error 16063" |
| 4 | +excerpt: "Every day from 1:00 AM to 3:00 AM, the primary database's alert log reports the following messages. The synchronization between the primary and standby databases is not affected." |
| 5 | +date: 2025-08-25 10:00:00 +0800 |
| 6 | +categories: [Oracle, Database] |
| 7 | +tags: [Error 16063, oracle] |
| 8 | +image: /assets/images/posts/Alert-Log-of-the-Primary-Database-Shows-Error-16063.jpg |
| 9 | +--- |
| 10 | + |
| 11 | +## Problem Description |
| 12 | +The alert log of the Primary Database shows the error: `Error 16063 archiving LNO:x to 'xxxdg'`. |
| 13 | +Environment: Oracle 19.7 RAC, one primary and two standby databases. |
| 14 | +Every day from 1:00 AM to 3:00 AM, the primary database's alert log reports the following messages. The synchronization between the primary and standby databases is not affected. |
| 15 | + |
| 16 | +Alert log errors: |
| 17 | +``` |
| 18 | +TT02 (PID:26639): Error 16063 archiving LNO:1 to 'fcdbdg' |
| 19 | +2024-04-13T04:21:31.131104+08:00 |
| 20 | +TT05 (PID:284880): SRL selected for T-1.S-86392 for LAD:2 |
| 21 | +2024-04-13T04:27:02.543062+08:00 |
| 22 | +Thread 1 advanced to log sequence 86393 (LGWR switch) |
| 23 | +Current log# 3 seq# 86393 mem# 0: +DATAC1/fCDB/ONLINELOG/group_3.272.1043431153 |
| 24 | +2024-04-13T04:27:03.733427+08:00 |
| 25 | +TT02 (PID:26639): SRL selected for T-1.S-86393 for LAD:3 |
| 26 | +TT02 (PID:26639): SRL selected for T-1.S-86393 for LAD:2 |
| 27 | +2024-04-13T04:27:04.165936+08:00 |
| 28 | +LOGMINER: End mining logfile for session 2 thread 1 sequence 86392, +DATAC1/fCDB/ONLINELOG/group_1.261.1043431153 |
| 29 | +2024-04-13T04:27:04.221339+08:00 |
| 30 | +LOGMINER: Begin mining logfile for session 2 thread 1 sequence 86393, +DATAC1/fCDB/ONLINELOG/group_3.272.1043431153 |
| 31 | +2024-04-13T04:27:07.213294+08:00 |
| 32 | +ARC1 (PID:26630): Archived Log entry 319543 added for T-1.S-86392 ID 0x73041d97 LAD:1 |
| 33 | +2024-04-13T04:29:01.299251+08:00 |
| 34 | +TT02 (PID:26639): Error 16063 archiving LNO:3 to 'fcdbsdb' |
| 35 | +``` |
| 36 | + |
| 37 | +## Analysis |
| 38 | +Confirm the ADG parameter settings: |
| 39 | +``` |
| 40 | +SYS@fcdb2> show parameter fal |
| 41 | +
|
| 42 | +NAME TYPE VALUE |
| 43 | +------------------------------------ ----------- ------------------------------ |
| 44 | +fal_client string |
| 45 | +fal_server string fcdbsdb,fcdbdg |
| 46 | +
|
| 47 | +SYS@fcdb2> show parameter log_archive |
| 48 | +
|
| 49 | +NAME TYPE VALUE |
| 50 | +------------------------------------ ----------- ------------------------------ |
| 51 | +log_archive_config string DG_CONFIG=(fcdb,fcdbdg,f |
| 52 | +cdbsdb) |
| 53 | +log_archive_dest string |
| 54 | +log_archive_dest_1 string LOCATION=+RECOC1 VALID_FOR=(AL |
| 55 | +L_LOGFILES,ALL_ROLES) DB_UNIQU |
| 56 | +E_NAME=fcdb |
| 57 | +
|
| 58 | +
|
| 59 | +log_archive_dest_2 string SERVICE=fcdbdg ASYNC REOPEN= |
| 60 | +15 VALID_FOR=(ONLINE_LOGFILES, |
| 61 | +PRIMARY_ROLE) DB_UNIQUE_NAME=a |
| 62 | +facdbdg |
| 63 | +
|
| 64 | +log_archive_dest_3 string SERVICE=fcdbsdb ASYNC REOPEN |
| 65 | +=15 VALID_FOR=(ONLINE_LOGFILES |
| 66 | +,PRIMARY_ROLE) DB_UNIQUE_NAME= |
| 67 | +fcdbsdb |
| 68 | +
|
| 69 | +log_archive_format string %t_%s_%r.dbf |
| 70 | +log_archive_max_processes integer 4 |
| 71 | +log_archive_min_succeed_dest integer 1 |
| 72 | +log_archive_start boolean FALSE |
| 73 | +log_archive_trace integer 0 |
| 74 | +``` |
| 75 | + |
| 76 | +Dataguard Configuration Report |
| 77 | +``` |
| 78 | +Database Name: fcdb |
| 79 | +Database Unique Name: fcdb |
| 80 | +Database Home: /u01/app/oracle/product/19.0.0.0/dbhome_1 |
| 81 | +Database SID: fcdb1 |
| 82 | +Database Version: 19.7.0.0.0 |
| 83 | +Database Owner: oracle |
| 84 | +Database Role: PRIMARY |
| 85 | +Database TNS Admin: /u01/app/oracle/product/19.0.0.0/dbhome_1/network/admin |
| 86 | +
|
| 87 | +
|
| 88 | +DB_UNIQUE_NAME PARENT_DBUN DEST_ROLE CURRENT_SCN CON_ID |
| 89 | +----------------------------- ----------------------------- ----------------- ---------------- ------------- |
| 90 | +fcdb NONE PRIMARY DATABASE 300985562490 0 |
| 91 | +fcdbdg fcdb PHYSICAL STANDBY 300985510289 0 |
| 92 | +fcdbsdb fcdb PHYSICAL STANDBY 300985510884 0 |
| 93 | +``` |
| 94 | + |
| 95 | +Verify the last sequence# received and the last sequence# applied to standby database. |
| 96 | +``` |
| 97 | +SYS@fcdb1> |
| 98 | +SYS@fcdb1> SELECT al.thrd "Thread", almax "Last Seq Received", lhmax "Last Seq Applied" FROM (select thread# thrd, MAX(sequence#) almax FROM v$archived_log WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) al, (SELECT thread# thrd, MAX(sequence#) lhmax FROM v$log_history WHERE resetlogs_change#=(SELECT resetlogs_change# FROM v$database) GROUP BY thread#) lh WHERE al.thrd = lh.thrd; |
| 99 | +
|
| 100 | +Thread Last Seq Received Last Seq Applied |
| 101 | +1 89891 89891 |
| 102 | +2 76653 76653 |
| 103 | +
|
| 104 | +2 rows selected. |
| 105 | +``` |
| 106 | + |
| 107 | +Check the transport lag and apply lag from the V$DATAGUARD_STATS view. This is only relevant when LGWR log transport and real time apply are in use. |
| 108 | +``` |
| 109 | +SYS@fcdb1> |
| 110 | +SYS@fcdb1>SELECT * FROM v$dataguard_stats WHERE name LIKE '%lag%'; |
| 111 | +
|
| 112 | +SOURCE_DBID SOURCE_DB_UNIQUE_NAME NAME VALUE UNIT TIME_COMPUTED DATUM_TIME CON_ID |
| 113 | +0 transport lag +00 00:00:00 day(2) to second(0) interval 06/03/2024 11:18:52 06/03/2024 11:18:51 0 |
| 114 | +0 apply lag +00 00:00:00 day(2) to second(0) interval 06/03/2024 11:18:52 06/03/2024 11:18:51 0 |
| 115 | +
|
| 116 | +SYS@fcdb1> SELECT * FROM v$dataguard_stats WHERE name LIKE '%lag%'; |
| 117 | +
|
| 118 | +SOURCE_DBID SOURCE_DB_UNIQUE_NAME NAME VALUE UNIT TIME_COMPUTED DATUM_TIME CON_ID |
| 119 | +0 transport lag +00 00:00:00 day(2) to second(0) interval 06/03/2024 11:24:24 06/03/2024 11:24:24 0 |
| 120 | +0 apply lag +00 00:00:00 day(2) to second(0) interval 06/03/2024 11:24:24 06/03/2024 11:24:24 0 |
| 121 | +
|
| 122 | +``` |
| 123 | +Based on all logs from the primary and standby databases, it can be confirmed that the primary database and the standby databases are synchronized. There is no lag between the primary database and the two standby databases. |
| 124 | + |
| 125 | +## Solution |
| 126 | +After investigation, it was found that other customers have encountered this issue. The recommended solution is to set the following hidden parameter and restart the primary database, then monitor for the error messages. |
| 127 | +``` |
| 128 | +alter system set "_REDO_TRANSPORT_ASYNC_MODE"=1 scope=spfile sid='*'; --> this parameter needs database restart. |
| 129 | +``` |
| 130 | + |
| 131 | +## REFERENCE INFORMATION |
| 132 | +Error 16063 archiving LNO:n to '<db>' (Doc ID 2722180.1) |
0 commit comments