Database Administrator's blog

Monday, March 3, 2025

Problem Key 'ORA 1578' was completely flood controlled (0x2)

============================

Options to identify the Corruption

============================

Using SQL

SELECT FILE#,

BLOCK#,

BLOCKS,

TO_CHAR(CORRUPTION_CHANGE#) CORRUPTION_CHANGE#,

CORRUPTION_TYPE

FROM V$DATABASE_BLOCK_CORRUPTION;

SQL> SELECT FILE#,

BLOCK#,

BLOCKS,

TO_CHAR(CORRUPTION_CHANGE#) CORRUPTION_CHANGE#,

CORRUPTION_TYPE

FROM V$DATABASE_BLOCK_CORRUPTION; 2 3 4 5 6

FILE# BLOCK# BLOCKS CORRUPTION_CHANGE#

---------- ---------- ---------- ----------------------------------------

CORRUPTIO

---------

325 196462 1 33745505699576

CORRUPT

SQL>

SELECT e.owner,

e.segment_type,

e.segment_name,

e.partition_name,

c.file#,

greatest(e.block_id, c.block#) corr_start_block#,

least(e.block_id+e.blocks-1, c.block#+c.blocks-1) corr_end_block#,

least(e.block_id+e.blocks-1, c.block#+c.blocks-1),

corruption_type description

FROM DBA_EXTENTS e,

V$DATABASE_BLOCK_CORRUPTION c

WHERE e.file_id = c.file#

AND e.block_id <= c.block# + c.blocks - 1

AND e.block_id + e.blocks - 1 >= c.block#

SQL> SELECT e.owner,

e.segment_type,

e.segment_name,

e.partition_name,

c.file#,

greatest(e.block_id, c.block#) corr_start_block#,

least(e.block_id+e.blocks-1, c.block#+c.blocks-1) corr_end_block#,

least(e.block_id+e.blocks-1, c.block#+c.blocks-1),

corruption_type description

FROM DBA_EXTENTS e,

V$DATABASE_BLOCK_CORRUPTION c

WHERE e.file_id = c.file#

AND e.block_id <= c.block# + c.blocks - 1

AND e.block_id + e.blocks - 1 >= c.block# 2 3 4 5 6 7 8 9 10 11 12 13 14 ;

OWNER SEGMENT_TYPE SEGMENT_NAME

-------------------------------------------------------------------------------------------------------------------------------- ------------------ --------------------------------------------------------------------------------------------------------------------------------

PARTITION_NAME FILE# CORR_START_BLOCK# CORR_END_BLOCK# LEAST(E.BLOCK_ID+E.BLOCKS-1,C.BLOCK#+C.BLOCKS-1) DESCRIPTI

-------------------------------------------------------------------------------------------------------------------------------- ---------- ----------------- --------------- ------------------------------------------------ ---------

IBANKING INDEX IDX_DT_ACT_STATEMENT

325 196462 196462 196462 CORRUPT

SELECT s.owner,

s.segment_type,

s.segment_name,

s.partition_name,

c.file#,

header_block corr_start_block#,

header_block corr_end_block#,

1 blocks_corrupted,

corruption_type||' Segment Header' description

FROM DBA_SEGMENTS S,

V$DATABASE_BLOCK_CORRUPTION C

WHERE s.header_file = c.file#

AND s.header_block between c.block# and c.block# + c.blocks - 1

SELECT null owner,

null segment_type,

null segment_name,

null partition_name,

c.file#,

greatest(f.block_id, c.block#) corr_start_block#,

least(f.block_id+f.blocks-1, c.block#+c.blocks-1) corr_end_block#,

least(f.block_id+f.blocks-1, c.block#+c.blocks-1)

- greatest(f.block_id, c.block#) + 1 blocks_corrupted,

'Free Block' description

FROM DBA_FREE_SPACE F,

V$DATABASE_BLOCK_CORRUPTION C

WHERE f.file_id = c.file#

AND f.block_id <= c.block# + c.blocks - 1

AND f.block_id + f.blocks - 1 >= c.block#

ORDER BY file#, corr_start_block#;

Solution:

Options to fix Corruption

Rebuild Index Online

SQL> ALTER INDEX IBANKING.IDX_DT_ACT_STATEMENT REBUILD ONLINE;

Index altered.

SQL>

Sunday, March 2, 2025

Resolving Gaps In Data Guard Using Incremental Rman Backup

1. [Standby] Stop the managed standby apply process:

SQL> alter database recover managed standby database cancel;

2. [Standby] Shutdown the standby database

3. [Primary] On the primary, take an incremental backup from the SCN number where the standby has been stuck:

StandBY

========

SQL> select to_char(current_scn) from v$database;

TO_CHAR(CURRENT_SCN)

----------------------------------------

33762732337439

SQL>

Primary

============

SQL> select to_char(current_scn) from v$database;

TO_CHAR(CURRENT_SCN)

----------------------------------------

33763275785289

--=== Primary ==

run {

allocate channel c1 type disk format '/u03/dpump/%U.rmb';

backup incremental from scn 33762732337439 database;

}

4. [Primary] On the primary, create a new standby controlfile:

alter database create standby controlfile as '/u03/dpump/BACH_standby.ctl';

SQL> alter database create standby controlfile as '/u03/dpump/BACH_standby.ctl';

Database altered.

SQL>

[oracle@drbach dbs]$ sqlplus / as sysdba

SQL*Plus: Release 12.2.0.1.0 Production on Mon Mar 3 10:21:51 2025

Connected to an idle instance.

SQL> startup nomount;

ORACLE instance started.

Total System Global Area 1.3422E+11 bytes

Fixed Size 30046408 bytes

Variable Size 1.9059E+10 bytes

Database Buffers 1.1489E+11 bytes

Redo Buffers 238387200 bytes

SQL>

SQL> ADMINISTER KEY MANAGEMENT SET KEYSTORE OPEN IDENTIFIED BY "BAwalletpass#456" CONTAINER=ALL;

keystore altered.

SQL>

8. [Standby] Replace the controlfile with the one you just created in primary.

[oracle@drbach dpump]$ cp BACH_standby.ctl /u05/app/oracle/oradata/bachdb/control01.ctl

[oracle@drbach dpump]$ cp BACH_standby.ctl /fra/control02.ctl

[oracle@drbach dpump]$

[oracl

10.[Standby] Mount the standby database:

SQL> alter database mount standby database;

Database altered.

SQL>

11.[Standby] RMAN does not know about these files yet; so you must let it know – by a process called cataloging. Catalog these files:

RMAN> catalog start with '/u03/dpump';

Starting implicit crosscheck backup at 03-MAR-25

using target database control file instead of recovery catalog

allocated channel: ORA_DISK_1

channel ORA_DISK_1: SID=3782 device type=DISK

Crosschecked 116 objects

Finished implicit crosscheck backup at 03-MAR-25

Starting implicit crosscheck copy at 03-MAR-25

using channel ORA_DISK_1

Crosschecked 6 objects

Finished implicit crosscheck copy at 03-MAR-25

searching for all files in the recovery area

cataloging files...

cataloging done

List of Cataloged Files

=======================

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54857_mvx8zjtk_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54858_mvx9n0rd_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54860_mvxboyt7_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54861_mvxboyvj_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54862_mvxc9kv1_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54864_mvxcnfvg_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54867_mvxcwn6g_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54868_mvxcwn7z_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54871_mvxdng31_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54873_mvxf1lqp_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54874_mvxfgpt0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54875_mvxg9rnq_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54878_mvxgp4yg_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54879_mvxh51p0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54880_mvxhjfr9_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54881_mvxhxlgx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54882_mvxjbpkk_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54885_mvxjqv54_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54886_mvxk4z5z_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54887_mvxklhsj_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54888_mvxlslok_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54889_mvxm6q98_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54890_mvxn10db_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54892_mvxnsfqz_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54893_mvxompvh_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54896_mvxpfzcv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54897_mvxpgbd8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54899_mvxpv3tw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54900_mvxpvnt4_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54902_mvxq8869_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54903_mvxqof1x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54904_mvxqow4b_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54905_mvxr2l5x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54906_mvxr3y2n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54907_mvxrwvcz_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54908_mvxsq4fs_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54909_mvxt49b7_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54910_mvxv7z4b_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54911_mvxw27tv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54912_mvxyy9rv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54914_mvy490kx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54916_mvy7vg7n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54917_mvygfs94_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54918_mvyh83r5_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54919_mvyho7kj_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54920_mvylk5nq_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54848_mvw2fm7k_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54849_mvw8bw98_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54850_mvwhy4jx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54851_mvwo75l1_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54855_mvx72kf3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54856_mvx7ymp3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54857_mvx8zjqq_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54858_mvx9lnqv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54859_mvxb4grs_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54860_mvxbnlry_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54861_mvxbz2s3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54862_mvxc85sb_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54863_mvxcfbsy_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54864_mvxcm1t0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54865_mvxcq8tm_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54866_mvxcrov9_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54867_mvxcv6v3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54868_mvxcxnv8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54869_mvxd3kvw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54870_mvxdksws_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54871_mvxdqsx3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54872_mvxdzvxg_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54873_mvxfbnyb_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54874_mvxg8cz6_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54875_mvxgfg01_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54876_mvxgh40j_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54877_mvxgn612_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54878_mvxh2x11_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54879_mvxhc81r_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54880_mvxhvd28_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54881_mvxj0q2o_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54882_mvxjhc30_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54883_mvxjk13n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54884_mvxjox42_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54885_mvxjxf44_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54886_mvxkk34f_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54887_mvxlr054_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54888_mvxm575g_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54889_mvxmpy5n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54890_mvxn4860_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54891_mvxnmq6x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54892_mvxogx6y_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54893_mvxp2z7b_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54894_mvxp4y7o_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54895_mvxp817n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54896_mvxpdn8b_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54897_mvxpl88m_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54898_mvxpqp92_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54899_mvxpsv8z_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54900_mvxpwl97_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54901_mvxq6p9z_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54902_mvxqhwbf_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54903_mvxqn3hn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54904_mvxqvzj0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54905_mvxr2kjb_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54906_mvxrs7jr_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54907_mvxsn4k1_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54908_mvxt2lk3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54909_mvxtc6k5_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54910_mvxvv0kw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54911_mvxywbl6_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54912_mvy45qmm_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54913_mvy45xnd_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54914_mvy4dz6y_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54915_mvy7mwnl_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54916_mvyg7op0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54917_mvyh0mp2_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54918_mvyhdspc_.arc

File Name: /fra/DRBACH/archivelog/2025_02_26/o1_mf_1_54919_mvylbw0g_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54921_mvys379j_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54922_mvyy0rd6_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54923_mvz6ngc7_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54924_mvzdso89_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54925_mvzs36hs_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54926_mvzvkz7g_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54927_mvzvz3b6_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54928_mvzx6k82_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54930_mvzyfx4f_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54931_mvzyv2g7_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54933_mvzzmg2r_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54934_mvzzmpvx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54938_mw00ct98_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54939_mw00ryxp_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54940_mw0164ky_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54941_mw01nfs3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54942_mw02fjd0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54943_mw037s2x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54946_mw03nwr6_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54947_mw03o62d_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54948_mw0420vj_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54949_mw043tsh_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54950_mw04wco0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54951_mw063rr1_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54952_mw06y1b2_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54953_mw07r9sn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54954_mw085fwm_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54959_mw08zpc3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54960_mw09syx9_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54961_mw0b77gw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54963_mw0bn72y_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54966_mw0c1c69_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54967_mw0c1n37_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54969_mw0cgh9d_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54970_mw0d8qhv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54971_mw0f2zyj_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54972_mw0gbd7w_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54973_mw0h4nmw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54974_mw0hyxdb_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54975_mw0lfpst_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54980_mw0nhcwd_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54981_mw0nwhr7_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54982_mw0nwsbn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54988_mw0o9mxw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54989_mw0py4xs_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54990_mw12tvnc_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54991_mw137zq9_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54992_mw16ypqd_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54920_mvyrs14w_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54921_mvyxr1y0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54922_mvz6980o_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54923_mvzdr8h6_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54924_mvzrwykg_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54925_mvzvb9kw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54926_mvzvw0l5_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54927_mvzx3olr_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54928_mvzxm4m4_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54929_mvzy4omr_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54930_mvzyr2mp_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54931_mvzz1tn0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54932_mvzzcynr_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54933_mvzzl4nx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54934_mvzzv7om_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54935_mw005npf_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54936_mw008cq1_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54937_mw00b4q8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54938_mw00lvqn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54939_mw012fqo_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54940_mw01m0r8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54941_mw02cvrn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54942_mw0360s8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54943_mw038nsj_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54944_mw03c8ss_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54945_mw03fpsw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54946_mw03mmsz_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54947_mw03yht8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54948_mw042ftn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54949_mw04qjv1_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54950_mw05qdv3_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54951_mw06o0vk_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54952_mw07j3vr_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54953_mw081qw2_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54954_mw08dswh_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54955_mw08g3x0_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54956_mw08h7xk_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54957_mw08jgxn_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54958_mw08r1xy_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54959_mw09jpy2_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54960_mw0b5syf_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54961_mw0bj0ym_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54962_mw0bl5z4_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54963_mw0bsryv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54964_mw0bwm07_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54965_mw0by60q_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54966_mw0bzz0n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54967_mw0c3n18_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54968_mw0c621q_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54969_mw0cyq1x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54970_mw0dt62n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54971_mw0g1o2w_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54972_mw0gsy37_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54973_mw0hxd3f_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54974_mw0l3f46_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54975_mw0mvl4w_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54976_mw0mwp5b_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54977_mw0mxk60_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54978_mw0my669_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54979_mw0mymyx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54980_mw0nrt6h_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54981_mw0nvc6o_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54982_mw0nx16x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54983_mw0ny87k_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54984_mw0nz37t_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54985_mw0nzo89_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54986_mw0nzy8b_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54987_mw0o3l3x_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54988_mw0pqn8n_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54989_mw12mbfy_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54990_mw1316g7_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54991_mw16x99w_.arc

File Name: /fra/DRBACH/archivelog/2025_02_27/o1_mf_1_54992_mw19vbbx_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54993_mw1b75vt_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54994_mw1h4pyy_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54995_mw1r6g7c_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54996_mw1z64bc_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54997_mw29dwv9_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54998_mw32fpot_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54999_mw3qc7mw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_55000_mw3qrcpw_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_55001_mw3rlmxz_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_55002_mw3vvo5f_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54993_mw1gzrkc_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54994_mw1r50mh_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54995_mw1z4pnp_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54996_mw29b6p8_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54997_mw32chvv_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54998_mw3pyy1t_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_54999_mw3qf322_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_55000_mw3r9m2f_.arc

File Name: /fra/DRBACH/archivelog/2025_02_28/o1_mf_1_55001_mw3vk339_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55003_mw420sqp_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55004_mw4dox47_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55005_mw4lttkp_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55006_mw4qc7lw_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55007_mw4z4odp_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55008_mw57rcdo_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55009_mw5f30n7_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55010_mw5lfovz_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55011_mw5py2xr_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55012_mw5tn7s6_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55013_mw5yqjrg_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55014_mw620kjj_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55015_mw68lm1m_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55016_mw6c1cmd_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55017_mw6cgs9l_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55018_mw6f3043_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55019_mw6fx8b6_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55020_mw6js4yj_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55002_mw41zc5b_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55003_mw4dhq7j_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55004_mw4lh5bh_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55005_mw4q41bq_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55006_mw4yrgdj_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55007_mw57dnh6_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55008_mw5dvrm2_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55009_mw5l4wqy_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55010_mw5pocrc_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55011_mw5td4s4_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55012_mw5yhvv1_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55013_mw61qgvy_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55014_mw6642wz_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55015_mw6btkz5_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55016_mw6cfb0n_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55017_mw6dqwwp_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55018_mw6frnf4_.arc

File Name: /fra/DRBACH/archivelog/2025_03_01/o1_mf_1_55019_mw6jq4g3_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55021_mw6nh9sn_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55022_mw6qc6hl_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55023_mw6v1cbz_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55024_mw7168vn_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55025_mw75b6pl_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55026_mw79ftv1_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55027_mw7dovkh_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55028_mw7mo171_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55030_mw7qpg6v_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55033_mw7sbyn4_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55035_mw7sr2sx_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55038_mw7tlby1_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55039_mw7tzh27_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55040_mw7vdm50_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55042_mw7vsq8f_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55043_mw7w6vox_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55076_mw849l1y_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55044_mw7w8rbp_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55045_mw7wnrfq_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55047_mw7x13sp_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55050_mw7xsj0f_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55051_mw7y6n3n_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55054_mw802nlz_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55055_mw80hrpc_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55058_mw80wwsr_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55059_mw80xtmd_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55060_mw81b0x5_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55062_mw81q50x_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55063_mw824947_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55065_mw82kf7m_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55066_mw82ykbn_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55069_mw83cog9_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55072_mw83rslf_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55073_mw83sjtg_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55076_mw845xnw_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55077_mw84m1r7_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55079_mw8505vb_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55082_mw85tg43_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55084_mw867lf0_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55085_mw86npd3_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55086_mw87w2of_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55087_mw895342_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55088_mw8c54hc_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55020_mw6n7r25_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55021_mw6q5m2x_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55022_mw6txm3j_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55023_mw70wo4w_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55024_mw758q69_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55025_mw79dc7t_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55094_mw8j6o5r_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55026_mw7dbh8o_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55027_mw7mf2bo_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55028_mw7p9wc7_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55029_mw7qh0cz_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55030_mw7r1ldc_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55031_mw7rfvdt_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55032_mw7rsvff_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55033_mw7sc9fc_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55034_mw7skhg6_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55035_mw7sq0g6_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55036_mw7t0ogw_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55037_mw7th0h9_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55038_mw7twphs_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55039_mw7v7lj2_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55040_mw7vkpk8_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55041_mw7voxl8_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55042_mw7vtzl9_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55043_mw7w78lt_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55044_mw7wm8m3_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55045_mw7wvfm6_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55046_mw7wzcmq_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55047_mw7x4wmo_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55048_mw7xfmn4_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55049_mw7xq8nl_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55050_mw7y4onq_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55051_mw7ywhnx_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55052_mw7zo1oh_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55053_mw7zy4or_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55054_mw805goz_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55055_mw80m7s1_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55056_mw80nxsk_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55057_mw80smsw_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55058_mw80wbt0_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55059_mw8170tb_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55060_mw819nts_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55061_mw81k4v4_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55062_mw81w0vf_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55063_mw827cvk_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55064_mw82cywn_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55065_mw82nvwy_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55066_mw834pxj_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55067_mw836hyd_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55068_mw838kyd_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55077_mw84n22b_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55069_mw83ffys_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55070_mw83k004_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55071_mw83p509_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55072_mw83r10m_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55073_mw83wt0w_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55074_mw83zx1h_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55075_mw843r1s_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55078_mw84ww33_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55079_mw85gp35_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55080_mw85nj3m_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55081_mw85rx3r_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55082_mw85zo3p_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55083_mw865l40_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55084_mw86d445_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55085_mw87lr4b_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55086_mw893m4f_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55087_mw8bw44q_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55091_mw8dpmkj_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55089_mw8dpp56_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55095_mw8ll784_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55096_mw8p2x9x_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55097_mw8ts0dx_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55098_mw8zhdhc_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55099_mw8zw7j8_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55100_mw9187ws_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55101_mw9309y0_.arc

File Name: /fra/DRBACH/archivelog/2025_03_02/o1_mf_1_55102_mw95ygcw_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55103_mw9b1sg2_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55104_mw9dzxjg_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55105_mw9jjplh_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55106_mw9pdook_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55107_mw9w8ns2_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55108_mwb0z0w5_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55109_mwb9nncq_.arc

File Name: /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55110_mwbc0jfb_.arc

searching for all files that match the pattern /u03/dpump

List of Files Unknown to the Database

=====================================

File Name: /u03/dpump/BACH_standby.ctl

Do you really want to catalog the above files (enter YES or NO)? yes

cataloging files...

cataloging done

List of Cataloged Files

=======================

File Name: /u03/dpump/BACH_standby.ctl

RMAN>

12.Recover these files:

RMAN> recover database;

Starting recover at 03-MAR-25

using channel ORA_DISK_1

channel ORA_DISK_1: starting incremental datafile backup set restore

channel ORA_DISK_1: specifying datafile(s) to restore from backup set

destination for restore of datafile 00156: /u05/app/oracle/oradata/drbach/micrarch/MICRIMG02.DBF

destination for restore of datafile 00158: /u05/app/oracle/oradata/drbach/micrarch/MICRIMG04.DBF

destination for restore of datafile 00182: /u05/app/oracle/oradata/drbach/micrarch/MICRXML06.DBF

destination for restore of datafile 00196: /data01/app/oracle/oradata/drbach/micrarch/CHQIMG05.DBF

channel ORA_DISK_1: reading from backup piece /u03/dpump/bm3jdk94_1_1.rmb

channel ORA_DISK_1: piece handle=/u03/dpump/bm3jdk94_1_1.rmb tag=TAG20250303T095340

channel ORA_DISK_1: restored backup piece 1

channel ORA_DISK_1: restore complete, elapsed time: 00:00:01

channel ORA_DISK_1: starting incremental datafile backup set restore

channel ORA_DISK_1: specifying datafile(s) to restore from backup set

destination for restore of datafile 00178: /u05/app/oracle/oradata/drbach/micrarch/MICRXML02.DBF

channel ORA_DISK_1: restored backup piece 1

channel ORA_DISK_1: restore complete, elapsed time: 00:00:01

starting media recovery

archived log for thread 1 with sequence 55110 is already on disk as file /fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55110_mwbc0jfb_.arc

archived log file name=/fra/DRBACH/archivelog/2025_03_03/o1_mf_1_55110_mwbc0jfb_.arc thread=1 sequence=55110

media recovery complete, elapsed time: 00:00:02

Finished recover at 03-MAR-25

RMAN>

14.At this point exit RMAN and start managed recovery process:

ecovery Manager complete.

[oracle@drbach dpump]$ sqlplus / as sysdba

SQL*Plus: Release 12.2.0.1.0 Production on Mon Mar 3 10:30:55 2025

Connected to:

Oracle Database 12c Enterprise Edition Release 12.2.0.1.0 - 64bit Production

SQL> alter database open;

Database altered.

SQL>

SQL> alter database recover managed standby database using current logfile disconnect;

Wednesday, November 8, 2023

Oracle 19c (19.19.0.0) Oracle Home Patching

--=== Oracle 19c (19.19.0.0) Oracle Home patching ============

[oracle@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.17

OPatch succeeded.

[oracle@baprdg01 OPatch]$

[oracle@baprdg01 OPatch]$ ls -ld

drwxr-x--- 14 oracle oinstall 4096 Nov 6 14:46 .

[oracle@baprdg01 OPatch]$

--move OPatch Version: 12.2.0.1.17

[oracle@baprdg01 OPatch]$ pwd

/u01/app/19.0.0.0/oracle/OPatch

[oracle@baprdg01 OPatch]$ cd ..

[oracle@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.17

OPatch succeeded.

[oracle@baprdg01 OPatch]$

[oracle@baprdg01 OPatch]$ ls -ld

drwxr-x--- 14 oracle oinstall 4096 Nov 6 14:46 .

[oracle@baprdg01 OPatch]$

--move OPatch Version: 12.2.0.1.17

[oracle@baprdg01 OPatch]$ pwd

/u01/app/19.0.0.0/oracle/OPatch

[oracle@baprdg01 OPatch]$ cd ..

[oracle@baprdg01 oracle]$ mv OPatch/ bak_OPatch_8nov23

[oracle@baprdg01 oracle]$ ls -ltr

-- use OPatch Version: 12.2.0.1.33

[oracle@baprdg01 dbhome_1]$ /u01/app/oracle/product/19.0.0.0/dbhome_1/OPatch/opatch version

OPatch Version: 12.2.0.1.39

OPatch succeeded.

[oracle@baprdg01 dbhome_1]$

[oracle@baprdg01 oracle]$ chmod -R 775 OPatch/

[oracle@baprdg01 oracle]$

[oracle@baprdg01 oracle]$ cd OPatch/

[oracle@baprdg01 OPatch]$

[oracle@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.33

OPatch succeeded.

[oracle@baprdg01 OPatch]$

[oracle@baprdg01 dbhome_1]$ chmod -R 775 OPatch/

[oracle@baprdg01 dbhome_1]$

OPatch LOCATION:

[oracle@baprdg01 DB_Patch]$ cd 35042068/

[oracle@baprdg01 35042068]$

[oracle@baprdg01 35042068]$ ls

custom etc files README.html README.txt

[oracle@baprdg01 35042068]$

[oracle@baprdg01 35042068]$ /u01/app/oracle/product/19.0.0.0/dbhome_1/OPatch/opatch apply

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/oracle/product/19.0.0.0/dbhome_1

Central Inventory : /u01/app/oraInventory

from : /u01/app/oracle/product/19.0.0.0/dbhome_1/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/oracle/product/19.0.0.0/dbhome_1/cfgtoollogs/opatch/opatch2023-11-08_13-04-59PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 35042068

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u01/app/oracle/product/19.0.0.0/dbhome_1')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '35042068' to OH '/u01/app/oracle/product/19.0.0.0/dbhome_1'

ApplySession: Optional component(s) [ oracle.network.gsm, 19.0.0.0.0 ] , [ oracle.rdbms.ic, 19.0.0.0.0 ] , [ oracle.rdbms.tg4db2, 19.0.0.0.0 ] , [ oracle.tfa, 19.0.0.0.0 ] , [ oracle.ons.cclient, 19.0.0.0.0 ] , [ oracle.network.cman, 19.0.0.0.0 ] , [ oracle.rdbms.tg4sybs, 19.0.0.0.0 ] , [ oracle.sdo.companion, 19.0.0.0.0 ] , [ oracle.rdbms.tg4ifmx, 19.0.0.0.0 ] , [ oracle.options.olap.api, 19.0.0.0.0 ] , [ oracle.rdbms.tg4tera, 19.0.0.0.0 ] , [ oracle.oid.client, 19.0.0.0.0 ] , [ oracle.options.olap, 19.0.0.0.0 ] , [ oracle.ons.eons.bwcompat, 19.0.0.0.0 ] , [ oracle.rdbms.tg4msql, 19.0.0.0.0 ] , [ oracle.net.cman, 19.0.0.0.0 ] , [ oracle.xdk.companion, 19.0.0.0.0 ] , [ oracle.jdk, 1.8.0.191.0 ] not present in the Oracle Home or a higher version is found.

Patching component oracle.rsf, 19.0.0.0.0...

Patching component oracle.nlsrtl.rsf.core, 19.0.0.0.0...

Patching component oracle.slax.rsf, 19.0.0.0.0...

Patching component oracle.ordim.jai, 19.0.0.0.0...

Patching component oracle.bali.jewt, 11.1.1.6.0...

Patching component oracle.bali.ewt, 11.1.1.6.0...

Patching component oracle.help.ohj, 11.1.1.7.0...

Patching component oracle.rdbms.locator, 19.0.0.0.0...

Patching component oracle.perlint.expat, 2.0.1.0.4...

Patching component oracle.rdbms.util, 19.0.0.0.0...

Patching component oracle.rdbms.rsf, 19.0.0.0.0...

Patching component oracle.rdbms, 19.0.0.0.0...

Patching component oracle.assistants.acf, 19.0.0.0.0...

Patching component oracle.assistants.deconfig, 19.0.0.0.0...

Patching component oracle.assistants.server, 19.0.0.0.0...

Patching component oracle.blaslapack, 19.0.0.0.0...

Patching component oracle.buildtools.rsf, 19.0.0.0.0...

Patching component oracle.ctx, 19.0.0.0.0...

Patching component oracle.dbdev, 19.0.0.0.0...

Patching component oracle.dbjava.ic, 19.0.0.0.0...

Patching component oracle.dbjava.jdbc, 19.0.0.0.0...

Patching component oracle.dbjava.ucp, 19.0.0.0.0...

Patching component oracle.duma, 19.0.0.0.0...

Patching component oracle.javavm.client, 19.0.0.0.0...

Patching component oracle.ldap.owm, 19.0.0.0.0...

Patching component oracle.ldap.rsf, 19.0.0.0.0...

Patching component oracle.ldap.security.osdt, 19.0.0.0.0...

Patching component oracle.marvel, 19.0.0.0.0...

Patching component oracle.network.rsf, 19.0.0.0.0...

Patching component oracle.odbc.ic, 19.0.0.0.0...

Patching component oracle.ons, 19.0.0.0.0...

Patching component oracle.ons.ic, 19.0.0.0.0...

Patching component oracle.oracore.rsf, 19.0.0.0.0...

Patching component oracle.perlint, 5.28.1.0.0...

Patching component oracle.precomp.common.core, 19.0.0.0.0...

Patching component oracle.precomp.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.crs, 19.0.0.0.0...

Patching component oracle.rdbms.dbscripts, 19.0.0.0.0...

Patching component oracle.rdbms.deconfig, 19.0.0.0.0...

Patching component oracle.rdbms.oci, 19.0.0.0.0...

Patching component oracle.rdbms.rsf.ic, 19.0.0.0.0...

Patching component oracle.rdbms.scheduler, 19.0.0.0.0...

Patching component oracle.rhp.db, 19.0.0.0.0...

Patching component oracle.sdo, 19.0.0.0.0...

Patching component oracle.sdo.locator.jrf, 19.0.0.0.0...

Patching component oracle.sqlplus, 19.0.0.0.0...

Patching component oracle.sqlplus.ic, 19.0.0.0.0...

Patching component oracle.wwg.plsql, 19.0.0.0.0...

Patching component oracle.xdk.xquery, 19.0.0.0.0...

Patching component oracle.javavm.server, 19.0.0.0.0...

Patching component oracle.xdk.parser.java, 19.0.0.0.0...

Patching component oracle.odbc, 19.0.0.0.0...

Patching component oracle.ctx.rsf, 19.0.0.0.0...

Patching component oracle.oraolap, 19.0.0.0.0...

Patching component oracle.rdbms.hsodbc, 19.0.0.0.0...

Patching component oracle.network.client, 19.0.0.0.0...

Patching component oracle.ctx.atg, 19.0.0.0.0...

Patching component oracle.rdbms.install.common, 19.0.0.0.0...

Patching component oracle.oraolap.dbscripts, 19.0.0.0.0...

Patching component oracle.ldap.rsf.ic, 19.0.0.0.0...

Patching component oracle.install.deinstalltool, 19.0.0.0.0...

Patching component oracle.ldap.client, 19.0.0.0.0...

Patching component oracle.rdbms.rman, 19.0.0.0.0...

Patching component oracle.ovm, 19.0.0.0.0...

Patching component oracle.rdbms.drdaas, 19.0.0.0.0...

Patching component oracle.rdbms.hs_common, 19.0.0.0.0...

Patching component oracle.oraolap.api, 19.0.0.0.0...

Patching component oracle.network.listener, 19.0.0.0.0...

Patching component oracle.rdbms.dv, 19.0.0.0.0...

Patching component oracle.sdo.locator, 19.0.0.0.0...

Patching component oracle.nlsrtl.rsf, 19.0.0.0.0...

Patching component oracle.xdk.rsf, 19.0.0.0.0...

Patching component oracle.xdk, 19.0.0.0.0...

Patching component oracle.dbtoolslistener, 19.0.0.0.0...

Patching component oracle.rdbms.install.plugins, 19.0.0.0.0...

Patching component oracle.ldap.ssl, 19.0.0.0.0...

Patching component oracle.rdbms.lbac, 19.0.0.0.0...

Patching component oracle.mgw.common, 19.0.0.0.0...

Patching component oracle.precomp.lang, 19.0.0.0.0...

Patching component oracle.precomp.common, 19.0.0.0.0...

Patching component oracle.jdk, 1.8.0.201.0...

Patch 35042068 successfully applied.

Sub-set patch [29517242] has become inactive due to the application of a super-set patch [35042068].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /u01/app/oracle/product/19.0.0.0/dbhome_1/cfgtoollogs/opatch/opatch2023-11-08_13-04-59PM_1.log

OPatch succeeded.

[oracle@baprdg01 35042068]$

Tuesday, November 7, 2023

Oracle 19c (19.19.0.0.0) Grid Home Patching

--===Oracle 19c (19.19.0.0.0) Grid Home Patching ============

[root@baprdg01 ~]# cd /u01/app/19.0.0.0/grid/crs/install

[root@baprdg01 install]#

[root@baprdg01 install]# ./rootcrs.sh -prepatch

Using configuration parameter file: /u01/app/19.0.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

/u01/app/grid/crsdata/baprdg01/crsconfig/crs_prepatch_baprdg01_2023-11-06_04-44-42PM.log

2023/11/06 16:45:34 CLSRSC-4012: Shutting down Oracle Trace File Analyzer (TFA) Collector.

2023/11/06 16:47:13 CLSRSC-4013: Successfully shut down Oracle Trace File Analyzer (TFA) Collector.

2023/11/06 16:47:15 CLSRSC-347: Successfully unlock /u01/app/19.0.0.0/grid

2023/11/06 16:47:17 CLSRSC-671: Pre-patch steps for patching GI home successfully completed.

[root@baprdg01 install]#

[grid@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.17

OPatch succeeded.

[grid@baprdg01 OPatch]$

[grid@baprdg01 OPatch]$ ls -ld

drwxr-x--- 14 grid oinstall 4096 Nov 6 14:46 .

[grid@baprdg01 OPatch]$

--move OPatch Version: 12.2.0.1.17

[grid@baprdg01 OPatch]$ pwd

/u01/app/19.0.0.0/grid/OPatch

[grid@baprdg01 OPatch]$ cd ..

[grid@baprdg01 grid]$ mv OPatch/ bak_OPatch_6oct23

[grid@baprdg01 grid]$ ls -ltr

-- use OPatch Version: 12.2.0.1.33

[grid@baprdg01 grid]$ chmod -R 775 OPatch/

[grid@baprdg01 grid]$

[grid@baprdg01 grid]$ cd OPatch/

[grid@baprdg01 OPatch]$

[grid@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.33

OPatch succeeded.

[grid@baprdg01 OPatch]$

-- UNZIPPED_PATCH_LOCATION: /d01/soft/GI_Patch/35037840

[root@baprdg01 bin]# ./crsctl stop has

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'baprdg01'

CRS-2673: Attempting to stop 'ora.crsd' on 'baprdg01'

CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on server 'baprdg01'

CRS-33673: Attempting to stop resource group 'ora.asmgroup' on server 'baprdg01'

CRS-2673: Attempting to stop 'ora.OCRVOTE.dg' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.cvu' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.chad' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.qosmserver' on 'baprdg01'

CRS-2677: Stop of 'ora.cvu' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.OCRVOTE.dg' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'baprdg01'

CRS-2677: Stop of 'ora.asm' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.ASMNET1LSNR_ASM.lsnr' on 'baprdg01'

CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.scan1.vip' on 'baprdg01'

CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.scan3.vip' on 'baprdg01'

CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.baprdg01.vip' on 'baprdg01'

CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.scan2.vip' on 'baprdg01'

CRS-2677: Stop of 'ora.scan1.vip' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.scan3.vip' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.baprdg01.vip' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.scan2.vip' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.chad' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.ASMNET1LSNR_ASM.lsnr' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.asmnet1.asmnetwork' on 'baprdg01'

CRS-2677: Stop of 'ora.asmnet1.asmnetwork' on 'baprdg01' succeeded

CRS-33677: Stop of resource group 'ora.asmgroup' on server 'baprdg01' succeeded.

CRS-2677: Stop of 'ora.qosmserver' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.ons' on 'baprdg01'

CRS-2677: Stop of 'ora.ons' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.net1.network' on 'baprdg01'

CRS-2677: Stop of 'ora.net1.network' on 'baprdg01' succeeded

CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'baprdg01' has completed

CRS-2677: Stop of 'ora.crsd' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.crf' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'baprdg01'

CRS-2677: Stop of 'ora.crf' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.mdnsd' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.asm' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'baprdg01'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.evmd' on 'baprdg01'

CRS-2677: Stop of 'ora.ctssd' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.evmd' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'baprdg01'

CRS-2677: Stop of 'ora.cssd' on 'baprdg01' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'baprdg01'

CRS-2673: Attempting to stop 'ora.gpnpd' on 'baprdg01'

CRS-2677: Stop of 'ora.gpnpd' on 'baprdg01' succeeded

CRS-2677: Stop of 'ora.gipcd' on 'baprdg01' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'baprdg01' has completed

CRS-4133: Oracle High Availability Services has been stopped.

[root@baprdg01 bin]#

[root@baprdg01 bin]# cd

[root@baprdg01 ~]#

[grid@baprdg01 grid]$ cd OPatch/

[grid@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.39

OPatch succeeded.

[grid@baprdg01 OPatch]$

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35042068

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35050331

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35050325

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35107512

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/33575402

[grid@baprdg01 ~]$ /u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35042068

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-28-51PM_1.log

Verifying environment and performing prerequisite checks...

--------------------------------------------------------------------------------

Start OOP by Prereq process.

Launch OOP...

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-29-12PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 35042068

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u01/app/19.0.0.0/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '35042068' to OH '/u01/app/19.0.0.0/grid'

ApplySession: Optional component(s) [ oracle.ctx, 19.0.0.0.0 ] , [ oracle.dbdev, 19.0.0.0.0 ] , [ oracle.marvel, 19.0.0.0.0 ] , [ oracle.network.gsm, 19.0.0.0.0 ] , [ oracle.odbc.ic, 19.0.0.0.0 ] , [ oracle.precomp.common.core, 19.0.0.0.0 ] , [ oracle.rdbms.ic, 19.0.0.0.0 ] , [ oracle.rdbms.oci, 19.0.0.0.0 ] , [ oracle.rdbms.scheduler, 19.0.0.0.0 ] , [ oracle.rdbms.tg4db2, 19.0.0.0.0 ] , [ oracle.sdo, 19.0.0.0.0 ] , [ oracle.ons.cclient, 19.0.0.0.0 ] , [ oracle.network.cman, 19.0.0.0.0 ] , [ oracle.rdbms.tg4sybs, 19.0.0.0.0 ] , [ oracle.xdk.xquery, 19.0.0.0.0 ] , [ oracle.sdo.companion, 19.0.0.0.0 ] , [ oracle.rdbms.tg4ifmx, 19.0.0.0.0 ] , [ oracle.odbc, 19.0.0.0.0 ] , [ oracle.options.olap.api, 19.0.0.0.0 ] , [ oracle.oraolap, 19.0.0.0.0 ] , [ oracle.rdbms.hsodbc, 19.0.0.0.0 ] , [ oracle.ctx.atg, 19.0.0.0.0 ] , [ oracle.rdbms.tg4tera, 19.0.0.0.0 ] , [ oracle.oid.client, 19.0.0.0.0 ] , [ oracle.options.olap, 19.0.0.0.0 ] , [ oracle.rdbms.drdaas, 19.0.0.0.0 ] , [ oracle.ons.eons.bwcompat, 19.0.0.0.0 ] , [ oracle.rdbms.hs_common, 19.0.0.0.0 ] , [ oracle.oraolap.api, 19.0.0.0.0 ] , [ oracle.rdbms.dv, 19.0.0.0.0 ] , [ oracle.rdbms.tg4msql, 19.0.0.0.0 ] , [ oracle.xdk, 19.0.0.0.0 ] , [ oracle.net.cman, 19.0.0.0.0 ] , [ oracle.xdk.companion, 19.0.0.0.0 ] , [ oracle.rdbms.lbac, 19.0.0.0.0 ] , [ oracle.mgw.common, 19.0.0.0.0 ] , [ oracle.precomp.lang, 19.0.0.0.0 ] , [ oracle.precomp.common, 19.0.0.0.0 ] , [ oracle.jdk, 1.8.0.191.0 ] not present in the Oracle Home or a higher version is found.

Patching component oracle.rsf, 19.0.0.0.0...

Patching component oracle.nlsrtl.rsf.core, 19.0.0.0.0...

Patching component oracle.slax.rsf, 19.0.0.0.0...

Patching component oracle.ordim.jai, 19.0.0.0.0...

Patching component oracle.bali.jewt, 11.1.1.6.0...

Patching component oracle.bali.ewt, 11.1.1.6.0...

Patching component oracle.help.ohj, 11.1.1.7.0...

Patching component oracle.rdbms.locator, 19.0.0.0.0...

Patching component oracle.perlint.expat, 2.0.1.0.4...

Patching component oracle.rdbms.util, 19.0.0.0.0...

Patching component oracle.rdbms.rsf, 19.0.0.0.0...

Patching component oracle.rdbms, 19.0.0.0.0...

Patching component oracle.assistants.acf, 19.0.0.0.0...

Patching component oracle.assistants.deconfig, 19.0.0.0.0...

Patching component oracle.assistants.server, 19.0.0.0.0...

Patching component oracle.blaslapack, 19.0.0.0.0...

Patching component oracle.buildtools.rsf, 19.0.0.0.0...

Patching component oracle.dbjava.ic, 19.0.0.0.0...

Patching component oracle.dbjava.jdbc, 19.0.0.0.0...

Patching component oracle.dbjava.ucp, 19.0.0.0.0...

Patching component oracle.duma, 19.0.0.0.0...

Patching component oracle.javavm.client, 19.0.0.0.0...

Patching component oracle.ldap.owm, 19.0.0.0.0...

Patching component oracle.ldap.rsf, 19.0.0.0.0...

Patching component oracle.ldap.security.osdt, 19.0.0.0.0...

Patching component oracle.network.rsf, 19.0.0.0.0...

Patching component oracle.ons, 19.0.0.0.0...

Patching component oracle.ons.ic, 19.0.0.0.0...

Patching component oracle.oracore.rsf, 19.0.0.0.0...

Patching component oracle.perlint, 5.28.1.0.0...

Patching component oracle.precomp.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.crs, 19.0.0.0.0...

Patching component oracle.rdbms.dbscripts, 19.0.0.0.0...

Patching component oracle.rdbms.deconfig, 19.0.0.0.0...

Patching component oracle.rdbms.rsf.ic, 19.0.0.0.0...

Patching component oracle.rhp.db, 19.0.0.0.0...

Patching component oracle.sdo.locator.jrf, 19.0.0.0.0...

Patching component oracle.sqlplus, 19.0.0.0.0...

Patching component oracle.sqlplus.ic, 19.0.0.0.0...

Patching component oracle.tfa, 19.0.0.0.0...

Patching component oracle.wwg.plsql, 19.0.0.0.0...

Patching component oracle.javavm.server, 19.0.0.0.0...

Patching component oracle.xdk.parser.java, 19.0.0.0.0...

Patching component oracle.ctx.rsf, 19.0.0.0.0...

Patching component oracle.network.client, 19.0.0.0.0...

Patching component oracle.rdbms.install.common, 19.0.0.0.0...

Patching component oracle.oraolap.dbscripts, 19.0.0.0.0...

Patching component oracle.ldap.rsf.ic, 19.0.0.0.0...

Patching component oracle.install.deinstalltool, 19.0.0.0.0...

Patching component oracle.ldap.client, 19.0.0.0.0...

Patching component oracle.rdbms.rman, 19.0.0.0.0...

Patching component oracle.ovm, 19.0.0.0.0...

Patching component oracle.network.listener, 19.0.0.0.0...

Patching component oracle.sdo.locator, 19.0.0.0.0...

Patching component oracle.nlsrtl.rsf, 19.0.0.0.0...

Patching component oracle.xdk.rsf, 19.0.0.0.0...

Patching component oracle.dbtoolslistener, 19.0.0.0.0...

Patching component oracle.rdbms.install.plugins, 19.0.0.0.0...

Patching component oracle.ldap.ssl, 19.0.0.0.0...

Patching component oracle.jdk, 1.8.0.201.0...

Patch 35042068 successfully applied.

Sub-set patch [29517242] has become inactive due to the application of a super-set patch [35042068].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-29-12PM_1.log

OPatch succeeded.

[grid@baprdg01 ~]$

[grid@baprdg01 ~]$ /u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35050331

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-36-44PM_1.log

Verifying environment and performing prerequisite checks...

--------------------------------------------------------------------------------

Start OOP by Prereq process.

Launch OOP...

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-37-07PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 35050331

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u01/app/19.0.0.0/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '35050331' to OH '/u01/app/19.0.0.0/grid'

ApplySession: Optional component(s) [ oracle.has.db.cvu, 19.0.0.0.0 ] not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 19.0.0.0.0...

Patching component oracle.has.common, 19.0.0.0.0...

Patching component oracle.rhp.crs, 19.0.0.0.0...

Patching component oracle.has.cvu, 19.0.0.0.0...

Patching component oracle.has.crs.cvu, 19.0.0.0.0...

Patching component oracle.has.rsf, 19.0.0.0.0...

Patching component oracle.rhp.common, 19.0.0.0.0...

Patching component oracle.has.crs, 19.0.0.0.0...

Patching component oracle.has.common.cvu, 19.0.0.0.0...

Patching component oracle.has.db, 19.0.0.0.0...

Patching component oracle.rhp.db, 19.0.0.0.0...

Patching component oracle.xag, 19.0.0.0.0...

Patch 35050331 successfully applied.

Sub-set patch [29585399] has become inactive due to the application of a super-set patch [35050331].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-37-07PM_1.log

OPatch succeeded.

[grid@baprdg01 ~]$

[grid@baprdg01 ~]$ /u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35050325

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-38-46PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 35050325

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u01/app/19.0.0.0/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '35050325' to OH '/u01/app/19.0.0.0/grid'

Patching component oracle.usm, 19.0.0.0.0...

Patch 35050325 successfully applied.

Sub-set patch [29517247] has become inactive due to the application of a super-set patch [35050325].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-38-46PM_1.log

OPatch succeeded.

[grid@baprdg01 ~]$

[grid@baprdg01 ~]$ /u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35107512

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-40-29PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 35107512

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u01/app/19.0.0.0/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '35107512' to OH '/u01/app/19.0.0.0/grid'

Patching component oracle.tomcat.crs, 19.0.0.0.0...

Patch 35107512 successfully applied.

Sub-set patch [29401763] has become inactive due to the application of a super-set patch [35107512].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-40-29PM_1.log

OPatch succeeded.

[grid@baprdg01 ~]$

[grid@baprdg01 ~]$ /u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/33575402

Oracle Interim Patch Installer version 12.2.0.1.39

Oracle Home : /u01/app/19.0.0.0/grid

Central Inventory : /u01/app/oraInventory

from : /u01/app/19.0.0.0/grid/oraInst.loc

OPatch version : 12.2.0.1.39

OUI version : 12.2.0.7.0

Log file location : /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-42-27PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33575402

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/u01/app/19.0.0.0/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33575402' to OH '/u01/app/19.0.0.0/grid'

Patching component oracle.wlm.dbwlm, 19.0.0.0.0...

Patch 33575402 successfully applied.

Log file location: /u01/app/19.0.0.0/grid/cfgtoollogs/opatch/opatch2023-11-07_17-42-27PM_1.log

OPatch succeeded.

[grid@baprdg01 ~]$

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35042068

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35050331

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35050325

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/35107512

/u01/app/19.0.0.0/grid/OPatch/opatch apply -oh /u01/app/19.0.0.0/grid -local /d01/soft/GI_Patch/35037840/33575402

--== in case of patch rollback =======

[grid@baprdg01 ~]$/u01/app/19.0.0.0/grid/OPatch/opatch nrollback -id 35042068,35050331,35050325,35107512,33575402

--===end =============

--== Post patching ===

[root@baprdg01 bin]# /u01/app/19.0.0.0/grid/rdbms/install/rootadd_rdbms.sh

[root@baprdg01 bin]#

[root@baprdg01 bin]# /u01/app/19.0.0.0/grid/rdbms/install/rootadd_rdbms.sh

[root@baprdg01 bin]#

[root@baprdg01 bin]# /u01/app/19.0.0.0/grid/crs/install/rootcrs.sh -postpatch

Using configuration parameter file: /u01/app/19.0.0.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

/u01/app/grid/crsdata/baprdg01/crsconfig/crs_postpatch_apply_inplace_baprdg01_2023-11-08_10-47-39AM.log

2023/11/08 10:47:49 CLSRSC-329: Replacing Clusterware entries in file 'oracle-ohasd.service'

Oracle Clusterware active version on the cluster is [19.0.0.0.0]. The cluster upgrade state is [NORMAL]. The cluster active patch level is [526767740].

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'baprdg01'

CRS-2676: Start of 'ora.drivers.acfs' on 'baprdg01' succeeded

2023/11/08 10:49:34 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.

2023/11/08 10:49:35 CLSRSC-672: Post-patch steps for patching GI home successfully completed.

[root@baprdg01 bin]#

[root@baprdg01 bin]# /u01/app/19.0.0.0/grid/bin/crsctl stat res -t

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.LISTENER.lsnr

ONLINE ONLINE baprdg01 STABLE

ora.chad

ONLINE ONLINE baprdg01 STABLE

ora.net1.network

ONLINE ONLINE baprdg01 STABLE

ora.ons

ONLINE ONLINE baprdg01 STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)

1 ONLINE ONLINE baprdg01 STABLE

2 ONLINE OFFLINE STABLE

3 ONLINE OFFLINE STABLE

ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE baprdg01 STABLE

ora.LISTENER_SCAN2.lsnr

1 ONLINE ONLINE baprdg01 STABLE

ora.LISTENER_SCAN3.lsnr

1 ONLINE ONLINE baprdg01 STABLE

ora.OCRVOTE.dg(ora.asmgroup)

1 ONLINE ONLINE baprdg01 STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.asm(ora.asmgroup)

1 ONLINE ONLINE baprdg01 Started,STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.asmnet1.asmnetwork(ora.asmgroup)

1 ONLINE ONLINE baprdg01 STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.baprdg01.vip

1 ONLINE ONLINE baprdg01 STABLE

ora.cvu

1 ONLINE ONLINE baprdg01 STABLE

ora.qosmserver

1 ONLINE ONLINE baprdg01 STABLE

ora.scan1.vip

1 ONLINE ONLINE baprdg01 STABLE

ora.scan2.vip

1 ONLINE ONLINE baprdg01 STABLE

ora.scan3.vip

1 ONLINE ONLINE baprdg01 STABLE

--------------------------------------------------------------------------------

[root@baprdg01 bin]#

-=== in case of error ==

[root@baprdg01 ~]# /u01/app/19.0.0.0/grid/bin/crsctl start has

CRS-6706: Oracle Clusterware Release patch level ('2965637783') does not match Software patch level ('2676783881'). Oracle Clusterware cannot be started.

CRS-4000: Command Start failed, or completed with errors.

[root@baprdg01 ~]# /u01/app/19.0.0.0/grid/crs/install/roothas.sh -unlock

[root@baprdg01 ~]#/u01/app/19.0.0.0/grid/bin/clscfg -localpatch

[root@baprdg01 ~]#/u01/app/19.0.0.0/grid/crs/install/roothas.sh -lock

[root@baprdg01 ~]# /u01/app/19.0.0.0/grid/crs/install/roothas.sh -unlock

Using configuration parameter file: /d01/app/19c/grid/crs/install/crsconfig_params

The log of current session can be found at:

/d01/app/grid/crsdata/badbdr-test/crsconfig/haunlock__2022-12-12_11-23-59PM.log

2022/12/12 23:24:11 CLSRSC-347: Successfully unlock /d01/app/19c/grid

[root@baprdg01 ~]# /u01/app/19.0.0.0/grid/bin/clscfg -localpatch

clscfg: EXISTING configuration version 0 detected.

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

[root@baprdg01 ~]# /u01/app/19.0.0.0/grid/crs/install/roothas.sh -lock

Using configuration parameter file: /d01/app/19c/grid/crs/install/crsconfig_params

The log of current session can be found at:

/d01/app/grid/crsdata/badbdr-test/crsconfig/halock__2022-12-12_11-27-23PM.log

2022/12/12 23:27:26 CLSRSC-329: Replacing Clusterware entries in file '/etc/inittab'

root@badbdr-test:~# /d01/app/19c/grid/bin/crsctl start has

CRS-4123: Oracle High Availability Services has been started.

[root@baprdg01 ~]#

--====End ==

[grid@baprdg01 ~]$ sqlplus / as sysasm

SQL*Plus: Release 19.0.0.0.0 - Production on Wed Nov 8 10:58:52 2023

Version 19.19.0.0.0

Connected to:

Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Version 19.19.0.0.0

SQL>

Monday, November 6, 2023

Grid patching 19c

--==== grid patching =====

[grid@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.17

OPatch succeeded.

[grid@baprdg01 OPatch]$

[grid@baprdg01 OPatch]$ ls -ld

drwxr-x--- 14 grid oinstall 4096 Nov 6 14:46 .

[grid@baprdg01 OPatch]$

--move OPatch Version: 12.2.0.1.17

[grid@baprdg01 OPatch]$ pwd

/u01/app/19.0.0.0/grid/OPatch

[grid@baprdg01 OPatch]$ cd ..

[grid@baprdg01 grid]$ mv OPatch/ bak_OPatch_6oct23

[grid@baprdg01 grid]$ ls -ltr

-- use OPatch Version: 12.2.0.1.33

[grid@baprdg01 grid]$ chmod -R 775 OPatch/

[grid@baprdg01 grid]$

[grid@baprdg01 grid]$ cd OPatch/

[grid@baprdg01 OPatch]$

[grid@baprdg01 OPatch]$ ./opatch version

OPatch Version: 12.2.0.1.33

OPatch succeeded.

[grid@baprdg01 OPatch]$

/d01/app/19c/grid/OPatch

root@cbspr:/d01/app/19c/grid/crs/install# cd /d01/app/19c/grid/crs/install

root@cbspr:/d01/app/19c/grid/crs/install#

root@cbspr:/d01/app/19c/grid/crs/install# ./rootcrs.sh -prepatch

Using configuration parameter file: /d01/app/19c/grid/crs/install/crsconfig_params

The log of current session can be found at:

/d01/app/grid/crsdata/cbspr/crsconfig/crs_prepatch_cbspr_2023-05-28_02-41-09PM.log

2023/05/28 14:42:28 CLSRSC-4012: Shutting down Oracle Trace File Analyzer (TFA) Collector.

2023/05/28 14:43:15 CLSRSC-4013: Successfully shut down Oracle Trace File Analyzer (TFA) Collector.

2023/05/28 14:43:20 CLSRSC-347: Successfully unlock /d01/app/19c/grid

2023/05/28 14:43:24 CLSRSC-671: Pre-patch steps for patching GI home successfully completed.

root@cbspr:/d01/app/19c/grid/crs/install#

/d01/app/19c/grid/bin

root@cbspr:/d01/app/19c/grid/bin#

root@cbspr:/d01/app/19c/grid/bin# ./crsctl stop has

CRS-4639: Could not contact Oracle High Availability Services

CRS-4000: Command Stop failed, or completed with errors.

root@cbspr:/d01/app/19c/grid/bin#

/d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33515361

grid@cbspr:~$ /d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33515361

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-47-53PM_1.log

Verifying environment and performing prerequisite checks...

--------------------------------------------------------------------------------

Start OOP by Prereq process.

Launch OOP...

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-48-17PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33515361

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/d01/app/19c/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33515361' to OH '/d01/app/19c/grid'

ApplySession: Optional component(s) [ oracle.ctx, 19.0.0.0.0 ] , [ oracle.marvel, 19.0.0.0.0 ] , [ oracle.network.gsm, 19.0.0.0.0 ] , [ oracle.odbc.ic, 19.0.0.0.0 ] , [ oracle.precomp.common.core, 19.0.0.0.0 ] , [ oracle.rdbms.ic, 19.0.0.0.0 ] , [ oracle.rdbms.oci, 19.0.0.0.0 ] , [ oracle.rdbms.tg4db2, 19.0.0.0.0 ] , [ oracle.sdo, 19.0.0.0.0 ] , [ oracle.rdbms.drdaas, 19.0.0.0.0 ] , [ oracle.options.olap.api, 19.0.0.0.0 ] , [ oracle.xdk.xquery, 19.0.0.0.0 ] , [ oracle.rdbms.hsodbc, 19.0.0.0.0 ] , [ oracle.ons.cclient, 19.0.0.0.0 ] , [ oracle.network.cman, 19.0.0.0.0 ] , [ oracle.odbc, 19.0.0.0.0 ] , [ oracle.rdbms.tg4sybs, 19.0.0.0.0 ] , [ oracle.rdbms.lbac, 19.0.0.0.0 ] , [ oracle.rdbms.tg4msql, 19.0.0.0.0 ] , [ oracle.oraolap.api, 19.0.0.0.0 ] , [ oracle.rdbms.dv, 19.0.0.0.0 ] , [ oracle.rdbms.tg4ifmx, 19.0.0.0.0 ] , [ oracle.oid.client, 19.0.0.0.0 ] , [ oracle.rdbms.tg4tera, 19.0.0.0.0 ] , [ oracle.ctx.atg, 19.0.0.0.0 ] , [ oracle.net.cman, 19.0.0.0.0 ] , [ oracle.dbdev, 19.0.0.0.0 ] , [ oracle.mgw.common, 19.0.0.0.0 ] , [ oracle.oraolap, 19.0.0.0.0 ] , [ oracle.xdk, 19.0.0.0.0 ] , [ oracle.rdbms.scheduler, 19.0.0.0.0 ] , [ oracle.xdk.companion, 19.0.0.0.0 ] , [ oracle.rdbms.hs_common, 19.0.0.0.0 ] , [ oracle.ons.eons.bwcompat, 19.0.0.0.0 ] , [ oracle.options.olap, 19.0.0.0.0 ] , [ oracle.precomp.common, 19.0.0.0.0 ] , [ oracle.precomp.lang, 19.0.0.0.0 ] , [ oracle.jdk, 1.8.0.191.0 ] not present in the Oracle Home or a higher version is found.

Patching component oracle.help.ohj, 11.1.1.7.0...

Patching component oracle.perlint, 5.28.1.0.0...

Patching component oracle.rdbms.locator, 19.0.0.0.0...

Patching component oracle.perlint.expat, 2.0.1.0.4...

Patching component oracle.rdbms.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.util, 19.0.0.0.0...

Patching component oracle.rdbms, 19.0.0.0.0...

Patching component oracle.assistants.acf, 19.0.0.0.0...

Patching component oracle.assistants.deconfig, 19.0.0.0.0...

Patching component oracle.assistants.server, 19.0.0.0.0...

Patching component oracle.buildtools.rsf, 19.0.0.0.0...

Patching component oracle.dbjava.ic, 19.0.0.0.0...

Patching component oracle.dbjava.jdbc, 19.0.0.0.0...

Patching component oracle.dbjava.ucp, 19.0.0.0.0...

Patching component oracle.duma, 19.0.0.0.0...

Patching component oracle.javavm.client, 19.0.0.0.0...

Patching component oracle.ldap.owm, 19.0.0.0.0...

Patching component oracle.ldap.rsf, 19.0.0.0.0...

Patching component oracle.ldap.security.osdt, 19.0.0.0.0...

Patching component oracle.network.rsf, 19.0.0.0.0...

Patching component oracle.oracore.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.dbscripts, 19.0.0.0.0...

Patching component oracle.rdbms.deconfig, 19.0.0.0.0...

Patching component oracle.rhp.db, 19.0.0.0.0...

Patching component oracle.sdo.locator.jrf, 19.0.0.0.0...

Patching component oracle.sqlplus, 19.0.0.0.0...

Patching component oracle.sqlplus.rsf, 19.0.0.0.0...

Patching component oracle.sqlplus.ic, 19.0.0.0.0...

Patching component oracle.tfa, 19.0.0.0.0...

Patching component oracle.wwg.plsql, 19.0.0.0.0...

Patching component oracle.rdbms.crs, 19.0.0.0.0...

Patching component oracle.network.client, 19.0.0.0.0...

Patching component oracle.javavm.server, 19.0.0.0.0...

Patching component oracle.rdbms.rman, 19.0.0.0.0...

Patching component oracle.xdk.rsf, 19.0.0.0.0...

Patching component oracle.precomp.rsf, 19.0.0.0.0...

Patching component oracle.ldap.ssl, 19.0.0.0.0...

Patching component oracle.ons, 19.0.0.0.0...

Patching component oracle.ovm, 19.0.0.0.0...

Patching component oracle.ldap.client, 19.0.0.0.0...

Patching component oracle.ons.ic, 19.0.0.0.0...

Patching component oracle.oraolap.dbscripts, 19.0.0.0.0...

Patching component oracle.ctx.rsf, 19.0.0.0.0...

Patching component oracle.sdo.locator, 19.0.0.0.0...

Patching component oracle.rdbms.install.common, 19.0.0.0.0...

Patching component oracle.rdbms.install.plugins, 19.0.0.0.0...

Patching component oracle.xdk.parser.java, 19.0.0.0.0...

Patching component oracle.dbtoolslistener, 19.0.0.0.0...

Patching component oracle.ldap.rsf.ic, 19.0.0.0.0...

Patching component oracle.network.listener, 19.0.0.0.0...

Patching component oracle.nlsrtl.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.rsf.ic, 19.0.0.0.0...

Patching component oracle.jdk, 1.8.0.201.0...

Patch 33515361 successfully applied.

Sub-set patch [29517242] has become inactive due to the application of a super-set patch [33515361].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-48-17PM_1.log

OPatch succeeded.

grid@cbspr:~$

/d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33529556

grid@cbspr:~$ /d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33529556

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-54-08PM_1.log

Verifying environment and performing prerequisite checks...

--------------------------------------------------------------------------------

Start OOP by Prereq process.

Launch OOP...

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-54-32PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33529556

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/d01/app/19c/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33529556' to OH '/d01/app/19c/grid'

ApplySession: Optional component(s) [ oracle.has.db.cvu, 19.0.0.0.0 ] not present in the Oracle Home or a higher version is found.

Patching component oracle.rdbms, 19.0.0.0.0...

Patching component oracle.rhp.db, 19.0.0.0.0...

Patching component oracle.has.common, 19.0.0.0.0...

Patching component oracle.has.rsf, 19.0.0.0.0...

Patching component oracle.has.crs, 19.0.0.0.0...

Patching component oracle.xag, 19.0.0.0.0...

Patching component oracle.has.crs.cvu, 19.0.0.0.0...

Patching component oracle.has.cvu, 19.0.0.0.0...

Patching component oracle.has.db, 19.0.0.0.0...

Patching component oracle.rhp.common, 19.0.0.0.0...

Patching component oracle.rhp.crs, 19.0.0.0.0...

Patching component oracle.has.common.cvu, 19.0.0.0.0...

Patch 33529556 successfully applied.

Sub-set patch [29585399] has become inactive due to the application of a super-set patch [33529556].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-54-32PM_1.log

OPatch succeeded.

grid@cbspr:~$

/d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33534448

grid@cbspr:~$ /d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33534448

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-58-26PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33534448

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/d01/app/19c/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33534448' to OH '/d01/app/19c/grid'

Patching component oracle.usm, 19.0.0.0.0...

Patch 33534448 successfully applied.

Sub-set patch [29517247] has become inactive due to the application of a super-set patch [33534448].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-58-26PM_1.log

OPatch succeeded.

grid@cbspr:~$

/d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33239955

grid@cbspr:~$ /d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33239955

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-59-37PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33239955

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/d01/app/19c/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33239955' to OH '/d01/app/19c/grid'

Patching component oracle.tomcat.crs, 19.0.0.0.0...

Patch 33239955 successfully applied.

Sub-set patch [29401763] has become inactive due to the application of a super-set patch [33239955].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_14-59-37PM_1.log

OPatch succeeded.

/d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33575402

grid@cbspr:~$ /d01/app/19c/grid/OPatch/opatch apply -oh /d01/app/19c/grid -local /d01/soft/gpatch/33509923/33575402

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/19c/grid

Central Inventory : /d01/app/oraInventory

from : /d01/app/19c/grid/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_15-00-31PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33575402

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/d01/app/19c/grid')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33575402' to OH '/d01/app/19c/grid'

Patching component oracle.wlm.dbwlm, 19.0.0.0.0...

Patch 33575402 successfully applied.

Log file location: /d01/app/19c/grid/cfgtoollogs/opatch/opatch2023-05-28_15-00-31PM_1.log

OPatch succeeded.

grid@cbspr:~$

root@cbspr:~#

root@cbspr:~# /d01/app/19c/grid/rdbms/install/rootadd_rdbms.sh

root@cbspr:~#

root@cbspr:~# /d01/app/19c/grid/crs/install/rootcrs.sh -postpatch

Using configuration parameter file: /d01/app/19c/grid/crs/install/crsconfig_params

The log of current session can be found at:

/d01/app/grid/crsdata/cbspr/crsconfig/crs_postpatch_apply_inplace_cbspr_2023-05-28_03-02-55PM.log

2023/05/28 15:03:12 CLSRSC-329: Replacing Clusterware entries in file '/etc/inittab'

Oracle Clusterware active version on the cluster is [19.0.0.0.0]. The cluster upgrade state is [NORMAL]. The cluster active patch level is [2965637783].

SQL Patching tool version 19.14.0.0.0 Production on Sun May 28 15:06:37 2023

Log file for this invocation: /d01/app/grid/cfgtoollogs/sqlpatch/sqlpatch_48269_2023_05_28_15_06_37/sqlpatch_invocation.log

Connecting to database...OK

Gathering database info...done

Note: Datapatch will only apply or rollback SQL fixes for PDBs

that are in an open state, no patches will be applied to closed PDBs.

Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation

(Doc ID 1585822.1)

Bootstrapping registry and package to current versions...done

Determining current state...done

Current state of interim SQL patches:

No interim patches found

Current state of release update SQL patches:

Binary registry:

19.14.0.0.0 Release_Update 211229021203: Installed

PDB CDB$ROOT:

Applied 19.3.0.0.0 Release_Update 190410122720 successfully on 28-MAY-23 12.54.05.778045 PM

PDB GIMR_DSCREP_10:

Applied 19.3.0.0.0 Release_Update 190410122720 successfully on 28-MAY-23 01.03.25.354752 PM

PDB PDB$SEED:

Applied 19.3.0.0.0 Release_Update 190410122720 successfully on 28-MAY-23 01.03.25.354752 PM

Adding patches to installation queue and performing prereq checks...done

Installation queue:

For the following PDBs: CDB$ROOT PDB$SEED GIMR_DSCREP_10

No interim patches need to be rolled back

Patch 33515361 (Database Release Update : 19.14.0.0.220118 (33515361)):

Apply from 19.3.0.0.0 Release_Update 190410122720 to 19.14.0.0.0 Release_Update 211229021203

No interim patches need to be applied

Installing patches...

Patch installation complete. Total patches installed: 3

Validating logfiles...done

Patch 33515361 apply (pdb CDB$ROOT): SUCCESS

logfile: /d01/app/grid/cfgtoollogs/sqlpatch/33515361/24574896/33515361_apply__MGMTDB_CDBROOT_2023May28_15_07_29.log (no errors)

Patch 33515361 apply (pdb PDB$SEED): SUCCESS

logfile: /d01/app/grid/cfgtoollogs/sqlpatch/33515361/24574896/33515361_apply__MGMTDB_PDBSEED_2023May28_15_12_14.log (no errors)

Patch 33515361 apply (pdb GIMR_DSCREP_10): SUCCESS

logfile: /d01/app/grid/cfgtoollogs/sqlpatch/33515361/24574896/33515361_apply__MGMTDB_GIMR_DSCREP_10_2023May28_15_12_14.log (no errors)

Automatic recompilation incomplete; run utlrp.sql to revalidate.

PDBs: GIMR_DSCREP_10 PDB$SEED

SQL Patching tool complete on Sun May 28 15:23:20 2023

2023/05/28 15:24:46 CLSRSC-4015: Performing install or upgrade action for Oracle Trace File Analyzer (TFA) Collector.

2023/05/28 15:24:48 CLSRSC-672: Post-patch steps for patching GI home successfully completed.

root@cbspr:~# 2023/05/28 15:26:47 CLSRSC-4003: Successfully patched Oracle Trace File Analyzer (TFA) Collector.

root@cbspr:~#

root@cbspr:~# /d01/app/19c/grid/bin/crsctl stat res -t

--------------------------------------------------------------------------------

Name Target State Server State details

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.LISTENER.lsnr

ONLINE ONLINE cbspr STABLE

ora.MGMT.GHCHKPT.advm

OFFLINE OFFLINE cbspr STABLE

ora.helper

OFFLINE OFFLINE cbspr IDLE,STABLE

ora.mgmt.ghchkpt.acfs

OFFLINE OFFLINE cbspr STABLE

ora.net1.network

ONLINE ONLINE cbspr STABLE

ora.ons

ONLINE ONLINE cbspr STABLE

ora.proxy_advm

ONLINE ONLINE cbspr STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 ONLINE OFFLINE STABLE

3 ONLINE OFFLINE STABLE

ora.CDATA.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.FRA.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.LISTENER_SCAN1.lsnr

1 ONLINE ONLINE cbspr STABLE

ora.MGMT.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.MGMTLSNR

1 ONLINE ONLINE cbspr 169.254.30.116 10.64

.130.42,STABLE

ora.OCRVOTE.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.REDO1.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.REDO2.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.REDO3.dg(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.asm(ora.asmgroup)

1 ONLINE ONLINE cbspr Started,STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.asmnet1.asmnetwork(ora.asmgroup)

1 ONLINE ONLINE cbspr STABLE

2 OFFLINE OFFLINE STABLE

3 OFFLINE OFFLINE STABLE

ora.cbspr.vip

1 ONLINE ONLINE cbspr STABLE

ora.cvu

1 ONLINE ONLINE cbspr STABLE

ora.mgmtdb

1 ONLINE ONLINE cbspr Open,STABLE

ora.qosmserver

1 ONLINE ONLINE cbspr STABLE

ora.rhpserver

1 OFFLINE OFFLINE STABLE

ora.scan1.vip

1 ONLINE ONLINE cbspr STABLE

--------------------------------------------------------------------------------

root@cbspr:~#

grid@cbspr:~$ cd $ORACLE_HOME/OPatch

grid@cbspr:/d01/app/19c/grid/OPatch$

grid@cbspr:/d01/app/19c/grid/OPatch$ ./opatch lspatches

33575402;DBWLM RELEASE UPDATE 19.0.0.0.0 (33575402)

33239955;TOMCAT RELEASE UPDATE 19.0.0.0.0 (33239955)

33534448;ACFS RELEASE UPDATE 19.14.0.0.0 (33534448)

33529556;OCW RELEASE UPDATE 19.14.0.0.0 (33529556)

33515361;Database Release Update : 19.14.0.0.220118 (33515361)

OPatch succeeded.

grid@cbspr:/d01/app/19c/grid/OPatch$

-=== in case of error ==

root@badbdr-test:~# /d01/app/19c/grid/bin/crsctl start has

CRS-6706: Oracle Clusterware Release patch level ('2965637783') does not match Software patch level ('2676783881'). Oracle Clusterware cannot be started.

CRS-4000: Command Start failed, or completed with errors.

root@badbdr-test:~# /d01/app/19c/grid/crs/install/roothas.sh -unlock

Using configuration parameter file: /d01/app/19c/grid/crs/install/crsconfig_params

The log of current session can be found at:

/d01/app/grid/crsdata/badbdr-test/crsconfig/haunlock__2022-12-12_11-23-59PM.log

2022/12/12 23:24:11 CLSRSC-347: Successfully unlock /d01/app/19c/grid

root@badbdr-test:~# /d01/app/19c/grid/bin/clscfg -localpatch

clscfg: EXISTING configuration version 0 detected.

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

root@badbdr-test:~# /d01/app/19c/grid/crs/install/roothas.sh -lock

Using configuration parameter file: /d01/app/19c/grid/crs/install/crsconfig_params

The log of current session can be found at:

/d01/app/grid/crsdata/badbdr-test/crsconfig/halock__2022-12-12_11-27-23PM.log

2022/12/12 23:27:26 CLSRSC-329: Replacing Clusterware entries in file '/etc/inittab'

root@badbdr-test:~# /d01/app/19c/grid/bin/crsctl start has

CRS-4123: Oracle High Availability Services has been started.

root@badbdr-test:~#

--=== oracle patching ===

root@cbspr:/d01/app/oracle/product/19c/db_1# mv OPatch OPatch_28may23

root@cbspr:/d01/app/oracle/product/19c/db_1#

-bash-5.1$ scp -r OPatch root@10.11.1.131:/d01/app/oracle/product/19c/db_1/

Password:

oot@cbspr:/d01/app/oracle/product/19c/db_1# chown -R oracle:oinstall OPatch

root@cbspr:/d01/app/oracle/product/19c/db_1# chmod -R 775 OPatch

root@cbspr:/d01/app/oracle/product/19c/db_1#

root@cbspr:/d01/app/oracle/product/19c/db_1# cd OPatch

root@cbspr:/d01/app/oracle/product/19c/db_1/OPatch# ls -ld

drwxrwxr-x 15 oracle oinstall 29 May 28 15:43 .

root@cbspr:/d01/app/oracle/product/19c/db_1/OPatch#

/d01/app/oracle/product/19c/db_1/OPatch

unzip p6880880_210000_SOLARIS64.zip in Oracle home [/d01/app/oracle/product/19c/db_1]

--- create database through DBCA

-- then connect ==

oracle@cbspr:~$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Sun May 28 17:58:50 2023

Version 19.3.0.0.0

Connected to:

Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production

Version 19.3.0.0.0

SQL>

SQL> conn c##cbsowner/Ba#2021#Core#131

Connected.

SQL>

SQL> grant DV_PATCH_ADMIN to sys container=all;

Grant succeeded.

SQL>

oracle@cbspr:~$

oracle@cbspr:~$ /d01/app/oracle/product/19c/db_1/OPatch/opatch version

OPatch Version: 12.2.0.1.28

OPatch succeeded.

oracle@cbspr:~$

oracle@cbspr:~$ srvctl stop scan_listener

oracle@cbspr:~$

oracle@cbspr:~$ srvctl stop listener

oracle@cbspr:~$

oracle@cbspr:~$ srvctl stop database -d cbsdb

oracle@cbspr:~$

oracle@cbspr:~$ cd /d01/soft/gpatch/

oracle@cbspr:/d01/soft/gpatch$ ls

33509923 p33509923_190000_SOLARIS64.zip PatchSearch.xml

oracle@cbspr:/d01/soft/gpatch$

oracle@cbspr:/d01/soft/gpatch$ cd 33509923/

oracle@cbspr:/d01/soft/gpatch/33509923$ ls

33239955 33515361 33529556 33534448 33575402 automation bundle.xml README.html README.txt

oracle@cbspr:/d01/soft/gpatch/33509923$ cd 33515361

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$ pwd

/d01/soft/gpatch/33509923/33515361

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:~$ cd /d01/soft/gpatch/

oracle@cbspr:/d01/soft/gpatch$ ls

33509923 p33509923_190000_SOLARIS64.zip PatchSearch.xml

oracle@cbspr:/d01/soft/gpatch$

oracle@cbspr:/d01/soft/gpatch$ cd 33509923/

oracle@cbspr:/d01/soft/gpatch/33509923$ ls

33239955 33515361 33529556 33534448 33575402 automation bundle.xml README.html README.txt

oracle@cbspr:/d01/soft/gpatch/33509923$ cd 33515361

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$ pwd

/d01/soft/gpatch/33509923/33515361

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$ pwd

/d01/soft/gpatch/33509923/33515361

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$ cd

oracle@cbspr:~$

oracle@cbspr:~$ cd $ORACLE_HOME/OPatch

oracle@cbspr:/d01/app/oracle/product/19c/db_1/OPatch$ pwd

/d01/app/oracle/product/19c/db_1/OPatch

oracle@cbspr:/d01/app/oracle/product/19c/db_1/OPatch$

oracle@cbspr:/d01/app/oracle/product/19c/db_1/OPatch$ cd /d01/soft/gpatch/33509923/33515361

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$ /d01/app/oracle/product/19c/db_1/OPatch/opatch apply

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/oracle/product/19c/db_1

Central Inventory : /d01/app/oraInventory

from : /d01/app/oracle/product/19c/db_1/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/oracle/product/19c/db_1/cfgtoollogs/opatch/opatch2023-05-28_18-06-31PM_1.log

Verifying environment and performing prerequisite checks...

--------------------------------------------------------------------------------

Start OOP by Prereq process.

Launch OOP...

Oracle Interim Patch Installer version 12.2.0.1.28

Oracle Home : /d01/app/oracle/product/19c/db_1

Central Inventory : /d01/app/oraInventory

from : /d01/app/oracle/product/19c/db_1/oraInst.loc

OPatch version : 12.2.0.1.28

OUI version : 12.2.0.7.0

Log file location : /d01/app/oracle/product/19c/db_1/cfgtoollogs/opatch/opatch2023-05-28_18-07-00PM_1.log

Verifying environment and performing prerequisite checks...

OPatch continues with these patches: 33515361

Do you want to proceed? [y|n]

User Responded with: Y

All checks passed.

Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.

(Oracle Home = '/d01/app/oracle/product/19c/db_1')

Is the local system ready for patching? [y|n]

User Responded with: Y

Backing up files...

Applying interim patch '33515361' to OH '/d01/app/oracle/product/19c/db_1'

ApplySession: Optional component(s) [ oracle.network.gsm, 19.0.0.0.0 ] , [ oracle.rdbms.ic, 19.0.0.0.0 ] , [ oracle.rdbms.tg4db2, 19.0.0.0.0 ] , [ oracle.tfa, 19.0.0.0.0 ] , [ oracle.options.olap.api, 19.0.0.0.0 ] , [ oracle.ons.cclient, 19.0.0.0.0 ] , [ oracle.network.cman, 19.0.0.0.0 ] , [ oracle.rdbms.tg4sybs, 19.0.0.0.0 ] , [ oracle.rdbms.tg4msql, 19.0.0.0.0 ] , [ oracle.rdbms.tg4ifmx, 19.0.0.0.0 ] , [ oracle.oid.client, 19.0.0.0.0 ] , [ oracle.rdbms.tg4tera, 19.0.0.0.0 ] , [ oracle.net.cman, 19.0.0.0.0 ] , [ oracle.xdk.companion, 19.0.0.0.0 ] , [ oracle.ons.eons.bwcompat, 19.0.0.0.0 ] , [ oracle.options.olap, 19.0.0.0.0 ] , [ oracle.jdk, 1.8.0.191.0 ] not present in the Oracle Home or a higher version is found.

Patching component oracle.help.ohj, 11.1.1.7.0...

Patching component oracle.perlint, 5.28.1.0.0...

Patching component oracle.rdbms.locator, 19.0.0.0.0...

Patching component oracle.perlint.expat, 2.0.1.0.4...

Patching component oracle.rdbms.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.util, 19.0.0.0.0...

Patching component oracle.rdbms, 19.0.0.0.0...

Patching component oracle.assistants.acf, 19.0.0.0.0...

Patching component oracle.assistants.deconfig, 19.0.0.0.0...

Patching component oracle.assistants.server, 19.0.0.0.0...

Patching component oracle.buildtools.rsf, 19.0.0.0.0...

Patching component oracle.ctx, 19.0.0.0.0...

Patching component oracle.dbjava.ic, 19.0.0.0.0...

Patching component oracle.dbjava.jdbc, 19.0.0.0.0...

Patching component oracle.dbjava.ucp, 19.0.0.0.0...

Patching component oracle.duma, 19.0.0.0.0...

Patching component oracle.javavm.client, 19.0.0.0.0...

Patching component oracle.ldap.owm, 19.0.0.0.0...

Patching component oracle.ldap.rsf, 19.0.0.0.0...

Patching component oracle.ldap.security.osdt, 19.0.0.0.0...

Patching component oracle.marvel, 19.0.0.0.0...

Patching component oracle.network.rsf, 19.0.0.0.0...

Patching component oracle.odbc.ic, 19.0.0.0.0...

Patching component oracle.oracore.rsf, 19.0.0.0.0...

Patching component oracle.precomp.common.core, 19.0.0.0.0...

Patching component oracle.rdbms.dbscripts, 19.0.0.0.0...

Patching component oracle.rdbms.deconfig, 19.0.0.0.0...

Patching component oracle.rdbms.oci, 19.0.0.0.0...

Patching component oracle.rhp.db, 19.0.0.0.0...

Patching component oracle.sdo, 19.0.0.0.0...

Patching component oracle.sdo.locator.jrf, 19.0.0.0.0...

Patching component oracle.sqlplus, 19.0.0.0.0...

Patching component oracle.sqlplus.rsf, 19.0.0.0.0...

Patching component oracle.sqlplus.ic, 19.0.0.0.0...

Patching component oracle.wwg.plsql, 19.0.0.0.0...

Patching component oracle.rdbms.crs, 19.0.0.0.0...

Patching component oracle.rdbms.drdaas, 19.0.0.0.0...

Patching component oracle.xdk.xquery, 19.0.0.0.0...

Patching component oracle.network.client, 19.0.0.0.0...

Patching component oracle.javavm.server, 19.0.0.0.0...

Patching component oracle.rdbms.rman, 19.0.0.0.0...

Patching component oracle.xdk.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.hsodbc, 19.0.0.0.0...

Patching component oracle.odbc, 19.0.0.0.0...

Patching component oracle.precomp.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.lbac, 19.0.0.0.0...

Patching component oracle.oraolap.api, 19.0.0.0.0...

Patching component oracle.rdbms.dv, 19.0.0.0.0...

Patching component oracle.ldap.ssl, 19.0.0.0.0...

Patching component oracle.ons, 19.0.0.0.0...

Patching component oracle.ovm, 19.0.0.0.0...

Patching component oracle.ctx.atg, 19.0.0.0.0...

Patching component oracle.dbdev, 19.0.0.0.0...

Patching component oracle.mgw.common, 19.0.0.0.0...

Patching component oracle.ldap.client, 19.0.0.0.0...

Patching component oracle.ons.ic, 19.0.0.0.0...

Patching component oracle.oraolap, 19.0.0.0.0...

Patching component oracle.oraolap.dbscripts, 19.0.0.0.0...

Patching component oracle.ctx.rsf, 19.0.0.0.0...

Patching component oracle.sdo.locator, 19.0.0.0.0...

Patching component oracle.rdbms.install.common, 19.0.0.0.0...

Patching component oracle.xdk, 19.0.0.0.0...

Patching component oracle.rdbms.install.plugins, 19.0.0.0.0...

Patching component oracle.xdk.parser.java, 19.0.0.0.0...

Patching component oracle.rdbms.scheduler, 19.0.0.0.0...

Patching component oracle.rdbms.hs_common, 19.0.0.0.0...

Patching component oracle.dbtoolslistener, 19.0.0.0.0...

Patching component oracle.ldap.rsf.ic, 19.0.0.0.0...

Patching component oracle.network.listener, 19.0.0.0.0...

Patching component oracle.nlsrtl.rsf, 19.0.0.0.0...

Patching component oracle.rdbms.rsf.ic, 19.0.0.0.0...

Patching component oracle.precomp.common, 19.0.0.0.0...

Patching component oracle.precomp.lang, 19.0.0.0.0...

Patching component oracle.jdk, 1.8.0.201.0...

Patch 33515361 successfully applied.

Sub-set patch [29517242] has become inactive due to the application of a super-set patch [33515361].

Please refer to Doc ID 2161861.1 for any possible further required actions.

Log file location: /d01/app/oracle/product/19c/db_1/cfgtoollogs/opatch/opatch2023-05-28_18-07-00PM_1.log

OPatch succeeded.

oracle@cbspr:/d01/soft/gpatch/33509923/33515361$

oracle@cbspr:~$ /d01/app/oracle/product/19c/db_1/OPatch

-bash: /d01/app/oracle/product/19c/db_1/OPatch: Is a directory

oracle@cbspr:~$

oracle@cbspr:~$ cd /d01/app/oracle/product/19c/db_1/OPatch

oracle@cbspr:/d01/app/oracle/product/19c/db_1/OPatch$

oracle@cbspr:/d01/app/oracle/product/19c/db_1/OPatch$ ./datapatch -verbose

SQL Patching tool version 19.14.0.0.0 Production on Mon May 29 10:11:54 2023

Log file for this invocation: /d01/app/oracle/cfgtoollogs/sqlpatch/sqlpatch_21728_2023_05_29_10_11_54/sqlpatch_invocation.log

Connecting to database...OK

Gathering database info...done

Note: Datapatch will only apply or rollback SQL fixes for PDBs

that are in an open state, no patches will be applied to closed PDBs.

Please refer to Note: Datapatch: Database 12c Post Patch SQL Automation

(Doc ID 1585822.1)

Bootstrapping registry and package to current versions...done

Determining current state...done

Current state of interim SQL patches:

No interim patches found

Current state of release update SQL patches:

Binary registry:

19.14.0.0.0 Release_Update 211229021203: Installed

PDB CDB$ROOT:

Applied 19.3.0.0.0 Release_Update 190410122720 successfully on 28-MAY-23 05.29.47.087320 PM

PDB PDB$SEED:

Applied 19.3.0.0.0 Release_Update 190410122720 successfully on 28-MAY-23 05.40.31.105263 PM

PDB STLBAS:

Applied 19.3.0.0.0 Release_Update 190410122720 successfully on 28-MAY-23 05.40.31.105263 PM

Adding patches to installation queue and performing prereq checks...done

Installation queue:

For the following PDBs: CDB$ROOT PDB$SEED STLBAS

No interim patches need to be rolled back

Patch 33515361 (Database Release Update : 19.14.0.0.220118 (33515361)):

Apply from 19.3.0.0.0 Release_Update 190410122720 to 19.14.0.0.0 Release_Update 211229021203

No interim patches need to be applied

Installing patches...

Patch installation complete. Total patches installed: 3

Validating logfiles...done

Patch 33515361 apply (pdb CDB$ROOT): SUCCESS

logfile: /d01/app/oracle/cfgtoollogs/sqlpatch/33515361/24574896/33515361_apply_CBSDB_CDBROOT_2023May29_10_12_49.log (no errors)

Patch 33515361 apply (pdb PDB$SEED): SUCCESS

logfile: /d01/app/oracle/cfgtoollogs/sqlpatch/33515361/24574896/33515361_apply_CBSDB_PDBSEED_2023May29_10_20_05.log (no errors)

Patch 33515361 apply (pdb STLBAS): SUCCESS

logfile: /d01/app/oracle/cfgtoollogs/sqlpatch/33515361/24574896/33515361_apply_CBSDB_STLBAS_2023May29_10_20_05.log (no errors)

Automatic recompilation incomplete; run utlrp.sql to revalidate.

PDBs: PDB$SEED STLBAS

SQL Patching tool complete on Mon May 29 10:26:28 2023

oracle@cbspr:/d01/app/oracle/product/19c/db_1/OPatch$

Pages

Monday, March 3, 2025

Problem Key 'ORA 1578' was completely flood controlled (0x2)

Sunday, March 2, 2025

Resolving Gaps In Data Guard Using Incremental Rman Backup

Wednesday, November 8, 2023

Oracle 19c (19.19.0.0) Oracle Home Patching

Tuesday, November 7, 2023

Oracle 19c (19.19.0.0.0) Grid Home Patching

Monday, November 6, 2023

Grid patching 19c