How to Patch Oracle 19c to Release 19.30 on Windows – A Complete Step-by-Step Blog

 

As soon as  Oracle released quarterly patch for Jan 2026 , I had to patch one of my Oracle 19c databases from 19.25 to 19.30. Since this is something we DBAs do almost on every quarter, I decided to write down the exact steps I followed. The procedures are the same for all 19c versions.

Note: On production systems, always apply on test/dev first. Never patch production directly without testing!

Prerequisites

• Oracle 19c database installed on Linux x86-64
• Access to Oracle Support (MOS account)
• OS user with ORACLE_HOME and ORACLE_BASE permissions
• At least 12 GB free disk space in /home
• WinSCP or similar tool to transfer files to the server
• Scheduled maintenance window (database downtime required)

 

Step 1: Download the Patch and OPatch Utility

Log in to Oracle Support and download the following:

• Patch file: 38597735 → p38597735_190000_MSWIN-x86-64.zip
• OPatch utility: 6880880 → p6880880_190000_MSWIN -x86-64.zip

Steps to download: Select Patches & Updates → enter patch number → select platform Linux x86-64 → download both files and review the README.

 

Step 2: Check and Update OPatch

On the server, check your current OPatch version:

cd $ORACLE_HOME/OPatch ./opatch version

 

You need version 12.2.0.1.48 or higher. If it's older, update it:

cd %ORACLE_HOME% ren OPatch OPatch_backup1 robocopy copy p6880880_190000_MSWIN -x86-64.zip   %ORACLE_HOME% cd %ORACLE_HOME% unzip p6880880_190000_MSWIN -x86-64.zip

 

Step 3: Run Pre-checks

Before applying the patch, check for conflicts with existing patches:

C:\Users\Administrator>cd C:\software\oracle_patch_19.30\38597735   C:\software\oracle_patch_19.30\38597735>D:\oracle\product\19.3.0\dbhome_1\OPatch\opatch prereq CheckConflictAgainstOHWithDetail -ph ./ Oracle Interim Patch Installer version 12.2.0.1.49 Copyright (c) 2026, Oracle Corporation.  All rights reserved.   PREREQ session   Oracle Home       : D:\oracle\product\19.3.0\dbhome_1 Central Inventory : C:\Program Files\Oracle\Inventory    from           : OPatch version    : 12.2.0.1.49 OUI version       : 12.2.0.7.0 Log file location : D:\oracle\product\19.3.0\dbhome_1\cfgtoollogs\opatch\opatch2026-04-14_19-40-37PM_1.log   Invoking prereq "checkconflictagainstohwithdetail"   Prereq "checkConflictAgainstOHWithDetail" passed.   OPatch succeeded.

 

As we see "OPatch succeeded", we are good to go. If there are conflicts, resolve them before proceeding.

Step 4: Stop the Database and Listener

sqlplus / as sysdba   SQL> shutdown immediate SQL> exit   lsnrctl stop

 

Verify all services are completely down before moving to the next step.

Step 5: Clean Up Inactive Patches (Optional but Recommended)

This frees up Oracle Home space before applying the new patch:

cd $ORACLE_HOME/OPatch ./opatch util listOrderedInactivePatches ./opatch util deleteInactivePatches

 

Step 6: Check Available Disk Space

Do not proceed if space is insufficient in oracle home

Step 7: Apply the Patch

C:\software\oracle_patch_19.30\38597735>D:\oracle\product\19.3.0\dbhome_1\OPatch\opatch apply Oracle Interim Patch Installer version 12.2.0.1.49 Copyright (c) 2026, Oracle Corporation.  All rights reserved.     Oracle Home       : D:\oracle\product\19.3.0\dbhome_1 Central Inventory : C:\Program Files\Oracle\Inventory    from           : OPatch version    : 12.2.0.1.49 OUI version       : 12.2.0.7.0 Log file location : D:\oracle\product\19.3.0\dbhome_1\cfgtoollogs\opatch\opatch2026-04-14_19-41-27PM_1.log   Verifying environment and performing prerequisite checks...   -------------------------------------------------------------------------------- Start OOP by Prereq process. Launch OOP...   Oracle Interim Patch Installer version 12.2.0.1.49 Copyright (c) 2026, Oracle Corporation.  All rights reserved.     Oracle Home       : D:\oracle\product\19.3.0\dbhome_1 Central Inventory : C:\Program Files\Oracle\Inventory    from           : OPatch version    : 12.2.0.1.49 OUI version       : 12.2.0.7.0 Log file location : D:\oracle\product\19.3.0\dbhome_1\cfgtoollogs\opatch\opatch2026-04-14_19-44-33PM_1.log   Verifying environment and performing prerequisite checks... OPatch continues with these patches:   38597735   Do you want to proceed? [y|n] y User Responded with: Y All checks passed.   Please shutdown Oracle instances running out of this ORACLE_HOME on the local system. (Oracle Home = 'D:\oracle\product\19.3.0\dbhome_1')     Is the local system ready for patching? [y|n] y User Responded with: Y Backing up files... Applying interim patch '38597735' to OH 'D:\oracle\product\19.3.0\dbhome_1' ApplySession: Optional component(s) [ oracle.tomcat.crs, 19.0.0.0.0 ] , [ oracle.has.cfs, 19.0.0.0.0 ] , [ oracle.rdbms.tg4msql, 19.0.0.0.0 ] , [ oracle.rdbms.ic, 19.0.0.0.0 ] , [ oracle.rdbms.tg4ifmx, 19.0.0.0.0 ] , [ oracle.network.cman, 19.0.0.0.0 ] , [ oracle.has.deconfig, 19.0.0.0.0 ] , [ oracle.network.gsm, 19.0.0.0.0 ] , [ oracle.assistants.asm, 19.0.0.0.0 ] , [ oracle.wlm.dbwlm, 19.0.0.0.0 ] , [ oracle.rhp.crs, 19.0.0.0.0 ] , [ oracle.has.cvu, 19.0.0.0.0 ] , [ oracle.tfa, 19.0.0.0.0 ] , [ oracle.rdbms.tg4sybs, 19.0.0.0.0 ] , [ oracle.usm, 19.0.0.0.0 ] , [ oracle.ons.daemon, 19.0.0.0.0 ] , [ oracle.rdbms.tg4tera, 19.0.0.0.0 ] , [ oracle.options.olap, 19.0.0.0.0 ] , [ oracle.assistants.usm, 19.0.0.0.0 ] , [ oracle.rdbms.tg4db2, 19.0.0.0.0 ] , [ oracle.options.olap.awm, 19.0.0.0.0 ] , [ oracle.has.crs, 19.0.0.0.0 ]  not present in the Oracle Home or a higher version is found.   Patching component oracle.has.common.cvu, 19.0.0.0.0...   Patching component oracle.has.rsf, 19.0.0.0.0...   Patching component oracle.assistants.server, 19.0.0.0.0...   Patching component oracle.ons, 19.0.0.0.0...   Patching component oracle.rdbms.plsql, 19.0.0.0.0...   Patching component oracle.rdbms.util, 19.0.0.0.0...   Patching component oracle.sqlplus.ic, 19.0.0.0.0...   Patching component oracle.sdo.locator.jrf, 19.0.0.0.0...   Patching component oracle.perlint, 5.28.1.0.0...   Patching component oracle.swd.oui.core.min, 12.2.0.7.0...   Patching component oracle.sqlplus, 19.0.0.0.0...   Patching component oracle.dbjava.jdbc, 19.0.0.0.0...   Patching component oracle.network.listener, 19.0.0.0.0...   Patching component oracle.odbc.ic, 19.0.0.0.0...   Patching component oracle.rdbms.rman, 19.0.0.0.0...   Patching component oracle.dbjava.ucp, 19.0.0.0.0...   Patching component oracle.perlint.modules, 5.28.1.0.0...   Patching component oracle.precomp.common.core, 19.0.0.0.0...   Patching component oracle.oracore.rsf, 19.0.0.0.0...   Patching component oracle.ntoledb.odp_net_2, 19.0.0.0.0...   Patching component oracle.has.db, 19.0.0.0.0...   Patching component oracle.ntoramts, 19.0.0.0.0...   Patching component oracle.marvel, 19.0.0.0.0...   Patching component oracle.xdk.parser.java, 19.0.0.0.0...   Patching component oracle.network.client, 19.0.0.0.0...   Patching component oracle.blaslapack, 19.0.0.0.0...   Patching component oracle.tfa.db, 19.0.0.0.0...   Patching component oracle.ctx, 19.0.0.0.0...   Patching component oracle.rdbms.hsodbc, 19.0.0.0.0...   Patching component oracle.ldap.rsf, 19.0.0.0.0...   Patching component oracle.assistants.deconfig, 19.0.0.0.0...   Patching component oracle.sqlj.sqljruntime, 19.0.0.0.0...   Patching component oracle.ldap.owm, 19.0.0.0.0...   Patching component oracle.duma, 19.0.0.0.0...   Patching component oracle.precomp.lang, 19.0.0.0.0...   Patching component oracle.ntoledb, 19.0.0.0.0...   Patching component oracle.rdbms.rsf, 19.0.0.0.0...   Patching component oracle.rdbms.install.common, 19.0.0.0.0...   Patching component oracle.ldap.security.osdt, 19.0.0.0.0...   Patching component oracle.sdo, 19.0.0.0.0...   Patching component oracle.rdbms.rsf.ic, 19.0.0.0.0...   Patching component oracle.wwg.plsql, 19.0.0.0.0...   Patching component oracle.rdbms.lbac, 19.0.0.0.0...   Patching component oracle.oraolap, 19.0.0.0.0...   Patching component oracle.precomp.rsf, 19.0.0.0.0...   Patching component oracle.ntoledbolap, 19.0.0.0.0...   Patching component oracle.assistants.acf, 19.0.0.0.0...   Patching component oracle.rhp.common, 19.0.0.0.0...   Patching component oracle.javavm.server, 19.0.0.0.0...   Patching component oracle.precomp.common, 19.0.0.0.0...   Patching component oracle.network.rsf, 19.0.0.0.0...   Patching component oracle.ovm, 19.0.0.0.0...   Patching component oracle.install.deinstalltool, 19.0.0.0.0...   Patching component oracle.rdbms.oci, 19.0.0.0.0...   Patching component oracle.rsf, 19.0.0.0.0...   Patching component oracle.clrintg.ode_net_2, 19.0.0.0.0...   Patching component oracle.nlsrtl.rsf, 19.0.0.0.0...   Patching component oracle.xdk.server, 19.0.0.0.0...   Patching component oracle.rdbms.install.plugins, 19.0.0.0.0...   Patching component oracle.ctx.atg, 19.0.0.0.0...   Patching component oracle.javavm.client, 19.0.0.0.0...   Patching component oracle.oraolap.dbscripts, 19.0.0.0.0...   Patching component oracle.rdbms.deconfig, 19.0.0.0.0...   Patching component oracle.dbjava.ic, 19.0.0.0.0...   Patching component oracle.rdbms.dv, 19.0.0.0.0...   Patching component oracle.aspnet_2, 19.0.0.0.0...   Patching component oracle.ldap.client, 19.0.0.0.0...   Patching component oracle.usm.deconfig, 19.0.0.0.0...   Patching component oracle.dbdev, 19.0.0.0.0...   Patching component oracle.ons.ic, 19.0.0.0.0...   Patching component oracle.mgw.common, 19.0.0.0.0...   Patching component oracle.oracler.server, 19.0.0.0.0...   Patching component oracle.has.common, 19.0.0.0.0...   Patching component oracle.xdk.rsf, 19.0.0.0.0...   Patching component oracle.xdk, 19.0.0.0.0...   Patching component oracle.rdbms.dbscripts, 19.0.0.0.0...   Patching component oracle.rdbms.olap, 19.0.0.0.0...   Patching component oracle.rdbms, 19.0.0.0.0...   Patching component oracle.sdo.locator, 19.0.0.0.0...   Patching component oracle.rdbms.scheduler, 19.0.0.0.0...   Patching component oracle.xdk.xquery, 19.0.0.0.0...   Patching component oracle.nlsrtl.rsf.lbuilder, 19.0.0.0.0...   Patching component oracle.jdk, 1.8.0.201.0... Patch 38597735 successfully applied. Sub-set patch [36878821] has become inactive due to the application of a super-set patch [38597735]. Please refer to Doc ID 2161861.1 for any possible further required actions. Log file location: D:\oracle\product\19.3.0\dbhome_1\cfgtoollogs\opatch\opatch2026-04-14_19-44-33PM_1.log   OPatch succeeded.

 

Watch the output carefully. You should see success messages for each component. The full process typically takes 20–30 minutes.

Sample successful output as above.

 

Step 8: Start the Database and Run DataPatch

Start the database first:

sqlplus / as sysdba   SQL> startup

 

Then run DataPatch to register the patch inside the database dictionary:

cd %ORACLE_HOME%/OPatch datapatch -verbose

 

This step is mandatory — without it the patch is applied at the binary level but not registered in the database.

 

Step 9: Verify the Patch

How to Change MAX_STRING_SIZE in a PDB (Oracle 19c Step-by-Step Guide)

 

Changing MAX_STRING_SIZE in a PDB (What Worked for Me)

I recently had to deal with a requirement where the application team wanted to store larger strings in the database. The usual 4000-byte limit wasn’t enough, so the only option was to switch MAX_STRING_SIZE to EXTENDED.

At first I thought it would be a quick change… but in a PDB setup, it’s not that straightforward. I actually had to redo a part of it because I missed the seed step

So sharing the exact steps that worked for me.

 

Step 1: Check Current Setting

First thing I checked was:

SQL> show parameter string_size   NAME TYPE VALUE ------------------------------------ ----------- ------------------------------ max_string_size string STANDARD

 

It was STANDARD, which is expected in most environments.

 

Step 2: Close and Open PDB in Upgrade Mode

Then I closed the PDB:

SQL> ALTER PLUGGABLE DATABASE PROD CLOSE;

and opened it in upgrade mode:

SQL> ALTER PLUGGABLE DATABASE PROD OPEN UPGRADE;

 

Step 3: Change MAX_STRING_SIZE

Now set the parameter:

SQL>ALTER SYSTEM SET MAX_STRING_SIZE=EXTENDED SCOPE=spfile;

This doesn’t take effect immediately, so a restart is needed.

---

Step 4: Restart Database in Upgrade Mode

So I restarted the CDB:

SQL> shu immediate;
SQL> startup upgrade;

---

Step 5: Run utl32k.sql

After startup, I ran:

SQL>@?/rdbms/admin/utl32k.sql

This is one of those steps you really shouldn’t skip.

---

Step 6: Close PDB and Handle PDB$SEED

Next, I closed the PDB:

SQL> ALTER PLUGGABLE DATABASE PROD CLOSE IMMEDIATE;

Then handled the seed database (this is where I messed up the first time):

SQL> ALTER PLUGGABLE DATABASE PDB$SEED OPEN UPGRADE;

SQL> ALTER SESSION SET CONTAINER = PDB$SEED;

SQL> ALTER PLUGGABLE DATABASE  CLOSE IMMEDIATE;

SQL> ALTER PLUGGABLE DATABASE OPEN READ ONLY;

SQL> ALTER PLUGGABLE DATABASE SAVE STATE;

If you skip this, new PDBs may not inherit the setting properly.

---

Step 7: Run Script Again in Target PDB

Finally, I switched back to my PDB:

SQL> ALTER SESSION SET CONTAINER=PROD;

SQL> @?/rdbms/admin/utl32k.sql

 

Final Thoughts

A few things I’d keep in mind:

• Do this during a maintenance window
• Take a backup before starting
• Don’t ignore the seed step
• This change is not easily reversible

Once done, you can go beyond the 4000-byte limit — up to 32767 for VARCHAR2, which is what we needed.

 

How to Delete Old (Inactive) Patches in Oracle 19c Using OPatch

How I Clean Up Old (Inactive) Patches in Oracle Using OPatch

Problem: After multiple Oracle RU patch cycles, old inactive patches accumulate in Oracle Home, causing clutter and confusion during troubleshooting.
Environment: Oracle 19c on Windows (same steps apply to Linux)
Solution: Use OPatch utility commands to safely list and delete inactive patches while retaining the minimum recommended count.

If you have been consistently installing RUs on your Oracle Database, one of the things that will occur to you after some time is your Oracle Home being crammed with outdated patches.

They're not active anymore, but they're still lingering. I ran into the same situation recently while checking one of our 19c environments. There were multiple old RUs lying around, and I thought it's a good time to clean things up a bit.

Here's how I usually handle deleting inactive patches using OPatch.

Prerequisites

• Oracle 19c installed (Windows or Linux)
• OPatch version 12.2.0.1.37 or higher
• Access to OS user with ORACLE_HOME permissions
• Preferably a scheduled maintenance window

---

Step 1: Check Your OPatch Version

Before doing anything, I always make sure OPatch is up to date. Some of these utilities won't work properly on older versions.

cd D:\oracle\product\19.3.0\dbhome_1\OPatch
opatch version

Make sure it's 12.2.0.1.37 or higher. In my case, it was 12.2.0.1.45 — good to go.

Step 2: Check What's Actually Inactive

Next step is to see what patches are inactive. This command is quite handy:

D:\oracle\product\19.3.0\dbhome_1\OPatch>opatch util listorderedinactivepatches

Sample output:

Oracle Interim Patch Installer version 12.2.0.1.45
Copyright (c) 2025, Oracle Corporation. All rights reserved.

Oracle Home       : D:\oracle\product\19.3.0\dbhome_1
OPatch version    : 12.2.0.1.45

Invoking utility "listorderedinactivepatches"

***** There are 2 inactive RU patches in chain 1
-Inactive RU/BP 35046439: 19.19.0.0.230418, installed on: Fri Jul 28 10:22:30 GST 2023
-Inactive RU/BP 36521936: 19.24.0.0.240716, installed on: Thu Oct 24 11:31:40 GST 2024
-Active   RU/BP 37486199: 19.26.0.0.250121, installed on: Sat May 17 10:22:50 GST 2025

OPatch succeeded.

So clearly:

• 2 old patches are inactive
• 1 is the current active RU

Pretty typical scenario after a couple of patch cycles.

Step 3: Important — Don't Delete Everything

Oracle recommends keeping at least 2 inactive patches in the Oracle Home. If something goes wrong and you need to rollback or investigate, having older patches helps. So don't just go and delete everything blindly.

Step 4: Clean Up the Old Ones

To remove inactive patches, use:

D:\oracle\product\19.3.0\dbhome_1\OPatch>opatch util deleteinactivepatches

Sample output:

Invoking utility "deleteinactivepatches"

***** There are 2 inactive RU patches in chain 1

***** 1 inactive patches will be deleted
-To be deleted  : 35046439 (19.19.0.0.230418)
-To be retained : 36521936 (19.24.0.0.240716)
-Active RU/BP   : 37486199 (19.26.0.0.250121)

Do you want to proceed? [y|n]

Notice something interesting — even though there were 2 inactive patches, OPatch decided to delete only 1. That's because it automatically ensures the minimum required patches are retained.

Confirm with:

y

Result:

Deleted RU/BP patch: 35046439

OPatch succeeded.

Things I Always Keep in Mind

• Prefer doing this during a maintenance window
• On critical systems, take a quick backup of Oracle Home first
• Always check logs if something looks off:

%ORACLE_HOME%\cfgtoollogs\opatch

---

Summary — What we did:

• Verified OPatch version is 12.2.0.1.37 or higher
• Listed inactive patches using listorderedinactivepatches
• Safely deleted oldest patch using deleteinactivepatches
• OPatch automatically retained the minimum required inactive patches

Final Thoughts

This is one of those small maintenance activities that's easy to ignore, but it helps keep your environment clean. Inactive patches don't harm directly, but over time they add clutter and confusion — especially when you're troubleshooting or auditing patch levels.

Related posts:

• How to Patch Oracle 19c to Release 19.29 – Step-by-Step
• Datapatch Fails in Oracle 12c on Windows – Root Cause and Fix

How to Patch Oracle 19c to Release 19.29 – A Complete Step-by-Step Blog

How to Patch Oracle 19c to Release 19.29 – A Complete Step-by-Step Guide

Problem: Oracle 19c database needs to be patched to the latest Release Update (19.29) to stay secure and aligned with Oracle's quarterly patch cycle.
Environment: Oracle 19c on Linux x86-64 (same process applies to all 19c versions)
Solution: Download patch 38291812 from Oracle Support, update OPatch, apply the patch, and run datapatch to register it in the database.

I recently had to patch one of my Oracle 19c databases from 19.28 to 19.29. Since this is something we DBAs do every few months, I decided to write down the exact steps I followed. The procedures are the same for all 19c versions.

Note: On production systems, always apply on test/dev first. Never patch production directly without testing!

Prerequisites

• Oracle 19c database installed on Linux x86-64
• Access to Oracle Support (MOS account)
• OS user with ORACLE_HOME and ORACLE_BASE permissions
• At least 12 GB free disk space in /home
• WinSCP or similar tool to transfer files to the server
• Scheduled maintenance window (database downtime required)

---

Step 1: Download the Patch and OPatch Utility

Log in to Oracle Support and download the following:

• Patch file: 38291812 → p38291812_190000_Linux-x86-64.zip
• OPatch utility: 6880880 → p6880880_190000_Linux-x86-64.zip

Steps to download: Select Patches & Updates → enter patch number → select platform Linux x86-64 → download both files and review the README.

Step 2: Check and Update OPatch

On the server, check your current OPatch version:

cd $ORACLE_HOME/OPatch
./opatch version

You need version 12.2.0.1.48 or higher. If it's older, update it:

mv OPatch OPatch_backup1
cp p6880880_190000_Linux-x86-64.zip $ORACLE_HOME
cd $ORACLE_HOME
unzip p6880880_190000_Linux-x86-64.zip

Update your .bash_profile so OPatch is available globally:

vi /home/oracle/.bash_profile

Add this line:

PATH=$ORACLE_HOME/OPatch:$PATH

Save and reload:

:wq
. ~/.bash_profile

Step 3: Prepare the Patch Directory

mkdir /home/oracle/patch
chmod -R 777 /home/oracle/patch

Transfer both ZIP files (Patch + OPatch) to /home/oracle/patch using WinSCP or SCP.

Step 4: Unzip the Patch

cd /home/oracle/patch
unzip p38291812_190000_Linux-x86-64.zip
cd 38291812

Step 5: Run Pre-checks

Before applying the patch, check for conflicts with existing patches:

./opatch prereq CheckConflictAgainstOHWithDetail -ph ./

If you see "OPatch succeeded" — you're good to go. If there are conflicts, resolve them before proceeding.

Step 6: Stop the Database and Listener

sqlplus / as sysdba

SQL> shutdown immediate
SQL> exit

lsnrctl stop

Verify all services are completely down before moving to the next step.

Step 7: Clean Up Inactive Patches (Optional but Recommended)

This frees up Oracle Home space before applying the new patch:

cd $ORACLE_HOME/OPatch
./opatch util listOrderedInactivePatches
./opatch util deleteInactivePatches

Step 8: Check Available Disk Space

You'll need at least 12 GB free in /home:

df -h

Do not proceed if space is insufficient — the patch will fail midway.

Step 9: Apply the Patch

cd /home/oracle/patch/38291812
./opatch apply

Watch the output carefully. You should see success messages for each component. The full process typically takes 10–20 minutes.

Sample successful output at the end:

Patching component oracle.rdbms, 19.0.0.0.0...
Verifying the update...
Patch 38291812 successfully applied.
OPatch succeeded.

Step 10: Start the Database and Run DataPatch

Start the database first:

sqlplus / as sysdba

SQL> startup

Then run DataPatch to register the patch inside the database dictionary:

cd $ORACLE_HOME/OPatch
./datapatch -verbose

This step is mandatory — without it the patch is applied at the binary level but not registered in the database.

Step 11: Verify the Patch

SQL> select * from v$version;
SQL> select patch_id, patch_uid, version, action, status, description
     from dba_registry_sqlpatch
     order by action_time;

You should see 19.29.0.0.0 listed in the output with status SUCCESS.

---

Summary — What we did:

• Downloaded patch 38291812 and updated OPatch to 12.2.0.1.48+
• Ran pre-checks to confirm no patch conflicts
• Shut down database and listener cleanly
• Applied the patch using opatch apply
• Ran datapatch -verbose to register the patch in the database
• Verified patch version shows 19.29.0.0.0 in dba_registry_sqlpatch

Final Tips

• In Data Guard setups — always patch the standby first, then the primary
• Never patch production directly — test on a non-prod clone first
• Always read the patch README before applying — it may have special instructions
• Keep the OPatch backup (OPatch_backup1) until you've verified the patch successfully

Related posts:

• How to Delete Old (Inactive) Patches in Oracle 19c Using OPatch
• Datapatch Fails in Oracle 12c on Windows – Root Cause and Fix
• How to Patch Oracle 19c to Release 19.27 – Step-by-Step

How to Fix formsweb.cfg When Fusion Middleware Enterprise Manager Is Not Accessible

Recently for one of my customer  I ran into a tricky situation while Fusion Middleware Enterprise Manager (EM) 12c was completely inaccessible. Normally, any configuration changes in Oracle Forms, reports or for weblogic  we use Fusion Middleware Enterprise Manager (EM) . Our requirement was to update especially formsweb.cfg which generally is changed through EM. But when EM itself is down, we had to find a way out.

Below is exactly what we did to safely make the change and bring the environment back without causing configuration corruption.

 

Step 1 — Shut Down the Required Services

First, we stopped the Forms managed server and Admin Server to avoid any configuration lock or file corruption.

• Shutdown WLS_FORMS
• Shutdown Admin Server

 

Step 2 — Navigate to Domain Home

[appltest@testapp ~]$ cd $DOMAIN_HOME [appltest@testapp ~]$ pwd [appltest@testapp ~]$ /u01/app/oracle/product/12.2.1.4/user_projects/domains/prd

 

Step 3 — Clear Configuration Lock (edit.lok)

WebLogic sometimes leaves an edit session lock if a previous configuration change did not complete properly.

If the following file exists, remove it

[appltest@testapp ~]$  rm -rf edit.lok

 

Step 4 — Clear Pending Changes

WebLogic stores in-progress configuration updates inside a pending directory. If this folder contains files, the Admin Server assumes an edit session is still active.

Delete any files inside $DOMAIN_HOME/pending/*

[appltest@testapp ~]$ rm -rf $DOMAIN_HOME/pending/*

 

Step 5 — Clear Temporary and Cache Directories

To ensure a clean startup, we removed temporary and cache files. These directories will be recreated automatically when servers restart.

[appltest@testapp ~]$ $DOMAIN_HOME/servers/AdminServer/tmp/ [appltest@testapp ~]$ $DOMAIN_HOME/servers/WLS_FORMS/tmp/ [appltest@testapp ~]$ $DOMAIN_HOME/servers/WLS_FORMS/cache/

 

Step 6 — Edit formsweb.cfg Manually

After cleanup, we updated the required configuration directly in the file:

[appltest@testapp ~]$  vi $DOMAIN_HOME/config/fmwconfig/components/FORMS/instances/forms1/config/formsweb.cfg   userid=new_username/new_password@orcl

 

Step 7 — Restart serivces and Verify

1. Start the Admin Server
2. Wait until it reaches RUNNING state
3. Start Forms services and verify changes.

Dealing with the "Stuck" Workflow Mailer in EBS 12.2: A Practical Guide

 

We all have  seen something like this . We just finished a fresh clone from Production to Test. After the post-clone steps are done, the services are coming up, but then we found the Workflow Notification Mailer is stuck. Its stuck at starting phase.

In a recent project for one of our customer, we noticed this exact scenario. After a successful clone, the mailer was perpetually stuck in a "Starting" phase.

The Problem: New Credentials vs. Old State

After cloning, the Test environment still has the Production SMTP and IMAP settings. Naturally, you have to update these fields—changing the server name which should point to correct smtp address and a valid credential to match the test or your cloned instance mailboxes

The issue seems to be that the Workflow Mailer is trying to start using the new credentials that were recently updated, but it is getting confused because  it is still seeing the previous Running state and some old control messages that came along with the Production snapshot.

The Root Cause: "Identity Crisis"

When an EBS environment is cloned, the target database initially behaves as if it’s still part of the source system. Even after completing adcfgclone and AutoConfig, the Workflow Advanced Queues (AQ) may still retain references or cached state information from the Production environment.

In this situation, the Workflow Mailer was trying to initialize, but it was encountering leftover control messages and orphaned process IDs that did not exist on the new Test server, which prevented it from starting properly.

So here is how we resolved the problem:-

Clearing the Database Block

Our first approach was to manually reset the component status. However, the UPDATE statement became unresponsive, indicating that another session was holding a lock on the FND_SVC_COMPONENTS table.

So, we identified the blocking session and killed it at the database level.

Once the session was killed, lock was cleared, we successfully forced the status to 'STOPPED'

To check workflow mailer status:-

SQL> SELECT component_status FROM fnd_svc_components WHERE component_name = 'Workflow Notification Mailer';

Find out the session stuck with 'FND_SVC_COMPONENTS' component

SQL> SELECT     l.session_id AS blocking_session,     s.username,     s.osuser,     s.program,     s.status,     s.last_call_et AS seconds_in_wait FROM v$locked_object l JOIN v$session s ON l.session_id = s.sid WHERE l.object_id in (SELECT object_id FROM all_objects WHERE object_name = 'FND_SVC_COMPONENTS');

Kill the Session

If the above query shows any rows, it means a session is holding a lock and must be killed to release it. Use the SID and SERIAL# values from the query output and kill that session at the db level.

SQL> Alter system kill session ‘sid , serial#’ immediate;

Update the fnd_svc_components table forcefully as stopped.

SQL> UPDATE fnd_svc_components SET component_status = 'STOPPED' WHERE component_name = 'Workflow Notification Mailer';

Reset the main component status

SQL>UPDATE fnd_svc_comp_requests SET component_status = 'STOPPED' WHERE component_id = (SELECT component_id FROM fnd_svc_components WHERE component_name = 'Workflow Notification Mailer'); SQL> COMMIT;

Also, you must check at OS level. If there is a "zombie" process, the mailer will never start correctly even after the above update.

ps -ef | grep FNDCPGSC

If a process exists, use kill -9 <PID>.

 

Once above steps are done, try to Workflow notification mailer. It should get started.