Friday, October 18, 2019

Internal Concurrent Manager status could not be determined






Restarted Concurrent Managers and Bounced the apps Tier services still same issue persisting
Check the log file of concurrent managers
$ ls –ltrh

Go through the aferror.log file


Now we have found the error. We have to check the tablespace status by connecting to ora user



Add a data file to the tablespace


Now we can see Space is available for the tablespace

Wednesday, October 2, 2019

Oracle E-Business Suite Upgrade from 12.2.x to 12.2.9


Upgrade Oracle E-Business Suite from 12.2.x to 12.2.9

Reference Docs:
Oracle E-Business Suite Release 12.2.9 Readme (Doc ID 2495027.1)
Here I will show you how I upgraded my EBS from 12.2.8 to 12.2.9 with the issues and fixes



Prepare:
·                     We can directly upgrade to EBS R12.2.9 from EBS 12.2.X versions (Not 12.1 or earlier)
·                     We use adop utility instead of adpatch in earlier versions (12.1)
o    Oracle E-Business Suite 12.2.9 Release Update Pack requires Oracle Fusion Middleware Technology Stack (FMW) 11.1.1.9
o    We should use StartCD 12.2.0.51 (Patch 22066363, RAPID INSTALL STARTCD 12.2.0.51) installs Oracle Fusion Middleware 11g PS7 (11.1.1.9.0)
·                     To upgrade EBS, the database should be 11.2.0.4 or highe
Download and unzip all the patches to the default Patch Top location. (DB: $ORACLE_HOME/Patches APP: $NE_BASE/EBSapps/patch)


Apply Required DB and Apps Tier patches:
·                     Before you apply the AD and TXK Delta 11 release update packs (RUPs), you must run     the latest version (available via Patch 17537119) of the EBS Technology Codelevel Checker (ETCC). Use the command checkDBpatch.sh and checkMTpatch.sh.
Ø     Run checkDBpatch.sh on DB Tier by sourcing the env variable
Ø     List all the patches to fix those bugs
Ø     Download the consolidated patch from the Oracle Support
Ø     Unzip the patch and apply the required patches one by one using opatch
Ø     After applying all the patches run checkDBpatch.sh again to confirm no bug is left.
·                     Repeat this process to Apps Tier also by running checkMTpatch.sh
·                     Read the instructions given in the each patch carefully before applying and remove any conflict patches or if the apply patch is superseded.
·                     Apply the patches by exporting ORACLE_HOME and PATH for oracle_common, webtier and WLS_HOME.
·                     Ensure all the required ETCC database objects will be found by the AD-TXK Delta 11 RUP installation process

DB patches list:
Patch 8975044
Patch 25599890
Patch 29748518 rollback 24481723
Patch 27264965 rollback 23595848
Patch 26113202 rollback 20830911
Patch 28500816 rollback 24911308
Patch 25305405 rollback 22338374
Patch 25643931 rollback 19908836
Patch 25906117
Patch 28653113 rollback 18966843
Patch 29842421 rollback 19779059
Patch 29778098 [12.1.0.2.0 version]
- EBS RELEASE 12.2 CONSOLIDATED DATABASE FIXES FOR JUL 2019

Error:
Files in use by a process: /u01/EBS1228/12.1.0/lib/libclntsh.so.12.1 PID
( 27986 28233 )
Following executables are active :
/u01/EBS1228/12.1.0/lib/libclntsh.so.12.1
Recommended actions: OPatch needs to modify files which are being used by some processes.
OPatch failed with error code 41

Sol:
[oracle@ebs1228 28500816]$ ps -ef|grep 27986
oracle   27986 27914  0 16:33 pts/0    00:00:00 sqlplus   as sysdba
oracle   28044 27986  0 16:34 pts/0    00:00:00 /bin/bash
oracle   31843 27064  0 23:40 pts/1    00:00:00 grep --color=auto 27986
[oracle@ebs1228 28500816]$ kill -9 27986

Startup the database and ran datapatch in Oracle_Home/OPatch (After applying all the DB Patches)
$datapatch


Ran checkMTpatch.sh with applmgr user
PATCH RECOMMENDATION SUMMARY

Oracle Forms and Reports 10.1.2.3.0
Patch 26825525
Patch 25342269
Patch 27491934

Oracle Fusion Middleware (FMW) - Web Tier 11.1.1.9.0
Patch 27369643
Patch 27301611 After applying this patch, configuration is required to secure existing OHS instances. Follow steps from the following document on My Oracle Support:post install step Doc ID 2314658.1

RSF within FMW Web tier 11.1.0.7.0
Patch 22290164

Oracle Fusion Middleware (FMW) - oracle_common 11.1.1.9.0
Patch 17428617
Patch 24843064
Patch 13544814
Patch 16089637
Patch 20141119
Patch 27120730
Patch 27212806
Patch 28708563

Oracle WebLogic Server (WLS) 10.3.6.0.161018  [Don’t apply patch GFWX, if you do so you have to remove again]
Patch 27395085 [SU Patch [GFWX]: WLS PSU 10.3.6.0.180417]
- Filename: p27395085_1036_Generic.zip

A consolidated zip file with the required application tier patches is
available on My Oracle Support via: Patch 29778100

- EBS RELEASE 12.2 CONSOLIDATED FMW FIXES FOR JUL 2019
[WARNING]  Patch 27395085 [SU Patch [GFWX]: WLS PSU 10.3.6.0.180417] is missing.
This is the current recommended minimum WLS patch set.

As patch sets are not included in the consolidated zip file, you must obtain it
(or a later one, if available) from My Oracle Support and install it by following its Readme.
Download Patch 29778100 unzip and keep in
/u01/EBS1228/fs_ne/EBSapps/patch/etcc-bundle/LINUX_X86-64

Oracle Forms and Reports 10.1.2.3.0 Prerequisites
-------------------------------------------------------------------------------
Patch 26825525
- Filename: p26825525_101232_LINUX.zip
Please ensure the patch for bug 14825718 is already applied before you proceed [Ignore this  patch].
Please Apply Mandatory Patch 8551790 [Ignore this patch].
Ensure that the directory containing the opatch script appears in your $PATH;






$opatch apply by shutting down all the application tier services

Oracle Fusion Middleware (FMW) - Web Tier 11.1.1.9.0
Set the ORACLE_HOME environment variable to any of "webtier" installation.
e.g. "[FMW_HOME]/Oracle_WebTier and PATH=$ORACLE_HOME/OPatch:$PATH
Oracle WebLogic Server (WLS) 10.3.6.0.161018
Patch 27395085 [SU Patch [GFWX]: WLS PSU 10.3.6.0.180417]
Downloaded and unzipped in
/u01/EBS1228/fs2/FMW_Home/utils/bsu/cache_dir/
[applmgr@ebs1228 FMW_Home]$ cd wlserver_10.3/
[applmgr@ebs1228 wlserver_10.3]$ cd server/bin/
[applmgr@ebs1228 bin]$ ./setWLSEnv.sh
Your environment has been set

[Here you can directly apply WLS Patch 29204678]
./ bsu.sh -install -patch_download_dir=/u01/EBS1228/fs2/FMW_Home/utils/bsu/cache_dir -patchlist=GFWX -prod_dir=/u01/EBS1228/fs2/FMW_Home/wlserver_10.3

Error: Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded
Sol: vi bsu.sh and MEM_ARGS="-Xms256m -Xmx512m"
I increased it to 1024-2048 as follows
"-Xms1024m –Xmx2048m"
Patch GFWX is mutually exclusive and cannot coexist with patch(es): Z9PC,NJVF, KRDE,9KCT,QMJP, K25M,QMJP,KRDE,9KCT

./bsu.sh -prod_dir=/u01/EBS1228/fs2/FMW_Home/wlserver_10.3 -patchlist=KRDE -verbose -remove

./bsu.sh -install -patch_download_dir=/u01/EBS1228/fs2/FMW_Home/utils/bsu/cache_dir -patchlist=S5C9 -prod_dir=/u01/EBS1228/fs2/FMW_Home/wlserver_10.3

Again Ran checkMTpatch.sh got bug fixes
Patch 13729611 [SU Patch [S5C9]]
Patch 17319481 [SU Patch [HMR4]]
Patch 19259028 [SU Patch [F5QI]]
Patch 25373406 [SU Patch [EN8U]]
Patch 16684205 [SU Patch [XNBA]]
Patch 27158972 [SU Patch [TK1T]]
Patch 26795917 [SU Patch [DN1F]]
Patch DN1F is mutually exclusive and cannot coexist with patch(es): CIH8

opatch prereq CheckConflictAgainstOHWithDetail -ph ./





Applying the Latest AD and TXK Release Update Packs to Oracle E-Business Suite Release 12.2 Delta 10 to Delta 11
The latest RUPs are R12.AD.C.Delta.11 (Patch 26834480) and R12.TXK.C.Delta.11 (Patch 28840822).

Existing Release 12.2 customers (below AD-TXK Delta 11 codelevel)



Error:


Sol:
alter package APPS.AD_ZD_ADOP compile body;
SQL> show error
Errors for PACKAGE BODY APPS.AD_ZD_ADOP:
LINE/COL ERROR
-------- -----------------------------------------------------------------
2712/3   PL/SQL: Statement ignored
2712/7   PLS-00201: identifier 'SYS.DBMS_METADATA_UTIL' must be declared
SQL> show user;
USER is "SYS"
SQL> grant execute on DBMS_METADATA_UTIL to apps;
Grant succeeded.





If you are planning an immediate upgrade to Oracle E-Business Suite 12.2.9 Release Update Pack, you must apply the Oracle WebLogic Server PSU version 10.3.6.0.190416 Patch 29204678 or higher and then re-run the Middle Tier EBS Technology Codelevel Checker (MT-ETCC) on the Oracle E-Business Suite application tier nodes.

./bsu.sh -install -patch_download_dir=/u01/EBS1228/fs2/FMW_Home/utils/bsu/cache_dir -patchlist=U5I2 -prod_dir=/u01/EBS1228/fs2/FMW_Home/wlserver_10.3
Checking for conflicts............
Conflict(s) detected - resolve conflict condition and execute patch installation again
Conflict condition details follow:
Patch U5I2 is mutually exclusive and cannot coexist with patch(es): HMR4,F5QI,S5C9,TK1T,GFWX,EN8U   ./bsu.sh -remove -prod_dir=/u01/EBS1228/fs2/FMW_Home/wlserver_10.3 -patchlist=HMR4 –verbose



Oracle WebLogic Server (WLS) 10.3.6.0.190416
-------------------------------------------------------------------------------
Patch 17319481 [SU Patch [159X]]
- Filename: p17319481_10360190416_Generic.zip

Patch 19259028 [SU Patch [M3C7]]
- Filename: p19259028_10360190416_Generic.zip

Patch 25373406 [SU Patch [LLU8]]
- Filename: p25373406_10360190416_Generic.zip

Patch 27158972 [SU Patch [WFNK]]
- Filename: p27158972_10360190416_Generic.zip
Apply the required patches and rerun this script.
A consolidated zip file with the required application tier patches is
available on My Oracle Support via:
Patch 29778100
- EBS RELEASE 12.2 CONSOLIDATED FMW FIXES FOR JUL 2019

Apply the patches and again ran MTcheck.sh to verify all the bugs were fixed.


Unzip ADC Delta11 patch 26834480 patches and run admsi.pl
Compare adgrants.sql in run file and patch file system to the new unzipped admin directory contained adgrants.sql file

cd $APPL_TOP/admin
$adident Header adgrants.sql
adgrants.sql 120.67.12020000.56  (Existing)
adgrants.sql 120.67.12020000.65 (Unzipped from 26834480)

Run the adgrants.sql script as a user from DB that can connect as SYSDBA to grant privileges to selected SYS objects and create PL/SQL profiler objects.

Execute adgrants by following the instructions in the readme of Patch 26834480, which includes the latest version of adgrants.



o    Download and unzip the following patches:
Patch 26834480 (R12.AD.C.Delta.11)
Patch 28840822 (R12.TXK.C.Delta.11)


adop phase=apply patches=26834480,28280348 merge=yes
adop phase=apply patches=28840822,29965377,29781255 merge=yes

Run the Middle Tier EBS Technology Codelevel Checker (MT-ETCC) on the patch file system
$ . <EBS_ROOT>/EBSapps.env run
$ adop phase=finalize
$ adop phase=cutover
$ . <EBS_ROOT>/EBSapps.env run
$ adop phase=cleanup

Error: While running cutover phase


$cd /u01/EBS1228/fs1/FMW_Home/user_projects/domains/EBS_domain_ebs1228/config
-rw-r-----  1 applmgr dba  54K Sep 18 21:28 config.xml
-rw-r-----  1 applmgr dba    0 Sep 18 21:28 config.lok
[applmgr@ebs1228 config]$ pwd
/u01/EBS1228/fs1/FMW_Home/user_projects/domains/EBS_domain_ebs1228/config
[applmgr@ebs1228 config]$ ls –ltrh

[applmgr@ebs1228 config]$ mv config.lok config.lok_old
adopscanlog -latest=yes

[applmgr@ebs1228 ~]$ echo $FILE_EDITION
Run

[applmgr@ebs1228 10.1.2]$ echo $RUN_BASE
/u01/EBS1228/fs1

[applmgr@ebs1228 10.1.2]$ adop -status
Enter the APPS password:
Connected.
==========================================================
ADOP (C.Delta.11)
Session Id: 19
Command: status
Output: /u01/EBS1228/fs_ne/EBSapps/log/adop/19/20190918_231355/adzdshowstatus.out
==========================================================
Node Name       Node Type  Phase           Status          Started             Finished      Elapsed
--------------- ---------- --------------- --------------- -------------------- -------------------- ------
ebs1228         master     PREPARE         COMPLETED       2019/04/03 15:37:14 2019/04/04
APPLY           COMPLETED       2019/09/18 19:14:32 2019/09/18 19:52:08  0:37:36
FINALIZE        COMPLETED       2019/09/18 20:50:29 2019/09/18 21:07:57  0:17:28
CUTOVER         FAILED          2019/09/18 21:18:03 2019/09/18 21:33:48  0:15:45
CLEANUP         NOT STARTED

File System Synchronization Type: Light

Sol: Shutdown all the application tier services on the runfile system and source the patch file system. Bring up the services on the patch file system as shown below.
cd $ADMIN_SCRIPTS_HOME
./adadminsrvctl.sh start forcepatchfs
Go to the weblogic console and click on release configurations and logout.
Now shutdown the services on the patch file system
./adadminsrvctl.sh stop forcepatchfs
Now source the run file system and start all the services then re-run the adop phase=cutover

Error: while starting the application tier services
Warning: An insecure protocol was used to connect to the server. To ensure on-the-wire security, the SSL port or Admin port should be used instead.
Connected to t3://ebs1228.splashbi.com:7203

Shutting down the server oacore_server1 with force=true while connected to oacore_server1 ...
Disconnected from weblogic server: oacore_server1

WLST lost connection to the WebLogic Server that you were connected to, this may happen if the server was shutdown or partitioned. You will have to re-connect to the server once the server is available.
Disconnected from weblogic server:
WARNING: [CVM Error Report]

The following report lists errors encountered during CVM Phase
<filename>  <return code where appropriate>
/u01/EBS1228/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkGenEBSManifestJars.pl                                          l
No. of scripts failed in CVM phase: 1

AutoConfig is exiting with status 1

AutoConfig execution completed on Fri Sep 27 19:47:06 2019

Time taken for AutoConfig execution to complete : 4 mins  19 secs

[applmgr@ebs1228 logs]$ vi /u01/EBS1228/fs1/inst/apps/ebs1228_ebs1228/admin/log/                                     09271942/adconfig.log
[applmgr@ebs1228 logs]$ mv /u01/EBS1228/fs1/EBSapps/appl/fnd/12.0.0/admin/template/custom/ebs3rdpartyManifest_xml.tmp /u01/EBS1228/fs1/EBSapps/appl/fnd/12.0.0/admin/template/custom/ebs3rdpartyManifest_xml.tmp_bkp

[applmgr@ebs1228 logs]$ cp /u01/EBS1228/fs1/EBSapps/appl/fnd/12.0.0/admin/template/ebs3rdpartyManifest_xml.tmp /u01/EBS1228/fs1/EBSapps/appl/fnd/12.0.0/admin/template/custom/

[applmgr@ebs1228 logs]$ cd $ADMIN_SCRIPTS_HOME
[applmgr@ebs1228 scripts]$ ls
adadminsrvctl.sh  adcmctl.sh          adnodemgrctl.sh  adstrtal.sh       java.sh      mwactlwrpr.sh
adalnctl.sh       adexecsql.pl        adopmnctl.sh     cz64bitengine.pl  jtffmctl.sh  pon64bitengine.pl
adapcctl.sh       adformsrvctl.sh     adpreclone.pl    gsmstart.sh       msc          shtiloglib.pl
adautocfg.sh      admanagedsrvctl.sh  adstpall.sh      ieo               mwactl.sh
[applmgr@ebs1228 scripts]$ ./adautocfg.sh
Enter the APPS user password:

The log file for this session is located at: /u01/EBS1228/fs1/inst/apps/ebs1228_ebs1228/admin/log/09271957/adconfig.log


wlsDomainName: EBS_domain_ebs1228
WLS Domain Name is VALID.
AutoConfig is configuring the Applications environment...

AutoConfig will consider the custom templates if present.
Using CONFIG_HOME location     : /u01/EBS1228/fs1/inst/apps/ebs1228_ebs1228
Classpath                   : /u01/EBS1228/fs1/FMW_Home/Oracle_EBS-app1/shared-libs/ebs-appsborg/WEB-INF/lib/ebsAppsborgManifest.jar:/u01/EBS1228/fs1/EBSapps/comn/java/classes

Using Context file          : /u01/EBS1228/fs1/inst/apps/ebs1228_ebs1228/appl/admin/ebs1228_ebs1228.xml

Context Value Management will now update the Context file

Updating Context file...COMPLETED

Attempting upload of Context file and templates to database...COMPLETED

Configuring templates from all of the product tops...
Configuring AD_TOP........COMPLETED
Configuring FND_TOP.......COMPLETED
Configuring ICX_TOP.......COMPLETED
Configuring MSC_TOP.......COMPLETED
Configuring IEO_TOP.......COMPLETED
Configuring BIS_TOP.......COMPLETED
Configuring CZ_TOP........COMPLETED
Configuring SHT_TOP.......COMPLETED
Configuring AMS_TOP.......COMPLETED
Configuring CCT_TOP.......COMPLETED
Configuring WSH_TOP.......COMPLETED
Configuring CLN_TOP.......COMPLETED
Configuring OKE_TOP.......COMPLETED
Configuring OKL_TOP.......COMPLETED
Configuring OKS_TOP.......COMPLETED
Configuring CSF_TOP.......COMPLETED
Configuring IBY_TOP.......COMPLETED
Configuring JTF_TOP.......COMPLETED
Configuring MWA_TOP.......COMPLETED
Configuring CN_TOP........COMPLETED
Configuring CSI_TOP.......COMPLETED
Configuring WIP_TOP.......COMPLETED
Configuring CSE_TOP.......COMPLETED
Configuring EAM_TOP.......COMPLETED
Configuring GMF_TOP.......COMPLETED
Configuring PON_TOP.......COMPLETED
Configuring FTE_TOP.......COMPLETED
Configuring ONT_TOP.......COMPLETED
Configuring AR_TOP........COMPLETED
Configuring AHL_TOP.......COMPLETED
Configuring IES_TOP.......COMPLETED
Configuring OZF_TOP.......COMPLETED
Configuring CSD_TOP.......COMPLETED
Configuring IGC_TOP.......COMPLETED

AutoConfig completed successfully.
[applmgr@ebs1228 scripts]$ ./adstrtal.sh

Update Database Tier to Latest Code
. <EBS_ROOT>/EBSapps.env run

execute the admkappsutil.pl utility to create the appsutil.zip file in <INST_TOP>/admin/out.
$ perl <AD_TOP>/bin/admkappsutil.pl
cp /u01/EBS1228/fs1/inst/apps/ebs1228_ebs1228/admin/out/appsutil.zip /u01/EBS1228/12.1.0

On the database tier (as the ORACLE user):
o    Source the environment for RDBMS ORACLE_HOME.
UNIX:
$ cd <RDBMS ORACLE_HOME>
$ . ./<RDBMS ORACLE_HOME>/<CONTEXT_NAME>.env
a.            Copy or FTP/scp the appsutil.zip file to <RDBMS ORACLE_HOME>.
b.            Uncompress appsutil.zip, under <RDBMS ORACLE_HOME>.

$ cd <ORACLE_HOME>
$ unzip -o appsutil.zip

Run AutoConfig on <RDBMS ORACLE_HOME>.
sh <RDBMS_ORACLE_HOME>/appsutil/scripts/<CONTEXT_NAME>/adautocfg.sh
Run AutoConfig on the run file system
sh <INST_TOP>/admin/scripts/adautocfg.sh

Synchronize the file systems.
$ adop phase=fs_clone

Error: fs_clone failed
[UNEXPECTED]fs_clone has failed.
[STATEMENT] Please run adopscanlog utility, using the command
"adopscanlog -latest=yes"
to get the list of the log files along with snippet of the error message corr      esponding to
each log file.

adop exiting with status = 2 (Fail)
[applmgr@ebs1228 scripts]$ adop -status
Enter the APPS password:
Connected.
==============================================================
ADOP (C.Delta.11)
Session Id: 21
Command: status
Output: /u01/EBS1228/fs_ne/EBSapps/log/adop/21/20190928_014753/adzdshowstatus.out
===============================================================
Node Name       Node Type  Phase           Status          Started              Finished        Elapsed
--------------- ---------- --------------- --------------- -------------------- -------------------- ------------
ebs1228         master     FS_CLONE        FAILED          2019/09/28 01:40:08         0:07:50
File System Synchronization Type: Full

adop exiting with status = 0 (Success)
[applmgr@ebs1228 scripts]$ adopscanlog -latest=yes

Scanning /u01/EBS1228/fs_ne/EBSapps/log/adop/21/ directory ...

No Errors.
Stop the application and db services
Confirm the port 6290 is free. For example: "netstat -nlp | grep 6290" should not show any attached process.
If some processes are still attached, reboot the OS.
Start the services from the Run filesystem.
When running adop phase=fs_clone or $ADMIN_SCRIPTS_HOME/adpreclone.pl on an application node, the below error occurs in $INST_TOP/admin/log/clone/fmwT2PStage/CLONEXXXXXX_XXXXX.error file:
SEVERE : <DATE&TIME> - ERROR - CLONE-20435 Some of the Oracle Homes are excluded during copy operation.
SEVERE : <DATE&TIME> - CAUSE - CLONE-20435 The following Oracle Homes were excluded during copy operation.

Error:
[/u01/oracle/fs1/FMW_Home/webtier, /u01/oracle/fs1/FMW_Home/oracle_common] , and possible causes were:
1.
All the Oracle Homes were not registered with one OraInventory.
2. If all Oracle Homes were registered with a single custom OraInventory, then corresponding inventory pointer file was not provided to T2P operation.

Solution:
To resolve the issue test the below steps in a non-business critical instance where the problem can be reproduced and then migrate accordingly:
1. Take backup of the instance and the existing "oraclehomeproperties.xml" file located under the ORACLE_HOME local inventory.

/u01/oracle/fs1/FMW_Home/webtier/inventory/ContentsXML

/u01/oracle/fs1/FMW_Home/oracle_common/inventory/ContentsXML

2. Check the path mentioned for PROPERTY NAME="MIDDLEWARE_HOME" in the file. This should point to the FMW_HOME on the same filesystem.
For example If the file is located in /u01/oracle/fs1/FMW_Home/webtier/inventory/ContentsXML/oraclehomeproperties.xml, then the value of PROPERTY NAME="MIDDLEWARE_HOME" should be "/u01/oracle/fs1/FMW_Home"
3. If the path mentioned is incorrect, edit the file to point to correct path.
4. Save the changes.
5. Rerun the failed FS_CLONE/ADPRECLONE/PL command.
6. Confirm the fs_clone command now complete successfully without error.

Re-run "adop phase=fs_clone"
Fs_clone phase done successfully
$ . <INSTALL_BASE>/EBSapps.env run
$ adop phase=prepare
Download and Unzip the Oracle E-Business Suite Release 12.2.9 Patch 28840850 (RUP) at fs_ne.

$ adop phase=apply patches=28840850
Logfile: /u01/EBS1228/fs_ne/EBSapps/log/adop/22/20190929_004151/apply/ebs1228/28840850/log/u28840850.log
/u01/EBS1228/fs_ne/EBSapps/log/adop/22/20191001_030609/apply/ebs1228/28840850/log/u28840850.log

Error:
ATTENTION: All workers either have failed or are waiting:

FAILED: file apfhanwf.wft on worker  6.

ATTENTION: Please fix the above failed worker(s) so the manager can continue.

Current time is: Sun Sep 29 2019 15:37:25

Telling workers to quit...

1 worker has quit.  Waiting for 7 more.
2 workers have quit.  Waiting for 6 more.
3 workers have quit.  Waiting for 5 more.
6 workers have quit.  Waiting for 2 more.
7 workers have quit.  Waiting for 1 more.

All workers have quit.

Connecting to APPS......Connected successfully.

AutoPatch error:

Error running SQL and EXEC commands in parallel

Freeing includes hash table
Freeing fixes hash table
Freeing basedons hash table


Patch applied again by giving restart=yes






$adop phase=apply patches=28840850 restart=yes options=forceapply,nocheckfile,nocompiledb




$ adop phase=finalize
$ adop phase=cutover
$ . <INSTALL_BASE>/EBSapps.env run

$ adop phase=cleanup
$ adop phase=fs_clone




Post-Update Steps:

Note: If you are upgrading from Release 11i, 12.0.x or 12.1.x to Release 12.2.9, then you must continue with 12.2.0 post upgrade steps mentioned in the Upgrade guides before performing the below steps.

Apply Oracle EBS Release 12.2.9 Online Help patch 28840900 using adop in hotpatch mode on the run file system.

1.            $ adop phase=apply patches=28840900 hotpatch=yes
2.Verify security configurations (required)
If you have upgraded to Oracle E-Business Suite 12.2.9 Release Update Pack from Oracle E-Business Suite 12.2.6 Release Update Pack (or earlier) and after you apply the Release Update Pack (RUP) or perform an upgrade, your Oracle E-Business Suite system is locked down until the system administrator configures or acknowledges the recommended security configurations in the Secure Configuration Console to unlock the system for normal usage. To access this console, a user must have a responsibility that includes the Applications System (OAM_APP_SYSTEM) function privilege, such as the seeded System Administration or System Administrator responsibilities, and must be registered as a local user with Oracle E-Business Suite. The administrator must log in to Oracle E-Business Suite using the local login page (http(s)://[host]:[port]/OA_HTML/AppsLocalLogin.jsp) to navigate to the console and unlock the system. If a user with local system administrator privileges is not available, you can access the Secure Configuration Console through a command line utility. For more information, see "Secure Configuration Console" in the Oracle E-Business Suite Security Guide, Part No. E22952.

3.    Perform product specific tasks.