Senthil Rajendran

My Son Dharun Performing at Improviser Music Studio

Believer



Please subscribe to our channel Improviser Music Studio

My Son Dharun Performing at Improviser Music Studio

Despacito



Please subscribe to our channel Improviser Music Studio

My Son Dharun Performing at Improviser Music Studio

Tchaikovsky | Swan Lake



Please subscribe to our channel Improviser Music Studio

My Son Dharun Performing at Improviser Music Studio

Shawn Mendes - Treat You Better



Please subscribe to our channel Improviser Music Studio

My Son Dharun Performing at Improviser Music Studio

Ekadantaya Vakratundaya 



Please subscribe to our channel Improviser Music Studio

EBS 12.2 ADOP Cycle Errors During Validation  Cannot open XML file for load

ADOP cycle will have validation errors in some cases.

*******FATAL ERROR*******
PROGRAM :
(/test/apps/CLONE/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPEvalSrvStatus.pl)
TIME    : Wed Nov 13 15:50:36 2019
FUNCTION: TXK::XML::load_doc [ Level 1 ]
MESSAGES:
error = Cannot open XML file for load
errorno = No such file or directory
file =
/test/apps/CLONE/fs_ne/EBSapps/log/adop/6/fs_clone_20191113_153822/CLONE_test/TXK_EVAL_fs_clone_Wed_Nov_13_15_49_52_2014/ctx_files/CLONE_test.xml

*******FATAL ERROR*******
PROGRAM :
(/test/apps/CLONE/fs1/EBSapps/appl/ad/12.0.0/patch/115/bin/txkADOPPreparePhaseSynchronize.pl)
TIME    : Wed Nov 13 15:50:36 2019
FUNCTION: main::validatePatchContextFile [ Level 1 ]
MESSAGES:
message = Access permission error on test
File CLONE_test.xml not readable

If you see the above stack then do the fix as suggested below

- Validate FND_NODES table for valid hostnames
- Validate FND_OAM_CONTEXT_FILES table for run and patch context file
- If a valid node does not have a valid run and patch context file in FND_OAM_CONTEXT_FILES , then it has to be loaded either by running autoconfig from the respective file system or if you do not want to run autoconfig then load the context file using API

$ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=$CONTEXT_FILE

Rerun ADOP Cycle.

Have fun with Oracle EBS 12.2

[oracle@testebsop3app01 ~]$ perl /u01/install/APPS/fs1/EBSapps/comn/clone/bin/adcfgclone.pl appltop /u01/install/APPS/fs1/inst/apps/SATURN_testebsop3app01/appl/admin/SATURN_testebsop3app01.xml

Appl_top only clone might result in the below error

START: Instantiate the txkWfClone.sql...
instantiate file:
   source : /u01/install/APPS/fs1/EBSapps/appl/fnd/12.0.0/admin/template/txkWfClone.sql
   dest   : /u01/install/APPS/fs1/inst/apps/SATURN_testebsop3app01/admin/install/txkWfClone.sql
Adding execute permission to : /u01/install/APPS/fs1/inst/apps/SATURN_testebsop3app01/admin/install/txkWfClone.sql

END: Instantiated txkWfClone.sql...

START: Executing /u01/install/APPS/fs1/inst/apps/SATURN_testebsop3app01/admin/install/txkWfClone.sh -nopromptmsg
txkWfClone.sh exited with status 1
ERROR: txkWfClone.sh execution failed, exit code 1
[oracle@testebsop3app01 clone_10091511]$


if you scroll up the logs you may find some more errors

TXK Script Name: txkChkFormsLaunchMethod.pl
Enter the APPS user password:
*******FATAL ERROR*******
PROGRAM : (/u01/install/APPS/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkChkFormsLaunchMethod.pl)
TIME    : Wed Oct  9 14:50:36 2019
FUNCTION: main::validateAppsSchemaCredentials [ Level 1 ]
ERRORMSG: Invalid APPS database user credentials.
ERRORCODE = 1 ERRORCODE_END
.end std out.
stty: standard input: Inappropriate ioctl for device
stty: standard input: Inappropriate ioctl for device
*******FATAL ERROR*******
PROGRAM : (/u01/install/APPS/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkChkFormsLaunchMethod.pl)
TIME    : Wed Oct  9 14:50:36 2019
FUNCTION:  [ Level 1 ]
ERRORMSG: *******FATAL ERROR*******
PROGRAM : (/u01/install/APPS/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkChkFormsLaunchMethod.pl)
TIME    : Wed Oct  9 14:50:36 2019
FUNCTION: main::validateAppsSchemaCredentials [ Level 1 ]
ERRORMSG: Invalid APPS database user credentials.


The problem is tnsnames.ora does not have an entry for TWO_TASK


from MT , sqlplus apps/apps@TWO_TASK will fail to connect.

Fix :
run autoconfig on the DB node
run adcfgclone.pl appltop

Not All Endpoints Registered

crsctl stat res -t

 --------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_LSTNSOLTP .lsnr
     1        ONLINE  INTERMEDIATE orcl1           Not All Endpoints Registered,STABLE
ora.LISTENER_LSTNSOLTP .lsnr
     1        ONLINE  ONLINE       orcl2           STABLE
ora.LISTENER_LSTNSOLTP .lsnr
     1        ONLINE  ONLINE       orcl3           STABLE

"Not All Endpoints Registered"

To fix the problem
- compare the listener.ora of all the nodes
- find the differences and sync it up

if you find static entries make sure you stop the listener running with "LSNRCT STOP " otherwise you might end up with duplicate processes

$  ps -ef|grep -i LSTNSOLTP
grid     312080      1  0 03:17 ?        00:00:00 /u01/app/12.1.0.2/grid/bin/tnslsnr LSTNSOLTP -no_crs_notify -inherit
$

-- found static entry in listener.ora

-- fixed listener.ora by removing the static entry

-- used crsctl to start the listener

$ ps -ef|grep -i LSTNSOLTP
grid     166779      1  0 Sep18 ?        00:14:53 /u01/app/12.1.0.2/grid/bin/tnslsnr LSTNSOLTP -no_crs_notify -inherit
grid     267334      1  0 03:07 ?        00:00:00 /u01/app/12.1.0.2/grid/bin/tnslsnr LSTNSOLTP -no_crs_notify -inherit
$

correct way to approach this problem


$  ps -ef|grep -i LSTNSOLTP
grid     312080      1  0 03:17 ?        00:00:00 /u01/app/12.1.0.2/grid/bin/tnslsnr LSTNSOLTP -no_crs_notify -inherit
$

$ lsnrctl stop LSTNSOLTP


$  ps -ef|grep -i LSTNSOLTP
$

Make sure no processes are running

-- fix listener.ora by removing the static entry

-- use crsctl to start the listener

$ ps -ef|grep -i LSTNSOLTP
grid     267334      1  0 03:07 ?        00:00:00 /u01/app/12.1.0.2/grid/bin/tnslsnr LSTNSOLTP -no_crs_notify -inherit
$


crsctl stat res -t

 --------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_LSTNSOLTP .lsnr
     1        ONLINE  ONLINE       orcl1           STABLE
ora.LISTENER_LSTNSOLTP .lsnr
     1        ONLINE  ONLINE       orcl2           STABLE
ora.LISTENER_LSTNSOLTP .lsnr
     1        ONLINE  ONLINE       orcl3           STABLE

Oracle EBS 12.2 - ADOP ad_zd_prep.create_patch_service exact fetch returns more than requested number of rows

Please note , if you get ADOP issues on PROD please read the logs and understand the problem before executing any commands.

SQL> exec ad_zd_prep.create_patch_service;
BEGIN ad_zd_prep.create_patch_service; END;

*
ERROR at line 1:
ORA-01422: exact fetch returns more than requested number of rows
ORA-06512: at "APPS.AD_ZD_PREP", line 342
ORA-06512: at "APPS.AD_ZD_PREP", line 378
ORA-06512: at line 1


A Quick fix without autoconfig

1. SQL> create table fnd_oam_bkup1 as select * from fnd_oam_context_files;
2. SQL> truncate fnd_oam_context_files
3. move DB context file MT
4. Load the Database Context File
• $ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=/tmp/test_dbserver.xml
5. Load the Run File System Context File
• $ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=/u01/test/appl/fs1/inst/apps/test_mtserver/appl/admin/test_mtserver.xml
6. Load the Patch File System Context File
• $ADJVAPRG oracle.apps.ad.autoconfig.oam.CtxSynchronizer action=upload contextfile=/u01/test/appl/fs1/inst/apps/test_mtserver/appl/admin/test_mtserver.xml

Oracle EBS 12.2 - ADOP ad_zd_prep.create_patch_service exceptions

Please note , if you get ADOP issues on PROD please read the logs and understand the problem before executing any commands.



There are cases where you might have to create a patch service manually. So usually after cloning or fresh install , add node , mass patching , upgrade this crazy error will pop up.

SQL> exec ad_zd_prep.create_patch_service;
BEGIN ad_zd_prep.create_patch_service; END;

*
ERROR at line 1:
ORA-01422: exact fetch returns more than requested number of rows
ORA-06512: at "APPS.AD_ZD_PREP", line 342
ORA-06512: at "APPS.AD_ZD_PREP", line 378
ORA-06512: at line 1

Check the state of the package

SQL> select owner, object_name,status,object_type from dba_objects where object_name like upper ('AD_ZD_PREP');

OWNER                                    OBJECT_NAME                              STATUS  OBJECT_TYPE
---------------------------------------- ---------------------------------------- ------- -----------------------
APPS                                     AD_ZD_PREP                               VALID   PACKAGE
APPS                                     AD_ZD_PREP                               INVALID PACKAGE BODY


SQL> alter package apps.ad_zd_prep compile body;

Warning: Package Body altered with compilation errors.

SQL> show error
Errors for PACKAGE BODY APPS.AD_ZD_PREP:

LINE/COL ERROR
-------- -----------------------------------------------------------------
463/3    PL/SQL: SQL Statement ignored
463/19   PL/SQL: ORA-00942: table or view does not exist
467/5    PL/SQL: SQL Statement ignored
467/21   PL/SQL: ORA-00942: table or view does not exist
501/5    PL/SQL: SQL Statement ignored
501/21   PL/SQL: ORA-00942: table or view does not exist


Fix :  follow this note
12.2 E-Business Suite DBA Upgrade Script ADZDEXRPT.sql Fails On Invalid Object 'AD_ZD_PREP' Or Patch 13543062 Fails With Error: ORA-06508: PL/SQL: could not find APPS.AD_ZD_PREPAD_ZD_PREP Due To Missing Package 'xdb_migrateschema' (Doc ID 2066607.1)



Move the adgrants.sql from MT to DB before running it.



exec ad_zd_prep.create_patch_service  -- this should succeed.

ADOP patching on a downtime mode with [ERROR]     Patch service  is not exist or running

Please note , if you get ADOP issues on PROD please read the logs and understand the problem before executing any commands.

When applying adop patches on a downtime mode you might see an error that the patch service is not existing or running. Please note NOT all patches are meant to be applied to a downtime mode so read the readme of the patch to understand the patching process. Exception cases breaking the rule book patches can be applied to a development environment but you have to know how to deal with post adop failure cases.

In this case it is clear that the patch service is not existing.

adop phase=apply patches=1234567 apply_mode=downtime

Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:

Validating credentials.

Initializing.
   Run Edition context  : /p01/ebs/appl/fs1/inst/apps/ebs_app01/appl/admin/ebs_app01.xml
   Patch edition context: /p01/ebs/appl/fs2/inst/apps/ebs_app01/appl/admin/ebs_app01.xml
   Patch file system free space: 77.95 GB

Validating system setup.
   Node registry is valid.
   [ERROR]     Patch service  is not exist or running
   [WARNING]   ETCC: The following required database fixes have not been applied to node app01:
bla bla bla
Encountered the above errors when performing database validations.
   Resolve the above errors and restart adop.

Fix : connect as APPS user and execute
SQL>  exec ad_zd_prep.create_patch_service;

Run ADOP now and it should proceed further.

New Feature - Create Databases from Automatic Daily Backups
Services : Block Volume
Release Month : Jan 2019

Automatic Daily Backup feature lets you to create automated backups of OCI DB System Databases on a daily basis. With this feature you can now create a new system out of the automated daily backups.

Here is a DB System in OCI that is created and you can see there is a Automated Backup Running













Once the backup is completed you will see that it is ready for the refresh





From the backup section select Create Backup and fill in the required details





Once you start the database creation process you will see the restore process beginning immediately.



The DB System will have your database in provisioning stage



Once restore is done you will be having your new Database up and running.



This is indeed a cool feature. I bet your DBA will love to see this , he can now start looking into other useful stuffs.

New Feature : In-transit encryption for boot and block volumes

New Feature : Consistent device paths for block volumes
Services : Block Volume
Release Date : Jan 2019

With this feature you can now select a device path that will remain consistent between instance reboots. though this is an optional feature it is recommended to use the device path as you can refer to the volumes when create partitions , creating file systems , mounting file system , you can also specify this option in /etc/fstab file for automatically mounting volumes on the instance boot.



























Operating System Linux Images that are released by Oracle prior to November 2018 would not be able to use this feature. Windows based , Custom images and Partner images are not supported.

To verify if consistent device path support is available on your instance , login into your environment and do a "ll /dev/oracleoci/oraclevd*" , if you see a list of devices then it is supported else if you get a message "no such file or directory" then it is not supported.





Attaching a device path in the console is done simply by selecting a device path for the block volume.  Once attached you can verify the block volume from the summary page

Device Path : /dev/oracleoci/oraclevdb

mkfs.ext3 /dev/oracleoci/oraclevdb1
update : /etc/fstab --- /dev/oracleoci/oraclevdb1   /oradata    ext3    defaults,_netdev,noatime  0  2
mkdir /oradata
mount /dev/oracleoci/oraclevdb1 /oradata

Recently have been working with a customer who was running high workload on virtual machine. After a complete review , DBAs have identified the database is running non optimized codes/sql/programs. During high peak load we observed very high Steal %



In a virtual environment, CPU cycles are shared across virtual machines on the server. If your virtual machine displays a high %st in top (steal time), this means CPU cycles are being taken away from your virtual machine to serve other purposes. You may be using more than your share of CPU resources or the physical server may be over-sold. Move the virtual machine to another physical server. If steal time remains high, try giving the virtual machine more CPU resources.

In this case this database was not having any noisy neighbor and it was the same machine fighting against itself. The reason was over-provisioning. The underlying hardware had 48 CPU but virtual machine was over provisioned for 64 CPU.

To resolve the issue , virtual machine was migrated from 48 CPU bare metal to 82 CPU bare metal.

The Steal is gone.

it is highly recommended to have a metric collection on the monitoring tool to have Steal monitored on high workload virtual machines. This will help take action and move environment to have better performance.

ADOPValidations_detailed.log reported a warning message for one of the critical error "Cross Reference"

Golden Gate moving from Classic to Integrated was an option taken in one of our project to have better performance. A lot of effort was put to convert all the extract and replicate to Integrated mode and some optimization parameters were used but still there were not a significant performance improvement.

Then I took a different route to examine the AWR and ASH for the replicate processes. Wow our friend INDEXES. Since we were dealing with build load , some of the unwanted indexes were dropped and Golgen Gate was super fast. Both Integrated and Classic was having better performance. Post the build load we rebuild the indexes.

Better consult a Dr.DBA always.