“Output Post Processor” Concurrent Manager not able to start

January 21, 2016 Leave a comment

Development team informed me of an issue where the concurrent job (that needs post processing) errored. On reveiwing the request log file, i notice an isue with ‘Output post Processor’. I checked the OPP in the ‘Administer Concurrent Manager’ screen and found

Actual=4 and Target=0 processes

I tried to restart but still getting the same status. Later on I tried to query the “FNDOPP” process on the application tier
$ ps -ef|grep -i FNDOPP|grep -v grep

and this resulted in 0 process.

I then looked into the manager log file and found below error

Jan 19, 2016 8:02:44 AM oracle.ias.cache.CacheInternal logLifecycleEvent
INFO: JOC is initialized from oracle.apps.jtf.cache.IASCacheProvider.init, ver=11.1.1.2.0, distribute=true, vid=996, coordinator=0, discover list=[[129.80.88.133:12345] segID=1]
Unable to initialize state monitor.
oracle.apps.fnd.cp.gsm.GenCartCommException: ORA-01403: no data found
ORA-06512: at "APPS.FND_CP_GSM_IPC", line 539
ORA-06512: at line 1

	at oracle.apps.fnd.cp.gsm.GenCartComm.initService(Unknown Source)
	at oracle.apps.fnd.cp.gsm.GenCartComm.<init>(Unknown Source)
	at oracle.apps.fnd.cp.gsf.GSMStateMonitor.init(Unknown Source)
	at oracle.apps.fnd.cp.gsf.GSMStateMonitor.<init>(Unknown Source)
	at oracle.apps.fnd.cp.gsf.GSMServiceController.init(GSMServiceController.java:117)
	at oracle.apps.fnd.cp.gsf.GSMServiceController.<init>(GSMServiceController.java:72)
	at oracle.apps.fnd.cp.gsf.GSMServiceController.main(GSMServiceController.java:448)

Solution that resolved the issue

I found “Service Manager” was down. So I restarted “Service Manager” and then restarted “Output Post Processor”.
and Actual=4 and Target=4 processes

I asked the development team to submit the job again. This time job completed successfully.

Categories: Oracle Apps

Oracle E-Business Suite 12.0.4 Installation on 32 bit Linux

September 15, 2015 Leave a comment

This document demonstrates step by step procedure with screenshots to do multinode installation of oracle Applications R12.0.4 and then upgrading it to 12.0.6

This article will be helpful for the beginners who want to learn how to Install and configure oracle E-business suite 12.0.4 on multiple nodes using Linux OS platform

R12.0.4 Multi Node Installation on 32 Bit Linux

Hope this helps. Happy learning!

-Anand M

 

 

Categories: Oracle Apps Tags:

Common Database Wait Events

Below is the document containing the most common database waits seen during the day to day activity of an Oracle DBA. It contains the possible causes and different ways to alleviate the wait.

Common Database waits

Happy reading!

-Anand

Categories: Oracle Database Tags:

Log file location in Oracle application 11i

Below is the ready reckoner for the location of various log files in Oracle apps 11i. This is very much helpful when troubleshooting any issue

  • Database Tier
    • Alert Log File – $ORACLE_HOME/admin/$CONTEXT_NAME/bdump/alert_$SID.log
    • Trace file – $ORACLE_HOME/admin/SID_Hostname/udump
    • Autoconfig Log file – $ORACLE_HOME/appsutil/log/SID_Hostname/DDMMTime/adconfig.log
  • Application Tier
    • Autoconfig Log file             – $APPL_TOP/admin/SID_Hostname/log/DDMMTime/adconfig.log
    • Start/Stop script log files  – $COMMON_TOP/admin/log/CONTEXT_NAME/<mmddhhmi.log>
    • Concurrent log file              – $APPLCSF/$APPLLOG
    • Patch Log file                      – $APPL_TOP/admin/<SID>/log
    • Worker Log file                   – $APPL_TOP/admin/<SID>/log
    • Apache Log file                   – $IAS_ORACLE_HOME/Apache/Apache/logs/
    • Jserv log File                       – $IAS_ORACLE_HOME/Apache/Jserv/logs/
    • JVM Log File                       – $IAS_ORACLE_HOME/Apache/Jserv/logs/jvm
    • ICM log file                          – $APPLCSF/$APPLLOG/
    • Workflow Mailer log file      – $APPLCSF/$APPLLOG/FNDCPGSC*.txt
Categories: Oracle Apps Tags: ,

Microsoft AD and OID synchronization not happening

Support team reported an issue where they were not able to see some of the new users created in AD (Active Directory) flowing to OID (Oracle Internet Directory)
I started looking into the issue. I checked ODI synchronization services (odisrv process)

Logged into the infra tier and ran the command

$ $ORACLE_HOME/ldap/bin/ldapcheck

Checking Oracle Internet Directory Processes ...ALL

Process oidmon is Alive as PID 30596
Process oidldapd is Alive as PID 30603
Process oidldapd is Alive as PID 30609
Not Running ---- Process oidrepld
Process odisrv is Alive as PID 17381

then checked the ldap synchronization log ($ORACLE_HOME/ldap/oid/log/_.aud
and this showed last successful synchronization happened on 23rd Feb 2015
No Errors were seen in the ldap trace file, oidsrv log or oidmon log.
I looked into the highest COMMITTED USN in the AD

$ ldapsearch -h  -b "" -s base "objectclass=*" highestcommittedusn
highestCommittedUSN=464557938

And searched for highest committed USN from the DIP profile

$ ldapsearch -h  -p  -D "cn=orcladmin" -w  -b "cn=subscriber profile,cn=changelog subscriber,cn=oracle internet directory" -s sub "objectclass=*" > /tmp/PROD_DIP_Profile.txt

$ grep -i "orclodipcondirlastappliedchgnum" /tmp/PROD_DIP_Profile1.txt
$ orclodipcondirlastappliedchgnum=0
orclodipcondirlastappliedchgnum=455736457
orclodipcondirlastappliedchgnum=0
orclodipcondirlastappliedchgnum=0
orclodipcondirlastappliedchgnum=0
orclodipcondirlastappliedchgnum=0
orclodipcondirlastappliedchgnum=0
orclodipcondirlastappliedchgnum=0

So there was huge difference between the highestCommittedUSN between AD and that in the DIPprofile.
This is the reason Synchronization got stopped.

I followed below steps to make this synchronization work again.
1) Stop the odisrv process
$ oidctl connect= server=odisrv instance=1 stop
2) Disable the DIP profile
– Set the DISPLAY
– Open a VNC sessions and run the below command
$ORACLE_HOME/bin/oidadmin

Login to oid console with user as “cn=orcladmin”
Go to Integration Server
Select the profile which should be something like <OID_SID>_PortalImport
Edit the same and make it “Disable”

picture1

 

 

 

 

 

 

 

 




You can check this by running the below command on Infra Node.
ldapsearch –h [oid_hostname with fully qualified domain] –p 389 –D “cn=orcladmin” –w –b “orclodipAgentName=xxxx_PortalImport,cn=subscriber profile ,cn=changelog subscriber,cn=oracle internet directory” –s base “objectclass=*” orclodipagentcontrol

3) update the Highest committed USN in the DIP profile with that obtained from AD
— Now again edit the same profile and go into ‘Status’ Tab
— Update the value against “Last Applied Change Number” with the value obtained above from AD

picture2

 

 

 

 

 

 

 

4) Enable the profile again
— Edit the Profile and make it enable

5) Move the old and existing odisrv log, odimon log, synchronization log ($ORACLE_INFRA_HOME/ldap/oid/log/*.aud and *.trc)
6) Start the odisrv process

$oidctl connect==[tns_alias] server=odisrv instance=1 configset=1 flags=”host=[oid_hostname with fully qualified domain] port=389″ start
7) Run “ldapcheck” command to see the odisrv process.

$ORACLE_HOME/ldap/bin/ldapcheck

Process oidmon is Alive as PID 28339
Process oidldapd is Alive as PID 28347
Process oidldapd is Alive as PID 28361
Not Running ---- Process oidrepld
Process odisrv is Alive as PID 28348

Now again search for Highest Committed USN in AD and in DIP profile and it matches.

This resolved the issue and synchronization resumed between Microsoft AD and OID.

File o7725967.tmp creation for FND_FILE failed

February 9, 2015 Leave a comment

Today support team sought a help for the issue they were encountering in the TEST instance.

Error as given by the support team


ErrBufORA-20100: File o7725967.tmp creation for FND_FILE failed.
You will find more information on the cause of the error in request log.

I tried a quick test to see if there is any issue with utl_file_dir


SQL>exec FND_FILE.PUT_LINE(FND_FILE.LOG, 'THIS IS A TEST');
BEGIN FND_FILE.PUT_LINE(FND_FILE.LOG, 'THIS IS A TEST'); END;

*
ERROR at line 1:
ORA-20100: File o7725970.tmp creation for FND_FILE failed.
You will find more information on the cause of the error in request log.
ORA-06512: at "APPS.FND_FILE", line 410
ORA-06512: at "APPS.FND_FILE", line 517
ORA-06512: at line 1

Above test threw an error. Then I verified 2 more things

1) APPLPTMP directory should be the first one appearing when UTL_FILE_DIR parameter is queried – this looked Ok


SQL>show parameter utl_file

NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
utl_file_dir string /d05/apptest/common/temp, /usr
/tmp, /d12/oratest/product/9.2.
0/appsutil/outbound/TEST, /d05/
apptest/11.5/xxbb/4.0.0/edi/ou
t, /d05/appltest/11.5/xxdd/4.0.
0/US/utl_file_dir, /d05/appltest
t/common/admin/log/TEST_host_name
, /d05/appltest/common/admi
n/out/TEST_host_name, /d05/ap
pltest/common/admin/log/TEST_host_name,
/d12/oratest/product/
9.2.0/ccr/hosts/host_name/st
ate, /d05/appltest/11.5/xxcal/s
mart, /d05/appltest/11.5/xxcal/
bartender

2)Missing permissions on APPLPTMP directory – I found that the permission was not correct. I gave the permission (777) to the directory and this resolved the issue.

To confirm, I ran the same procedure again and it returned the expected result.


SQL>exec FND_FILE.PUT_LINE(FND_FILE.LOG, 'THIS IS A TEST');

PL/SQL procedure successfully completed.

Elapsed: 00:00:01.15

Other probable causes of error

3)APPLPTMP directory is missing &

4)APPLPTMP directory pointing to wrong location

 

Hope this helps.

Categories: Oracle Apps

PASSWORD column NULL in DBA_USERS from 11g onwards

December 16, 2014 Leave a comment

I got a request from support team to reset the DBA user password as they were getting some error due to password expiration.
However support person was not aware of the password.

SQL> select USERNAME,ACCOUNT_STATUS,EXPIRY_DATE
  2  from dba_users
  3  where USERNAME = 'PEOPLE';

USERNAME
--------------------------------------------------------------------------------
ACCOUNT_STATUS
--------------------------------------------------------------------------------
EXPIRY_DATE
---------------
PEOPLE
EXPIRED
03-NOV-14

Oracle 11g brought several security enhancements, as it is well known by the 11g users. On previous Oracle versions it was possible to query the DBA_USERS PASSWORD column to get the hashed password string. It was useful when someone tried to temporarily reset the user’s password and restore it to its original value without actually knowing it.
The command:

ALTER USER IDENTIFIED BY VALUES ‘F28740221A2D9A70’;

it could take the hashed value from the DBA_USERS data dictionary view. However starting with Oracle 11g this column is null … so where are we supposed to take this hashed value from?.

SQL> SELECT USERNAME, PASSWORD
2 FROM DBA_USERS
3 WHERE USERNAME='PEOPLE';

USERNAME PASSWORD
--------------- ------------------------------
PEOPLE 

Starting with Oracle 11g, there is a view called SYS.USER$ which stores the PASSWORD, the way it was stored prior to 11g.

Oracle 11g only makes it a little bit more difficult to get the hashed password, but if you login with “SYS” account, you can still apply the conventional (prior to 11g method) to temporarily reset the password, and still have access to the hashed password.

SQL> SELECT NAME, PASSWORD
FROM SYS.USER$
WHERE NAME = 'PEOPLE'   2    3  ;

NAME
--------------------------------------------------------------------------------
PASSWORD
--------------------------------------------------------------------------------
PEOPLE
F28740221A2D9A70

And the command used to reset the password

SQL> alter user PEOPLE identified by values 'F28740221A2D9A70';

User altered.

SQL> select USERNAME,ACCOUNT_STATUS,EXPIRY_DATE
  2  from dba_users
  3  where USERNAME = 'PEOPLE';

USERNAME
--------------------------------------------------------------------------------
ACCOUNT_STATUS
--------------------------------------------------------------------------------
EXPIRY_DATE
---------------
PEOPLE
OPEN
14-JUN-15
Categories: Oracle Database Tags: ,