Oracle Application Technology

Today our development team complained of ‘Development’ instance of Oracle 11 Ebiz is not accessible. Even the login page is not loading.

I tried to login and got the login page but later on after keying the login credential, it was taking extremely long time to open and later on threw ‘page not found’ error. I thought of bouncing apache.

When I tried to bounce apache, I got below error.

ORACLE error 604 in afpodbinit

Cause:  afpodbinit failed due to ORA-00604: error occurred at recursive SQL level 1
ORA-01013: user requested cancel of current operation
ORA-06508: PL/SQL: could not find program unit being called
ORA-06512: at "APPS.FND_GLOBAL", line 101
ORA-06512: at "APPS.FND_GLOBAL",.

The SQL statement being executed at the time of the error was: begin fnd_global.bless_next_init('FND_PERMIT_0000'); fnd_global.initialize(:session_id, :user_id, :resp_id, :resp_appl_id, :security_group_id, :site_id, :login_id, :conc_login_id, :prog_appl_id, :conc_program_id, :conc_request_id, :conc_priority_request, :form_id, :form_application_id, :conc_process_id, :conc_queue_id, :queue_appl_id, :server_id); fnd_profile.put('ORG_ID', :org_id); fnd_profile.put('MFG_ORGANIZATION_ID', :mfg_org_id); fnd_profile.put('MFG_CHART_OF_ACCOUNTS_ID', :coa); fnd_profile.put('APPS_MAINTENANCE_MODE', :amm); end; and was executed from the file &ERRFILE.

Apache Web Server Listener :httpd ( pid 17197 ) is running.
Stopping Apache Web Server Listener (dedicated HTTP) ...

Oracle error -6508: ORA-01013: user requested cancel of current operation
ORA-06508: PL/SQL: could not find program unit being called
has been detected in FND_GLOBAL.INITIALIZE.

Oracle error -6508: ORA-01013: user requested cancel of current operation
ORA-06508: PL/SQL: could not find program unit being called
has been detected in FND_GLOBAL.INITIALIZE.
Apache Web Server Listener (PLSQL) :httpd ( pid 17521 ) is running.
Stopping Apache Web Server Listener (dedicated PLSQL) ...
Oracle error -6508: ORA-01013: user requested cancel of current operation
ORA-06508: PL/SQL: could not find program unit being called
has been detected in FND_GLOBAL.INITIALIZE.

adapcctl.sh: exiting with status 0

Later on when I tried to run adstpall.sh on Web tier, I got following in the error.

Setting service Oracle Apache Server DEV_pdc-al-lnx12 to mode 3
Executing service control script:
/d01/wfmdev/common/admin/scripts/DEV_pdc-al-lnx12/adapcctl.sh stop
Timeout specified in context file: 100 second(s)

script returned:
****************************************************
ERROR : Timed out( 100000 ): Interrupted Exception

adapcctl.sh version 115.50

Later on when I looked into the database, I got following latches/library pin waits and hence decided to go for database bounce.

    1    71 library cache lock            JDBC Thin Client     APPS        ############ 5.0440E+17        302   1117
    1    87 library cache lock               ?  @pdc-al-lnx12  APPS        ############ 5.0440E+17        302   1084
                                          (TNS V1-V3)

    1    88 library cache lock                                 APPS        ############ 5.0440E+17        302    817
    1   104 library cache lock            JDBC Thin Client     APPS        ############ 5.0440E+17        302    520
    1   132 library cache lock                                 APPS        ############ 5.0440E+17        302   1169
    1   150 library cache lock               ?  @pdc-al-lnx12  APPS        ############ 5.0440E+17        302    817
                                          (TNS V1-V3)

    1   164 library cache lock            JDBC Thin Client     APPS        ############ 5.0440E+17        302   1117
    1   233 library cache lock               ?  @pdc-al-lnx12  APPS        ############ 5.0440E+17        302    189
                                          (TNS V1-V3)

    1   142 library cache pin                ?  @pdc-al-lnx12  APPS        ############ 5.0440E+17        302    219
                                          (TNS V1-V3)

    1   171 library cache pin                ?  @pdc-al-lnx12  APPS        ############ 5.0440E+17        202     11

DB bounce helped to resolve the issue. ‘adstpall.sh’ and ‘adstrtal.sh’ executed successfully. Application was very much accessible.

-Anand