HTTP-500 error in R12 instance after clone with ORA-01578

Issue:

Performed oracle ebs r12 application clone from PROD with RMAN Backup. Cloned instance is configured and services are brought up. When tried to launch the application getting HTTP-500 Internal error.
Checked application.log file under $LOG_HOME/ora/10.1.3/j2ee/oacore/oracore_default_group~1/ directory and found below errors.

Caused by: oracle.apps.jtf.base.resources.FrameworkException: Failure in CacheLoader: oracle.apps.jtf.base.resources.FrameworkException
Caused by: oracle.apps.jtf.base.resources.FrameworkException: ORA-01578: ORACLE data block corrupted (file # 131, block # 59236)
        ... 31 more
ORA-01110: data file 131: '/u01/oradata/UAT/apps_ts_tx_data_34.dbf'
ORA-26040: Data block was loaded using the NOLOGGING option

Cause:

As per metalink note 781413.1 the issue is Data in APPLSYS.WF_LOCAL_USER_ROLES are not synchronized.
query of table WF_LOCAL_USER_ROLES throws block corruption error

Solution:

Synchronize workflow tables from backend as below

sqlplus apps/<apps password>

set serveroutput on size 100000;
declare
begin
WF_LOCAL_SYNCH.BULKSYNCHRONIZATION(
P_ORIG_SYSTEM => 'ALL',
P_PARALLEL_PROCESSES => null,
P_LOGGING => null,
P_RAISEERRORS => TRUE);
exception
when others then
dbms_output.put_line('sqlerrm = ' || sqlerrm);
end;
/

An error occurred while attempting to establish an Applications File Server connection OPP Files

I did R12 upgrade recently from 11i and as part of upgrade we had server migration also. So as part this activity we copied all old concurrent log & out files from old 11i server to new R12 server.

After copying all the files we updated fnd_concurrent_requests table to open old log and out files from R12 applications.

Then users are now able to open their 11i standard Log & Out files. But users are not able to open their Concurrent PDF output that is generated by Output post processor. Users when try to launch PDF out files they get below error.

An error occurred while attempting to establish an Applications File Server connection with the node FNDFS_<oldserver>. There may be a network configuration problem, or the TNS listener on node FNDFS_<oldserver> may not be running. Please contact your system administrator.

Solution:

After  investigation I identified that OPP will store file generayion details like file type,nodename, filename in table FND_CONC_REQ_OUTPUTS instead of FND_CONCURRENT REQUESTS. After updating these tables manually as below users are able to open OPP PDF output files.

update FND_CONC_REQ_OUTPUTS set
FILE_NAME=replace(FILE_NAME,'/u01/oracle/testcomn/admin/out/PROD_test','/u01/oracle/test/inst/apps/PROD_test/logs/appl/conc/out/PROD_tes');

 update FND_CONC_REQ_OUTPUTS  set FILE_NODE_NAME='<NewServer>'
 where FILE_NODE_NAME='<OldServer>';

...

Apps URL redirecting to https after cloning (ssl_terminator)

Apps URL redirecting to https instead of http after clone

As part of regular practice I tried to clone my Production instance with standard oracle steps. Our Production is configured with Load balancer and SSL Setup at load balancer.

I executed adcfgclone.pl successfully on appsTier.

Later I modified the below context file parameters to disable SSL configuration after clone

<webentryurlprotocol oa_var="s_webentryurlprotocol">https</webentryurlprotocol>

to

<webentryurlprotocol oa_var="s_webentryurlprotocol">http</webentryurlprotocol>

<chronosURL oa_var="s_chronosURL">https://orapp01.test.com:8000/oracle_smp_chronos/oracle_smp_chronos_sdk.gif</chronosURL>

to

<chronosURL oa_var="s_chronosURL">http://orapp01.test.com:8000/oracle_smp_chronos/oracle_smp_chronos_sdk.gif</chronosURL>

<EndUserMonitoringURL oa_var="s_endUserMonitoringURL">https://orapp01.test.com:8000/oracle_smp_chronos/oracle_smp_chronos_sdk.gif</EndUserMonitoringURL>

to

<EndUserMonitoringURL oa_var="s_endUserMonitoringURL">http://orapp01.test.com:8000/oracle_smp_chronos/oracle_smp_chronos_sdk.gif</EndUserMonitoringURL>

<externURL oa_var="s_external_url">https://orapp01.test.com:8000</externURL>

to

<externURL oa_var="s_external_url">http://orapp01.test.com:8000</externURL>

<login_page oa_var="s_login_page">https://orapp01.test.com:8000/OA_HTML/AppsLogin</login_page>

to

<login_page oa_var="s_login_page">http://orapp01.test.com:8000/OA_HTML/AppsLogin</login_page>

Then executed autoconfig ad it completed without any errors. Later I brought up the application services normally and tried to launch application. After launching the url it is again redirecting to https even after chaning necessary parameters context file.

http://orapp01.test.com:8000/OA_HTML/AppsLogin is redirecting to https://orapp01.test.com:8000/OA_HTML/AppsLocalLogin.jsp

Later upon investigation I found that changing all https to http doesn't disable SSL but also need to modify ssl_terminator value in context value as below.

<sslterminator oa_var="s_enable_sslterminator"/>

to

<sslterminator oa_var="s_enable_sslterminator">#</sslterminator>

This disables SSL configuration. The I executed autoconfig and bounced services and finally I could launch ebs applications from Browser.

Thanks...