on 09-07-2016 9:11 AM
Hi Igor,
Can you please paste the last 4 latest log file .
With Regards
Ashutosh Chaturvedi
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
Hi Ashutosh !
I think that I found something interesting -
<message type="trace" timestamp="2016-09-07 09:43:08.165">Error GetNetworkEnv: java.lang.NullPointerException: oracleHome source in listener.ora cannot be null.</message>
<message type="trace" timestamp="2016-09-07 09:43:08.165">Info: GetNetworkEnv.execute done: ret=false</message>
<message type="trace" timestamp="2016-09-07 09:43:08.165"> Step return value is not 'true'. </message>
Hi Reagan
[root@msk-ewm-qas ~]# cat /etc/oraInst.loc
inventory_loc=/oracle/oraInventory
inst_group=dba
[root@msk-ewm-qas ~]# cat /etc/oratab
EW3:/oracle/EW3/11204:N
[root@msk-ewm-qas ~]# cat /oracle/EW3/112_64/network/admin/listener.ora
# listener.ora Network Configuration File: /oracle/EW3/11204/network/admin/listener.ora
# Generated by Oracle configuration tools.
LISTENER =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = msk-ewm-prd)(PORT = 1521))
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
)
)
ADR_BASE_LISTENER = /oracle
Hello Igor,
1. root is the correct user when using SWPM.
2. Check the environment variables.
As user ew3adm and then as user oraew3 please run:
"env | grep 102"
cd $HOME ; grep 102 .*
3. Check SAP profiles.
cd /sapmnt/EW3/profile
grep 102 *
4. Check Oracle Profiles
cd $ORACLE_HOME/112_64/dbs
grep 102 *
Provide the output of the above if any of the commands return a result for the string "102".
KR,
Amerjit
Hi Amerjit
msk-ewm-qas:ew3adm 67> env | grep 102
msk-ewm-qas:ew3adm 68> cd $HOME ; grep 102 .*
grep: .: Is a directory
grep: ..: Is a directory
grep: .config: Is a directory
grep: .gnome2: Is a directory
grep: .mc: Is a directory
grep: .mozilla: Is a directory
grep: .sdb: Is a directory
grep: .ssh: Is a directory
msk-ewm-qas:ew3adm 69>
msk-ewm-qas:ew3adm 69> cd /sapmnt/EW3/profile
msk-ewm-qas:ew3adm 70> grep 102 *
/oracle/EW3/112_64/112_64/dbs: Too many levels of symbolic links.
msk-ewm-qas:ew3adm 75>
Hi Igor,
Could you also perform the same env checks as user oraew3.
You have a incorrect situation for your Oracle home as I see 112_64 twice in the path and then your error of "too many levels of symbolic links". Could you perform a "ls -l" of /oracle/EW3 and /oracle/EW3/112_64 and post it here. It looks like you may have the 112_64 sym link created twice.
KR,
Amerjit
ETW000 R3trans version 6.24 (release 722 - 01.04.15 - 20:15:04).
4 ETW000 unicode enabled version
4 ETW000 ===============================================
4 ETW000
4 ETW000 date&time : 12.09.2016 - 13:50:20
4 ETW000 control file: <no ctrlfile>
4 ETW000 R3trans was called as follows: R3trans -d
4 ETW000 trace at level 1 opened for a given file pointer
4 ETW000 [ dev trc,00000] Mon Sep 12 13:50:20 2016
4 ETW000 [ dev trc,00000] Loading DB library '/usr/sap/EW3/SYS/exe/run/dboraslib.so' ...
4 ETW000 [ dev trc,00000] Library '/usr/sap/EW3/SYS/exe/run/dboraslib.so' loaded
4 ETW000 [ dev trc,00000] Version of '/usr/sap/EW3/SYS/exe/run/dboraslib.so' is "722.00", patchlevel (0.3)
4 ETW000 [ dev trc,00000] con_info_ext_support(): DBSL supports extended connect protocol
4 ETW000 ==> connect info for default DB will be read from ssfs
4 ETW000 [ dev trc,00000] dbs/ora/stmt_cache_size = 250
4 ETW000 [ dev trc,00000] Register application info.
4 ETW000 [ dev trc,00000] Oracle client version: 11.2.0.4.0, V2, default build, (dbsl 722 030315, UNICODE[2])
4 ETW000 [ dev trc,00000] Installed Oracle client patches:
4 ETW000 [ dev trc,00000] # Patch 12985200 : Created on 2 Jul 2014, 09:45:20 hrs PST8PDT
4 ETW000 [ dev trc,00000] # Patch 11742262 : Created on 6 Nov 2013, 15:22:08 hrs CET
4 ETW000 [ dev trc,00000] Client NLS setting (by OCINlsGetInfo(con=0)): 'AMERICAN_AMERICA.UTF16'
4 ETW000 [ dev trc,00000] Connecting as SAPSR3/<pwd>@EW3 on connection 0 (nls 0) ... (dbsl 722 030315, UNICODE[2])
4 ETW000 [ dev trc,00000] OCIHandleAlloc(con=0): Service svc=2dea318 created, rc=0
4 ETW000 [ dev trc,00000] OCIServerAttach(con=0, svc=2dea318): New server hdl. srv=2dec970 attached to 'EW3'
4 ETW000 [ dev trc,00000] OCISessionBegin(con=0, svc=2dea318, srv=2dec970='EW3'): start session usr=2e1b710='SAPSR3', rc=0
4 ETW000 [ dev trc,00000] Now 'SAPSR3/<pwd>@EW3' is connected: con=0, nls=0, session=731, time='2016-09-12 13:50:20'
4 ETW000 [ dev trc,00000] DB instance EW3 is running on msk-ewm-qas with ORACLE version 11.2.0.4.0 since SEP 12, 2016, 13:49:19.
4 ETW000 [ dev trc,00000] con=0, V$NLS_PARAMETERS: NLS_LANG=AMERICAN_AMERICA.UTF8, NLS_NCHAR=UTF8
4 ETW000 [ dev trc,00000] # CharacterSet NCharSet envhp errhp er2hp bathp
4 ETW000 [ dev trc,00000] 0 UTF16 AL16UTF16 2ddcb00 2de82f8 2de9378 2dea3f8
4 ETW000 [ dev trc,00000] Connection 0 opened (DBSL handle 0)
4 ETW000 [ dev trc,00000] DbSlControl(DBSL_CMD_SAPRELEASE_SET,abap='731')
4 ETW000 [ dev trc,00000] NTAB: version is VERS_B, UNICODELG=2, SAP_UC_LN=2
4 ETW000 Connected to DBMS = ORACLE --- dbs_ora_tnsname = 'EW3' --- SYSTEM = 'EW3'.
4 ETW690 COMMIT "0" "0"
4 ETW000 trace to file pointer closed
4 ETW000 trace at level 1 opened for a given file pointer
4 ETW000
4 ETW000 ================== STEP 1 =====================
4 ETW000 date&time : 12.09.2016 - 13:50:20
4 ETW000 function : CONNECT
4 ETW000 buffersync : YES
4 ETW000 clients : default
4 ETW000 commit : 100000
4 ETW000 table cache : dynamic
4 ETW000
4 ETW000 [ dev trc,00000] Disconnecting from ALL connections:
4 ETW000 [ dev trc,00000] dbcon[db_con_disconnect_all]: disconnecting from connection 0 ...
4 ETW000 [ dev trc,00000] Disconnecting con=0
4 ETW000 [ dev trc,00000] OCISessionEnd(con=0, svc=2dea318, srv=2dec970='EW3'): Close session usr=2e1b710, rc=0
4 ETW000 [ dev trc,00000] OCIServerDetach(stale1 con=0, svc=2dea318, srv=2dec970='EW3') successfully detached
4 ETW000 [ dev trc,00000] OCIHandleFree(con=0, svc=2dea318): Server handle srv=2dec970 freed
4 ETW000 [ dev trc,00000] OCIHandleFree(con=0): Service hdl. svc=2dea318 freed.
4 ETW000 [ dev trc,00000] dbcon[db_con_disconnect_all]: disconnected from connection 0
4 ETW000 [ dev trc,00000] statistics db_con_commit (com_total=1, com_tx=1)
4 ETW000 [ dev trc,00000] statistics db_con_rollback (roll_total=0, roll_tx=0)
4 ETW000 Disconnected from database.
4 ETW000 End of Transport (0000).
4 ETW000 date&time: 12.09.2016 - 13:50:20
Maybe SWPM can not work with SSFS ?
[root@msk-ewm-qas tmp]# ls -l /oracle/EW3/
total 2988
drwxr-xr-x 83 oraew3 dba 4096 Jan 1 2016 11204
lrwxrwxrwx 1 root root 5 Jan 1 2016 112_64 -> 11204
-rw-rw-r--. 1 oraew3 dba 6250 Feb 27 2013 11ginstall_11203.log
-rw-rw-r-- 1 oraew3 dba 12271 Jan 1 2016 11ginstall_11204.log
-rw-r--r-- 1 oraew3 dba 4869 Jan 1 2016 11gupgrade-11203-EW3-2016_01_01-17-08-12.log
-rw-r--r-- 1 oraew3 dba 4869 Jan 1 2016 11gupgrade-11203-EW3-2016_01_01-17-09-52.log
-rw-r--r-- 1 oraew3 dba 4653 Jan 1 2016 11gupgrade-11203-EW3-2016_01_01-17-13-54.log
-rw-r--r-- 1 oraew3 dba 4966 Jan 1 2016 11gupgrade-11203-EW3-2016_01_01-17-14-45.log
drwxr-xr-x. 2 oraew3 dba 4096 Feb 27 2013 mirrlogA
drwxr-xr-x. 2 oraew3 dba 4096 Feb 27 2013 mirrlogB
drwxr-xr-x. 2 oraew3 dba 36864 Sep 12 14:53 oraarch
drwxr-xr-x. 2 oraew3 dba 4096 Feb 27 2013 oraflash
drwxr-xr-x. 3 oraew3 dba 4096 Feb 27 2013 origlogA
drwxr-xr-x. 3 oraew3 dba 4096 Feb 27 2013 origlogB
drwxrwxrwx. 2 oraew3 dba 36864 Sep 12 14:02 saparch
drwxrwxrwx. 3 oraew3 dba 16384 Sep 9 05:00 sapbackup
drwxr-xr-x 1 oraew3 dba 2621440 Sep 12 16:01 sapbackup_remote
drwxrwxrwx. 2 oraew3 dba 4096 Sep 12 11:00 sapcheck
drwxrwxrwx. 12 oraew3 dba 4096 Feb 2 2015 sapdata1
drwxrwxrwx. 15 oraew3 dba 4096 Aug 5 10:49 sapdata2
drwxrwxrwx. 6 oraew3 dba 4096 Jan 12 2015 sapdata3
drwxrwxrwx. 3 oraew3 dba 4096 Feb 27 2013 sapdata4
drwxrwxrwx. 4 oraew3 dba 4096 Sep 4 18:00 sapreorg
drwxrwxrwx. 6 oraew3 dba 4096 Feb 27 2013 saptrace
-rw-r----- 1 oraew3 dba 184798 Jan 1 2016 sapuprof_profile.log
drwxr-xr-x 3 oraew3 dba 4096 May 8 09:06 security
-rwxr-xr-x. 1 oraew3 dba 16763 Jan 4 2013 startdb
-rw-r--r--. 1 oraew3 dba 359 Mar 29 2014 startsap.trc
-rwxr-xr-x. 1 oraew3 dba 12049 Jan 4 2013 stopdb
-rw-r--r--. 1 oraew3 dba 357 Jan 19 2015 stopsap.trc
[root@msk-ewm-qas tmp]# ls -l /oracle/EW3/112_64/
total 84440
lrwxrwxrwx 1 oraew3 dba 6 Jan 1 2016 112_64 -> 112_64
drwxr-xr-x 8 oraew3 dba 4096 Jan 1 2016 apex
drwxr-xr-x 8 oraew3 dba 4096 Jan 1 2016 assistants
drwxr-xr-x 2 oraew3 dba 12288 Sep 12 15:18 bin
I see the wrong symlink. Fixing it...
[root@msk-ewm-qas EW3]# su - oraew3
msk-ewm-qas:oraew3 48> env | grep 102
msk-ewm-qas:oraew3 49> cd $HOME ; grep 102 .*
grep: .: Is a directory
grep: ..: Is a directory
grep: .config: Is a directory
.history:env | grep 102
.history:cd $HOME ; grep 102 .*
.history:mkdir /oracle/EW3/102_64
.history:mkdir /oracle/EW2/102_64/
grep: .mc: Is a directory
msk-ewm-qas:oraew3 50> cd /sapmnt/EW3/profile
msk-ewm-qas:oraew3 51> grep 102 *
EW3_DVEBMGS00_msk-ewm-prd:#old_value: 10240 changed: IKOSTYLEV 10.09.2013 12:57:20
EW3_DVEBMGS00_msk-ewm-qas:#old_value: 10240 changed: IKOSTYLEV 10.09.2013 12:57:20
grep: oracle: Is a directory
msk-ewm-qas:oraew3 52> cd $ORACLE_HOME/112_64/dbs
/oracle/EW3/112_64/112_64/dbs: No such file or directory.
msk-ewm-qas:oraew3 53> cd $ORACLE_HOME/dbs
msk-ewm-qas:oraew3 54> grep 102 *
initEW3.ora:*.event='10027','10028','10142','10183','10191','10995 level 2','38068 level 100','38085','38087','44951 level 1024'#RECOMMENDED BY ORACLE/SAP FOR 11.2.0 - SAP note 1431798
Binary file spfileEW3.ora matches
msk-ewm-qas:oraew3 55>
Dear Igor,
Can you share sapinst_dev.log file as well.
As per the sapinst.log file there is some error related to DNS name kindly ask IS team to resolve the same, this error dont have any relation with oracle error, but lets make the system error free.
Kindly share the sapinst_dev.log file.
WARNING[E] 2016-09-12 17:24:29.643 (root/sapinst) id=syslib.network.getInfoFailed errno=FSL-03003
Unable to determine parameter "DNS domain name". DNS domain name is not configured in resolv.conf (UNIX) or the registry (Windows) and neither getaddrinfo nor gethostbyname could retrieve it.
WARNING 2016-09-12 17:24:29.647 (root/sapinst) id=modlib.jslib.caughtException
Caught ::ESyException in module call: At line 243 file syxxcnwmgt.cpp
Call stack:
EJSController.cpp: 181: EJSControllerImpl::executeScript()
JSExtension.hpp: 1136: CallFunctionBase::call()
iaxxcnetwork.cpp: 129: iastring CIaOsNetworkConnect::callMemberFunction(iastring const& name, args_t const& args)
iaxxcnetwork.cpp: 340: iastring CIaOsNetworkConnect::getDNSDomainName(args_t const& _args)
iaxxbnetwork.cpp: 53: CIaOsNetwork::getDNSDomainName_impl()
syxxcnwmgt.cpp: 159: iastring CSyNetworkMgtImpl::getDNSDomainName() const
Unable to determine parameter "DNS domain name". DNS domain name is not configured in resolv.conf (UNIX) or the registry (Windows) and neither getaddrinfo nor gethostbyname could retrieve it.
Regards,
Anil Bhandary
Hello Igor,
In addition to the DNS name that Anil has mentioned you seem to have inconsistent configuration for EW3 in the different files.
INFO 2016-09-12 17:23:59.337 (root/sapinst)
Found these instances:
sid: EW3, number: 00, name: DVEBMGS00, host: msk-ewm-prd, Service definition file /usr/sap/sapservices
sid: DAA, number: 97, name: SMDA97, host: msk-ewm-prd, Service definition file /usr/sap/sapservices
sid: EW3, number: 00, name: DVEBMGS00, host: msk-ewm-qas, Profile directory /usr/sap/EW3/SYS/profile
KR,
Amerjit
Yes Anil, I resolve DNS problem, here is the files:
/sapmnt/EW3/profile/oracle:
sqlnet.ora
################
# Filename......: sqlnet.ora
# Created.......: created by SAP AG, R/3 Rel. >= 6.10
# Name..........:
# Date..........:
# @(#) $Id: //bas/720_REL/src/krn/tpls/ora/SQLNET.ORA#1 $
################
AUTOMATIC_IPC = ON
TRACE_LEVEL_CLIENT = OFF
NAMES.DEFAULT_DOMAIN = WORLD
# 05.01.06 unsorported parameter now
#NAME.DEFAULT_ZONE = WORLD
# 05.01.06 set the default to 10
SQLNET.EXPIRE_TIME = 10
# 05.01.06 set to default
#TCP.NODELAY=YES
# 05.01.06 set to 32768
DEFAULT_SDU_SIZE=32768
tnsnames.ora
################
# Filename......: tnsnames.ora
# Created.......: created by SAP AG, R/3 Rel. >= 6.10
# Name..........:
# Date..........:
# @(#) $Id: //bas/720_REL/src/krn/tpls/ora/TNSNAMES.ORA#2 $
################
EW3.WORLD=
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS =
(COMMUNITY = SAP.WORLD)
(PROTOCOL = TCP)
(HOST = msk-ewm-qas)
(PORT = 1521)
)
)
(CONNECT_DATA =
(SID = EW3)
(GLOBAL_NAME = EW3.WORLD)
)
)
/oracle/EW3/112_64/network/admin/
listner.ora
# listener.ora Network Configuration File: /oracle/EW3/11204/network/admin/listener.ora
# Generated by Oracle configuration tools.
LISTENER =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = msk-ewm-qas)(PORT = 1521))
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
)
)
ADR_BASE_LISTENER = /oracle
sqlnet.ora
# sqlnet.ora Network Configuration File: /oracle/EW3/11204/network/admin/sqlnet.ora
# Generated by Oracle configuration tools.
NAMES.DIRECTORY_PATH= (TNSNAMES)
ADR_BASE = /oracle
tnsnames.ora
# tnsnames.ora Network Configuration File: /oracle/EW3/11204/network/admin/tnsnames.ora
# Generated by Oracle configuration tools.
################
# Filename......: tnsnames.ora
# Created.......: created by SAP AG, R/3 Rel. >= 6.10
# Name..........:
# Date..........:
# @(#) $Id: //bas/720_REL/src/krn/tpls/ora/TNSNAMES.ORA#2 $
################
EW3 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = msk-ewm-qas)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = EW3)
)
)
EW3.WORLD =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (COMMUNITY = SAP.WORLD)(PROTOCOL = TCP)(HOST = msk-ewm-qas)(PORT = 1521))
)
(CONNECT_DATA =
(SID = EW3)
(GLOBAL_NAME = EW3.WORLD)
)
)
I fixed the sapservices, but it didn't help:
#!/bin/sh
LD_LIBRARY_PATH=/usr/sap/EW3/DVEBMGS00/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/EW3/DVEBMGS00/exe/sapstartsrv pf=/usr/sap/EW3/SYS/profile/START_DVEBMGS00_msk-ewm-qas -D -u ew3adm
LD_LIBRARY_PATH=/usr/sap/DAA/SMDA97/exe:$LD_LIBRARY_PATH; export LD_LIBRARY_PATH; /usr/sap/DAA/SMDA97/exe/sapstartsrv pf=/usr/sap/DAA/SYS/profile/DAA_SMDA97_msk-ewm-qas -D -u daaadm
Oracle specific files look good, as you have taken couple of actions now, try to perform below steps.
1. Stop SWPM running process, kill sapinst process
2. Keep only active default, instance and start profile profile directory, move rest of the file to other safe place, dont touch oracle folder in profile directory.
3. Stop SAP and oracle also stop any process related to EW3 instance, stop SAP services. So when you do ps -ef| grep -i ew3, you should not see any process is running.
4. Start ORacle and SAP (Make sure Earlier soft link which was created it is not place now)
5. Start SWPM from scratch.
Let give a try to above steps and let us know the result. If you still phase issue, then share the sapinst_dev.log file which was created after running new setup of SWPM.
Regards,
Anil Bhandary
Dear Anil, I did this steps, but it didn't help. Also I downloaded 2-years old SAP System Rename software - there is the same error. So something returns the bad ORACLE_HOME:
TRACE 2016-09-13 12:18:05.459 [??]
com.sap.sdt.ins.filercopy.db.ora.NetworkOra lib=java
oracle_home: /oracle/EW2/102_64
Maybe I should to try manual SAPSID and ORASID rename ?
Hello Igor
Try setting ORACLE_HOME in the listener.ora and restart tool from the begining.
Check note 562403 - FAQ: Oracle Net for an example for ORACLE_HOME in the listener.ora file.
Restart listener as well.
What is this EW2 instance ?
From the sapinst_dev we can see there is no issue with EW3 now, it is properly seeing Oracle home with 112_64. Want o understand what exactly is this EW2 and why it is going specific to 102_64.
TRACE 2016-09-13 12:18:05.459 [??]
com.sap.sdt.ins.filercopy.db.ora.NetworkOra lib=java
oracle_home: /oracle/EW2/102_64
ERROR 2016-09-13 12:18:05.463 [syxxcfsmgt.cpp:118]
CSyFileSystemMgtImpl::getNode(const CSyPath &/oracle/EW2/102_64) const
lib=syslib module=syslib
FSL-02015 Node /oracle/EW2/102_64 does not exist.
User | Count |
---|---|
85 | |
10 | |
10 | |
9 | |
7 | |
7 | |
6 | |
5 | |
4 | |
4 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.