Processed dump event systhrow java/lang/OutOfMemory
Agent down due to “Processed dump event “systhrow”, detail “java/lang/OutOfMemoryError” on RAC.
Issue:
Agent is down on Node1 in two node RAC due to OutOfMemoryError
Overview of Environment:
Oracle 11g RAC on AIX
Solution:
1. We modified agentJavaDefines parameter in emd.properties. Both nodes were have different value
Node1:- agentJavaDefines=-Xmx1536M
Node2:- agentJavaDefines=-Xmx2048M
2.We modified same value in Node1
2. 2.1 emclt stop agent
2.2 ps -ef | grep java | grep ‘/u00/app/oracle/12105/agent12c’
killed java process
2.3 moved state files to other location. (Node1)
mv agent_inst/sysman/emd/state/* /tmp/state-bkp
3. emctl clearstate agent
4. emctl stop agent
5. emctl start agent
|
Node1:/u00/app/oracle/12105/agent12c/core/12.1.0.5.0/bin:$ emctl status agent
Oracle Enterprise Manager Cloud Control 12c Release 5
|
—————————————————————
Agent Version : 12.1.0.5.0
OMS Version : 13.2.0.0.0
Protocol Version : 12.1.0.1.0
Agent Home : /u00/app/oracle/12105/agent12c/agent_inst
Agent Log Directory : /u00/app/oracle/12105/agent12c/agent_inst/sysman/log
Agent Binaries : /u00/app/oracle/12105/agent12c/core/12.1.0.5.0
Agent Process ID : 23134402
Parent Process ID : 41222322
Agent URL : https://Node1.3872/emd/main/
Local Agent URL in NAT : https://Node1.3872/emd/main/
Repository URL : https://OEM.4903/empbs/upload
Started at : 2018-10-24 13:37:48
Started by user : oracle
Operating System : AIX version 7.1 (ppc64)
Last Reload : (none)
Last successful upload : 2018-10-24 13:38:49
Last attempted upload : 2018-10-24 13:38:49
Total Megabytes of XML files uploaded so far : 1.09
Number of XML files pending upload : 0
Size of XML files pending upload(MB) : 0
Available disk space on upload filesystem : 61.97%
Collection Status : Collections enabled
Heartbeat Status : Ok
Last attempted heartbeat to OMS : 2018-10-24 13:38:18
Last successful heartbeat to OMS : 2018-10-24 13:38:18
Next scheduled heartbeat to OMS : 2018-10-24 13:39:18
—————————————————————
Agent is Running and Ready
See Also: