java - glassfish server getting hang after sometime -
i facing new problem in glassfish server :(
after server starts after sometime gets hang , stops processing requests
following exceptions in server log
[#|2011-05-08t17:44:34.027+0300|warning|sun-appserver2.1|javax.enterprise.system.stream.err|_threadid=17;_threadname=timer-18 ;_requestid=a47329c8-5efa-4e29-b90d-a5bda9c8f725;| java.util.logging.errormanager: 5: error in formatting logrecord|#] [#|2011-05-08t17:44:34.036+0300|warning|sun-appserver2.1|javax.enterprise.system.stream.err|_threadid=17;_threadname=timer-18 ;_requestid=a47329c8-5efa-4e29-b90d-a5bda9c8f725;| java.security.providerexception: implnextbytes() failed @ sun.security.pkcs11.p11securerandom.implnextbytes(p11securerandom.java:170) @ sun.security.pkcs11.p11securerandom.enginenextbytes(p11securerandom.java:117) @ java.security.securerandom.nextbytes(securerandom.java:413) @ java.util.uuid.randomuuid(uuid.java:161) @ com.sun.enterprise.admin.monitor.callflow.agentimpl$threadlocalstate.<init>(agentimpl.java:162) @ com.sun.enterprise.admin.monitor.callflow.agentimpl$1.initialvalue(agentimpl.java:256) @ com.sun.enterprise.admin.monitor.callflow.agentimpl$1.initialvalue(agentimpl.java:255) @ java.lang.threadlocal$threadlocalmap.getaftermiss(threadlocal.java:374) @ java.lang.threadlocal$threadlocalmap.get(threadlocal.java:347) @ java.lang.threadlocal$threadlocalmap.access$000(threadlocal.java:225) @ java.lang.threadlocal.get(threadlocal.java:127) @ com.sun.enterprise.admin.monitor.callflow.agentimpl.getthreadlocaldata(agentimpl.java:1070) @ com.sun.enterprise.server.logging.uniformlogformatter.uniformlogformat(uniformlogformatter.java:320) @ com.sun.enterprise.server.logging.uniformlogformatter.format(uniformlogformatter.java:151) @ java.util.logging.streamhandler.publish(streamhandler.java:179) @ com.sun.enterprise.server.logging.fileandsysloghandler.publish(fileandsysloghandler.java:512) @ java.util.logging.logger.log(logger.java:440) @ java.util.logging.logger.dolog(logger.java:462) @ java.util.logging.logger.log(logger.java:526) @ com.sun.enterprise.deployment.autodeploy.autodeploycontrollerimpl$autodeploytask.run(autodeploycontrollerimpl.java :391) @ java.util.timerthread.mainloop(timer.java:512) @ java.util.timerthread.run(timer.java:462) caused by: sun.security.pkcs11.wrapper.pkcs11exception: ckr_device_error @ sun.security.pkcs11.wrapper.pkcs11.c_generaterandom(native method) @ sun.security.pkcs11.p11securerandom.implnextbytes(p11securerandom.java:167) ... 21 more |#] [#|2011-05-08t17:44:36.034+0300|severe|sun-appserver2.1|javax.enterprise.system.tools.deployment|_threadid=17;_threadname=tim er-18;_requestid=a47329c8-5efa-4e29-b90d-a5bda9c8f725;|"dpl8011: autodeployment failure while deploying application : nul l"|#] [#|2011-05-08t17:44:38.034+0300|severe|sun-appserver2.1|javax.enterprise.system.tools.deployment|_threadid=17;_threadname=tim er-18;_requestid=a47329c8-5efa-4e29-b90d-a5bda9c8f725;|"dpl8011: autodeployment failure while deploying application : nul l"|#] ******** when in hang state took thread dump , found 1 dead lock below !!!
found 1 java-level deadlock: ============================= "selectorthread-4242": waiting lock monitor 0x0040ef60 (object 0x56cd6dd0, org.apache.jasper.util.systemloghandler), held "timer-2" "timer-2": waiting lock monitor 0x0040f5d8 (object 0x568bc440, com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream), held "selectorthread-4242" java stack information threads listed above: =================================================== "selectorthread-4242": @ java.lang.throwable.printstacktrace(throwable.java:461) - waiting lock <0x56cd6dd0> (a org.apache.jasper.util.systemloghandler) @ java.lang.throwable.printstacktrace(throwable.java:452) @ java.util.logging.errormanager.error(errormanager.java:78) - locked <0x5a4fe388> (a java.util.logging.errormanager) @ com.sun.enterprise.server.logging.uniformlogformatter.uniformlogformat(uniformlogformatter.java:364) @ com.sun.enterprise.server.logging.uniformlogformatter.format(uniformlogformatter.java:151) @ java.util.logging.streamhandler.publish(streamhandler.java:179) - locked <0x568825e0> (a com.sun.enterprise.server.logging.fileandsysloghandler) @ com.sun.enterprise.server.logging.fileandsysloghandler.publish(fileandsysloghandler.java:512) - locked <0x568825e0> (a com.sun.enterprise.server.logging.fileandsysloghandler) @ java.util.logging.logger.log(logger.java:440) @ java.util.logging.logger.dolog(logger.java:462) @ java.util.logging.logger.log(logger.java:485) @ com.sun.enterprise.server.logging.systemoutanderrhandler$loggingbytearrayoutputstream.flush(systemoutanderrhandler.java:368) - locked <0x568b84f0> (a com.sun.enterprise.server.logging.systemoutanderrhandler$loggingbytearrayoutputstream) @ java.io.printstream.write(printstream.java:414) - locked <0x568bc440> (a com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream) @ com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream.write(systemoutanderrhandler.java:293) @ sun.nio.cs.streamencoder$charsetse.writebytes(streamencoder.java:336) @ sun.nio.cs.streamencoder$charsetse.implflushbuffer(streamencoder.java:404) @ sun.nio.cs.streamencoder.flushbuffer(streamencoder.java:115) - locked <0x568bc470> (a java.io.outputstreamwriter) @ java.io.outputstreamwriter.flushbuffer(outputstreamwriter.java:169) @ java.io.printstream.write(printstream.java:459) - locked <0x568bc440> (a com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream) @ java.io.printstream.print(printstream.java:602) @ com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream.print(systemoutanderrhandler.java:205) @ java.io.printstream.println(printstream.java:739) - locked <0x568bc440> (a com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream) @ com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream.println(systemoutanderrhandler.java:187) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:254) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:254) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:254) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:254) @ java.util.logging.errormanager.error(errormanager.java:76) - locked <0x5a4fe3a8> (a java.util.logging.errormanager) @ com.sun.enterprise.server.logging.uniformlogformatter.uniformlogformat(uniformlogformatter.java:364) @ com.sun.enterprise.server.logging.uniformlogformatter.format(uniformlogformatter.java:151) @ com.sun.enterprise.server.logging.amxlogginghook.publish(amxlogginghook.java:198) @ com.sun.enterprise.server.logging.fileandsysloghandler.publish(fileandsysloghandler.java:531) - locked <0x568825e0> (a com.sun.enterprise.server.logging.fileandsysloghandler) @ java.util.logging.logger.log(logger.java:440) @ java.util.logging.logger.dolog(logger.java:462) @ java.util.logging.logger.log(logger.java:551) @ com.sun.enterprise.web.connector.grizzly.selectorthread.doselect(selectorthread.java:1445) @ com.sun.enterprise.web.connector.grizzly.selectorthread.startlistener(selectorthread.java:1316) - locked <0x56cdf878> (a [ljava.lang.object;) @ com.sun.enterprise.web.connector.grizzly.selectorthread.startendpoint(selectorthread.java:1279) @ com.sun.enterprise.web.connector.grizzly.selectorthread.run(selectorthread.java:1255) "timer-2": @ java.io.printstream.println(printstream.java:738) - waiting lock <0x568bc440> (a com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream) @ com.sun.enterprise.server.logging.systemoutanderrhandler$loggingprintstream.println(systemoutanderrhandler.java:178) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:258) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:258) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:258) @ org.apache.jasper.util.systemloghandler.println(systemloghandler.java:258) @ java.lang.throwable.printstacktrace(throwable.java:462) - locked <0x56cd6dd0> (a org.apache.jasper.util.systemloghandler) @ java.lang.throwable.printstacktrace(throwable.java:452) @ com.sun.jbi.management.system.adminservice.heartbeat(adminservice.java:975) @ com.sun.jbi.management.system.adminservice.handlenotification(adminservice.java:198) @ com.sun.jmx.interceptor.defaultmbeanserverinterceptor$listenerwrapper.handlenotification(defaultmbeanserverinterceptor.java:1652) @ javax.management.notificationbroadcastersupport.handlenotification(notificationbroadcastersupport.java:221) @ javax.management.notificationbroadcastersupport.sendnotification(notificationbroadcastersupport.java:184) @ javax.management.timer.timer.sendnotification(timer.java:1295) - locked <0x57d2e590> (a javax.management.timer.timernotification) @ javax.management.timer.timer.notifyalarmclock(timer.java:1264) @ javax.management.timer.timeralarmclock.run(timer.java:1347) @ java.util.timerthread.mainloop(timer.java:512) @ java.util.timerthread.run(timer.java:462) **found 1 deadlock.** please suggest
thanks ali
got same issue
i resolve cause .properties file contained simple quote ' , when jersey logger tries log it, cannot parse json send server.
so kind of string jersey trying log , carefull on special characters
Comments
Post a Comment