Error: "TIBCO-AMX-HPA-014903: Failed recovery of java:JMSQueueConnectionFactory with MCF XManagedConnectionFactory", during node restart.

Error: "TIBCO-AMX-HPA-014903: Failed recovery of java:JMSQueueConnectionFactory with MCF XManagedConnectionFactory", during node restart.

book

Article ID: KB0089415

calendar_today

Updated On:

Products Versions
TIBCO ActiveMatrix Service Grid -
Not Applicable -

Description

Description:
Error,:"TIBCO-AMX-HPA-014903: Failed recovery of java:JMSQueueConnectionFactory with MCF XManagedConnectionFactory" during node restart.

==
13 May 2014 23:19:13,938 [TxRecoveryThread: java:JMSQueueConnectionFactory] [ERROR] [] com.tibco.amx.hpa.tm.ResourceRecoverer - TIBCO-AMX-HPA-014903: Failed recovery of java:JMSQueueConnectionFactory with MCF XManagedConnectionFactory: class = TibcoXMCFUnifiedXA, username = , password = , connection url = jndi://, producer pooling = false, mRA = [com.tibco.amf.sharedresource.runtime.tibcoh
ost.jms.TibcoRAJNDIResourceAdapterForTibcohost:with 0 activations], mOptionsStr = JMSJCA.sep=,,JMSJCA.UnifiedCF=QueueConnectionFactory,remoteJndiConfigurationName=java:JNDIConnectionConfiguration,
identityJndiName=java:JMSQueueConnectionFactory_userIdentityJNDIName,
TIBCO-AMX-SR-JMS-800012: Could not find JNDI object by name: QueueConnectionFactory
javax.naming.ServiceUnavailableException: Failed to query JNDI: InterruptedException has occurred while waiting for server response [Root exception is javax.jms.JMSException: InterruptedException
has occurred while waiting for server response]
        at com.tibco.tibjms.naming.TibjmsContext.lookup(TibjmsContext.java:671)
        at com.tibco.tibjms.naming.TibjmsContext.lookup(TibjmsContext.java:491)
        at javax.naming.InitialContext.lookup(InitialContext.java:392)
        at com.stc.jmsjca.tibco.TibcoRAJNDIObjectFactory.getJndiObject(TibcoRAJNDIObjectFactory.java:388)
        at com.stc.jmsjca.jndi.RAJNDIObjectFactory.createConnectionFactory(RAJNDIObjectFactory.java:226)
        at com.stc.jmsjca.tibco.TibcoRAJNDIObjectFactory.createConnectionFactory(TibcoRAJNDIObjectFactory.java:111)
        at com.stc.jmsjca.core.XManagedConnectionFactory.getConnectionFactory(XManagedConnectionFactory.java:248)
        at com.stc.jmsjca.core.XManagedConnectionFactory.getConnectionFactory(XManagedConnectionFactory.java:276)
        at com.stc.jmsjca.core.XManagedConnection.<init>(XManagedConnection.java:115)
        at com.stc.jmsjca.core.XManagedConnectionFactory.createManagedConnection(XManagedConnectionFactory.java:300)
        at org.apache.geronimo.connector.outbound.MCFConnectionInterceptor.getConnection(MCFConnectionInterceptor.java:48)
        at org.apache.geronimo.connector.outbound.XAResourceInsertionInterceptor.getConnection(XAResourceInsertionInterceptor.java:41)
        at org.apache.geronimo.connector.outbound.SinglePoolConnectionInterceptor.internalGetConnection(SinglePoolConnectionInterceptor.java:70)
        at org.apache.geronimo.connector.outbound.AbstractSinglePoolConnectionInterceptor.getConnection(AbstractSinglePoolConnectionInterceptor.java:80)
        at org.apache.geronimo.connector.outbound.TIBCOConnectionValidatingInterceptor.getConnection(TIBCOConnectionValidatingInterceptor.java:44)
        at org.apache.geronimo.connector.outbound.TransactionEnlistingInterceptor.getConnection(TransactionEnlistingInterceptor.java:46)
        at org.apache.geronimo.connector.outbound.TransactionCachingInterceptor.getConnection(TransactionCachingInterceptor.java:94)
        at org.apache.geronimo.connector.outbound.TCCLInterceptor.getConnection(TCCLInterceptor.java:39)
        at org.apache.geronimo.connector.outbound.AbstractConnectionManager.doRecovery(AbstractConnectionManager.java:65)
        at com.tibco.amf.resources.tibcohost.geronimo.transaction.ResourceRecoverer.recoverUsingMCF(ResourceRecoverer.java:115)
        at com.tibco.amf.resources.tibcohost.geronimo.transaction.ResourceRecoverer.run(ResourceRecoverer.java:99)
        at java.lang.Thread.run(Thread.java:662)
Caused by: javax.jms.JMSException: InterruptedException has occurred while waiting for server response
        at com.tibco.tibjms.Tibjmsx.buildException(Tibjmsx.java:509)
        at com.tibco.tibjms.TibjmsxLink.sendRequest(TibjmsxLink.java:364)
        at com.tibco.tibjms.TibjmsxLink.sendRequestMsg(TibjmsxLink.java:282)
        at com.tibco.tibjms.TibjmsConnection._createSession(TibjmsConnection.java:2719)
        at com.tibco.tibjms.TibjmsConnection._createSession(TibjmsConnection.java:2663)
        at com.tibco.tibjms.TibjmsQueueConnection.createQueueSession(TibjmsQueueConnection.java:46)
        at com.tibco.tibjms.naming.TibjmsContext$Messenger.request(TibjmsContext.java:326)
        at com.tibco.tibjms.naming.TibjmsContext.lookup(TibjmsContext.java:657)
        ... 21 more
13 May 2014 23:19:14,019 [TxRecoveryThread: java:JMSTopicConnectionFactory] [ERROR] [] org.apache.geronimo.connector.outbound.MCFConnectionInterceptor - Error occurred creating ManagedConnection for org.apache.geronimo.connector.outbound.ConnectionInfo@4e96d02a
javax.resource.ResourceException: JMSJCA-E084: Failed to create session: InterruptedException has occurred while waiting for server response
        at com.stc.jmsjca.util.Exc.rsrcExc(Exc.java:78)
        at com.stc.jmsjca.core.XManagedConnection.<init>(XManagedConnection.java:131)
        at com.stc.jmsjca.core.XManagedConnectionFactory.createManagedConnection(XManagedConnectionFactory.java:300)
        at org.apache.geronimo.connector.outbound.MCFConnectionInterceptor.getConnection(MCFConnectionInterceptor.java:48)
        at org.apache.geronimo.connector.outbound.XAResourceInsertionInterceptor.getConnection(XAResourceInsertionInterceptor.java:41)
        at org.apache.geronimo.connector.outbound.SinglePoolConnectionInterceptor.internalGetConnection(SinglePoolConnectionInterceptor.java:70)
        at org.apache.geronimo.connector.outbound.AbstractSinglePoolConnectionInterceptor.getConnection(AbstractSinglePoolConnectionInterceptor.java:80)
        at org.apache.geronimo.connector.outbound.TIBCOConnectionValidatingInterceptor.getConnection(TIBCOConnectionValidatingInterceptor.java:44)
        at org.apache.geronimo.connector.outbound.TransactionEnlistingInterceptor.getConnection(TransactionEnlistingInterceptor.java:46)
        at org.apache.geronimo.connector.outbound.TransactionCachingInterceptor.getConnection(TransactionCachingInterceptor.java:94)
        at org.apache.geronimo.connector.outbound.TCCLInterceptor.getConnection(TCCLInterceptor.java:39)
        at org.apache.geronimo.connector.outbound.AbstractConnectionManager.doRecovery(AbstractConnectionManager.java:65)
        at com.tibco.amf.resources.tibcohost.geronimo.transaction.ResourceRecoverer.recoverUsingMCF(ResourceRecoverer.java:115)
        at com.tibco.amf.resources.tibcohost.geronimo.transaction.ResourceRecoverer.run(ResourceRecoverer.java:99)
        at java.lang.Thread.run(Thread.java:662)
Caused by: javax.jms.JMSException: InterruptedException has occurred while waiting for server response
        at com.tibco.tibjms.Tibjmsx.buildException(Tibjmsx.java:509)
        at com.tibco.tibjms.TibjmsxLink.sendRequest(TibjmsxLink.java:364)
        at com.tibco.tibjms.TibjmsxLink.sendRequestMsg(TibjmsxLink.java:282)
        at com.tibco.tibjms.TibjmsConnection._createSession(TibjmsConnection.java:2719)
        at com.tibco.tibjms.TibjmsConnection._createSession(TibjmsConnection.java:2663)
        at com.tibco.tibjms.TibjmsConnection.createSession(TibjmsConnection.java:4404)
        at com.stc.jmsjca.core.RAJMSObjectFactory.createSession(RAJMSObjectFactory.java:343)
        at com.stc.jmsjca.core.GenericSessionConnection.<init>(GenericSessionConnection.java:121)
        at com.stc.jmsjca.jndi.JNDISessionConnection.<init>(JNDISessionConnection.java:56)
        at com.stc.jmsjca.jndi.RAJNDIObjectFactory.createSessionConnection(RAJNDIObjectFactory.java:246)
        at com.stc.jmsjca.core.JSession.<init>(JSession.java:97)
        at com.stc.jmsjca.core.XManagedConnection.<init>(XManagedConnection.java:129)
        ... 13 more
Caused by: java.lang.InterruptedException
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:485)
        at com.tibco.tibjms.TibjmsxLink.sendRequest(TibjmsxLink.java:359)
        ... 23 more
==

Symptoms:
During node restart , the following error is printed on the node.

==
13 May 2014 23:19:13,938 [TxRecoveryThread: java:JMSQueueConnectionFactory] [ERROR] [] com.tibco.amx.hpa.tm.ResourceRecoverer - TIBCO-AMX-HPA-014903: Failed recovery of java:JMSQueueConnectionFactory with MCF XManagedConnectionFactory: class = TibcoXMCFUnifiedXA, username = , password = , connection url = jndi://, producer pooling = false, mRA = [com.tibco.amf.sharedresource.runtime.tibcoh
ost.jms.TibcoRAJNDIResourceAdapterForTibcohost:with 0 activations], mOptionsStr = JMSJCA.sep=,,JMSJCA.UnifiedCF=QueueConnectionFactory,remoteJndiConfigurationName=java:JNDIConnectionConfiguration,
identityJndiName=java:JMSQueueConnectionFactory_userIdentityJNDIName,
TIBCO-AMX-SR-JMS-800012: Could not find JNDI object by name: QueueConnectionFactory
javax.naming.ServiceUnavailableException: Failed to query JNDI: InterruptedException has occurred while waiting for server response [Root exception is javax.jms.JMSException: InterruptedException
has occurred while waiting for server response]
  
...

        ... 21 more
13 May 2014 23:19:14,019 [TxRecoveryThread: java:JMSTopicConnectionFactory] [ERROR] [] org.apache.geronimo.connector.outbound.MCFConnectionInterceptor - Error occurred creating ManagedConnection for org.apache.geronimo.connector.outbound.ConnectionInfo@4e96d02a
javax.resource.ResourceException: JMSJCA-E084: Failed to create session: InterruptedException has occurred while waiting for server response
        at com.stc.jmsjca.util.Exc.rsrcExc(Exc.java:78)
        at com.stc.jmsjca.core.XManagedConnection.<init>(XManagedConnection.java:131)
        at com.stc.jmsjca.core.XManagedConnectionFactory.createManagedConnection(XManagedConnectionFactory.java:300)
...

        at java.lang.Thread.run(Thread.java:662)
Caused by: javax.jms.JMSException: InterruptedException has occurred while waiting for server response
        at com.tibco.tibjms.Tibjmsx.buildException(Tibjmsx.java:509)
        at com.tibco.tibjms.TibjmsxLink.sendRequest(TibjmsxLink.java:364)
        at com.tibco.tibjms.TibjmsxLink.sendRequestMsg(TibjmsxLink.java:282)
        at com.tibco.tibjms.TibjmsConnection._createSession(TibjmsConnection.java:2719)
        at com.tibco.tibjms.TibjmsConnection._createSession(TibjmsConnection.java:2663)
        at com.tibco.tibjms.TibjmsConnection.createSession(TibjmsConnection.java:4404)
        at com.stc.jmsjca.core.RAJMSObjectFactory.createSession(RAJMSObjectFactory.java:343)
        at com.stc.jmsjca.core.GenericSessionConnection.<init>(GenericSessionConnection.java:121)
        at com.stc.jmsjca.jndi.JNDISessionConnection.<init>(JNDISessionConnection.java:56)
        at com.stc.jmsjca.jndi.RAJNDIObjectFactory.createSessionConnection(RAJNDIObjectFactory.java:246)
        at com.stc.jmsjca.core.JSession.<init>(JSession.java:97)
        at com.stc.jmsjca.core.XManagedConnection.<init>(XManagedConnection.java:129)
        ... 13 more
Caused by: java.lang.InterruptedException
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:485)
        at com.tibco.tibjms.TibjmsxLink.sendRequest(TibjmsxLink.java:359)
        ... 23 more
==

Cause:
A JMS Connection Factory Resource Instance failed. The error was reported regarding a Resource Instance 'JMSQueueConnectionFactory' on the problematic node.

Issue/Introduction

Error: "TIBCO-AMX-HPA-014903: Failed recovery of java:JMSQueueConnectionFactory with MCF XManagedConnectionFactory", during node restart.

Resolution

1). From the Administrator GUI, go to Infrastructure-> Nodes -> <select the node> -> Resource Instances.

2). Check for the resource instance printed in the error stack, example: 'JMSQueueConnectionFactory'. If there is one, check if it status is 'out of sync'.

3). Go to the associated resource template to make sure all configuration details are correct. Make sure that the target EMS server is available and the existence of the mentioned connection factory by running "show factories" from the EMS Administrator.

4). After verifying that the details are correct, reinstall the resource instance.

5). Restart the node.