Question : the WAS server goes down occasionaly

the WAS server goes down occasionally. The error i see right prior to it is as follows and seems to be related to
failure in loading T2 native library db2jcct2. I dont understand why this kind of error might bring the server down.

 
Code Snippet:
1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:
20:
21:
22:
23:
24:
25:
26:
27:
28:
29:
30:
31:
32:
33:
34:
35:
36:
37:
38:
39:
40:
41:
42:
43:
44:
45:
46:
47:
48:
49:
50:
51:
52:
53:
54:
55:
56:
57:
58:
59:
60:
61:
62:
63:
64:
65:
66:
67:
68:
69:
70:
71:
72:
73:
74:
75:
76:
77:
78:
79:
80:
81:
82:
83:
[6/10/09 7:57:44:652 EDT] 00000034 SystemErr     R com.ibm.db2.jcc.c.SqlException: Failure in loading T2 native library db2jcct2, reason: java.lang.Unsatisfi
 
edLinkError: db2jcct2 (A file or directory in the path name does not exist.)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at com.ibm.db2.jcc.t2.a.a(a.java:31)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at com.ibm.db2.jcc.t2.T2Configuration.(T2Configuration.java:84)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at java.lang.J9VMInternals.initializeImpl(Native Method)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at java.lang.J9VMInternals.initialize(J9VMInternals.java:194)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at com.ibm.db2.jcc.DB2Driver.connect(DB2Driver.java:182)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at java.sql.DriverManager.getConnection(DriverManager.java:562)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at java.sql.DriverManager.getConnection(DriverManager.java:155)
 
[6/10/09 7:57:44:664 EDT] 00000034 SystemErr     R      at com.ibm.mm.sdk.internal.sql.db2.PDB2ConnectionICM.(PDB2ConnectionICM.java:83)
 
[6/10/09 7:57:44:665 EDT] 00000034 SystemErr     R      at com.ibm.mm.sdk.internal.sql.PDriverICM.connect(PDriverICM.java:81)
 
[6/10/09 7:57:44:665 EDT] 00000034 SystemErr     R      at java.sql.DriverManager.getConnection(DriverManager.java:562)
 
[6/10/09 7:57:44:665 EDT] 00000034 SystemErr     R      at java.sql.DriverManager.getConnection(DriverManager.java:186)
 
[6/10/09 7:57:44:668 EDT] 00000034 SystemErr     R Caused by: java.lang.UnsatisfiedLinkError: db2jcct2 (A file or directory in the path name does not exist.)
        at java.lang.ClassLoader.loadLibraryWithPath(ClassLoader.java:979)
        at java.lang.ClassLoader.loadLibraryWithClassLoader(ClassLoader.java:948)
        at java.lang.System.loadLibrary(System.java:453)
        at com.ibm.db2.jcc.t2.b.run(b.java:35)
        at java.security.AccessController.doPrivileged(AccessController.java:197)
        at com.ibm.db2.jcc.t2.a.a(a.java:26)
        at com.ibm.db2.jcc.t2.T2Configuration.(T2Configuration.java:84)
        at java.lang.J9VMInternals.initializeImpl(Native Method)
        at java.lang.J9VMInternals.initialize(J9VMInternals.java:194)
        at com.ibm.db2.jcc.DB2Driver.connect(DB2Driver.java:182)
        at java.sql.DriverManager.getConnection(DriverManager.java:562)
        at java.sql.DriverManager.getConnection(DriverManager.java:155)
        at com.ibm.mm.sdk.internal.sql.db2.PDB2ConnectionICM.(PDB2ConnectionICM.java:83)
        at com.ibm.mm.sdk.internal.sql.PDriverICM.connect(PDriverICM.java:81)
        at java.sql.DriverManager.getConnection(DriverManager.java:562)
        at java.sql.DriverManager.getConnection(DriverManager.java:186)
        at com.ibm.mm.sdk.server.DKDatastoreICM.connect(DKDatastoreICM.java:2377)
        at com.tools.cm.CMServerHandler.cmConnect(CMServerHandler.java:74)
        at com.tools.cm.CMServerHandler.findBBLPdf(CMServerHandler.java:97)
        at com.cm.servlets.StatementSearch.performCMLookup(StatementSearch.java:59)
        at com.cm.servlets.StatementSearch.doPost(StatementSearch.java:192)
        at com.cm.servlets.StatementSearch.doGet(StatementSearch.java:152)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:743)
        at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
        at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1096)
        at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:570)
        at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:478)
        at com.ibm.ws.webcontainer.webapp.WebApp.handleRequest(WebApp.java:3444)
        at com.ibm.ws.webcontainer.webapp.WebGroup.handleRequest(WebGroup.java:267)
        at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:815)
        at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1466)
        at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:119)
        at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:458)
        at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:387)
        at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:267)
        at com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscriminators(NewConnectionInitialReadCallback.java:214)
        at com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewConnectionInitialReadCallback.java:113)
        at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
        at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
        at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
        at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:136)
        at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:195)
        at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:743)
        at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:873)
        at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1473)
 
[6/10/09 7:57:44:676 EDT] 00000034 SystemErr     R      at java.lang.ClassLoader.loadLibraryWithPath(ClassLoader.java:979)
[6/10/09 7:57:44:676 EDT] 00000034 SystemErr     R      at java.lang.ClassLoader.loadLibraryWithClassLoader(ClassLoader.java:948)
[6/10/09 7:57:44:676 EDT] 00000034 SystemErr     R      at java.lang.System.loadLibrary(System.java:453)
[6/10/09 7:57:44:676 EDT] 00000034 SystemErr     R      at com.ibm.db2.jcc.t2.b.run(b.java:35)
[6/10/09 7:57:44:677 EDT] 00000034 SystemErr     R      at java.security.AccessController.doPrivileged(AccessController.java:197)
[6/10/09 7:57:44:677 EDT] 00000034 SystemErr     R      at com.ibm.db2.jcc.t2.a.a(a.java:26)
[6/10/09 7:57:44:677 EDT] 00000034 SystemErr     R      ... 39 more
[6/10/09 7:57:44:749 EDT] 00000034 SystemErr     R com.ibm.mm.sdk.common.DKDatastoreAccessError: DGL0394A: Error in ::DriverManager.getConnection; Failure in
 loading T2 native library db2jcct2, reason: java.lang.UnsatisfiedLinkError: db2jcct2 (A file or directory in the path name does not exist.) (STATE) : ; [SER
VER = ICMPROD, USERID = icmconct, SQL RC = -99999, SQL STATE = ]

Answer : the WAS server goes down occasionaly

I presume that you have DB2, and the associated library files installed.

What version of WSAS are you using?

1. Open a command prompt
2. cd to the websphere application server bin directory
    - On Windows, this would be something like:
      cd /d D:\IBM\WebSphere\AppServer\bin
    - On *ix type systems, this would be something like:
      cd /opt/IBM/WebSphere/AppServer/bin
3. Execute the "versionInfo" command script
    - On Windows, this would be something like:
      versionInfo
    - On *ix type systems, this would be something like:
      ./versionInfo.sh

Near the end of the output you should see something like shown below.

- Next, you can take a look at this document
  http://www.IBM.com/support/docview.wss?rs=180&uid=swg21228700
  Title: ProblemDetermination: Classloader problems for WebSphere Application Server

  That URL is to the "Analyzing Data" tab.  You may also want to take a look at the other tabs:

  - Learning More
  - Troubleshooting
  - Collecting data
1:
2:
3:
4:
5:
6:
7:
Installed Product
--------------------------------------------------------------------------------
Name                     IBM WebSphere Application Server - ND
Version                  6.1.0.23
ID                       ND
Build Level              cf230910.10
Build Date               3/10/09
Random Solutions  
 
programming4us programming4us