Admin console suddenly not availible

Hi All,

since yesterday we have a problem with our Jabber/Openfire Server. All clients are unable to connect to the server.

I just checked the ports via nmap at the Server, only ssh and rpcbind ports are availible.

Even the Admin-Frontend :9090 did not work.

A reboot didn’t help.

nmap:

Starting Nmap 6.00 ( http://nmap.org ) at 2012-11-30 12:39 CET

Stats: 0:00:00 elapsed; 0 hosts completed (0 up), 1 undergoing Ping Scan

Ping Scan Timing: About 100.00% done; ETC: 12:39 (0:00:00 remaining)

Nmap scan report for srvjab001 (10.12.0.26)

Host is up (0.00042s latency).

Not shown: 998 closed ports

PORT STATE SERVICE

22/tcp open ssh

111/tcp open rpcbind

error.log:

2012.11.30 12:03:26 java.sql.SQLException: ConnectionManager.getConnection() failed to obtain a connection after 11 retries. The exception from the last attempt is as follows: com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:

** BEGIN NESTED EXCEPTION **

java.net.UnknownHostException

MESSAGE: srvsql004

STACKTRACE:

java.net.UnknownHostException: srvsql004

      at java.net.InetAddress.getAllByName0(InetAddress.java:1150)

      at java.net.InetAddress.getAllByName(InetAddress.java:1072)

      at java.net.InetAddress.getAllByName(InetAddress.java:1008)

      at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:246)

      at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:271)

      at com.mysql.jdbc.Connection.createNewIO(Connection.java:2771)

      at com.mysql.jdbc.Connection.<init>(Connection.java:1555)

      at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285)

      at java.sql.DriverManager.getConnection(DriverManager.java:525)

      at java.sql.DriverManager.getConnection(DriverManager.java:140)

      at org.logicalcobwebs.proxool.DefaultConnectionBuilder.buildConnection(DefaultConn ectionBuilder.java:39)

      at org.logicalcobwebs.proxool.Prototyper.buildConnection(Prototyper.java:159)

      at org.logicalcobwebs.proxool.ConnectionPool.getConnection(ConnectionPool.java:211 )

      at org.logicalcobwebs.proxool.ProxoolDriver.connect(ProxoolDriver.java:89)

      at java.sql.DriverManager.getConnection(DriverManager.java:525)

      at java.sql.DriverManager.getConnection(DriverManager.java:140)

      at org.jivesoftware.database.DefaultConnectionProvider.getConnection(DefaultConnec tionProvider.java:86)

      at org.jivesoftware.database.DbConnectionManager.getConnection(DbConnectionManager .java:124)

      at org.jivesoftware.openfire.XMPPServer.verifyDataSource(XMPPServer.java:754)

      at org.jivesoftware.openfire.XMPPServer.start(XMPPServer.java:480)

      at org.jivesoftware.openfire.XMPPServer.<init>(XMPPServer.java:212)

      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)

      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessor Impl.java:39)

      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructor AccessorImpl.java:27)

      at java.lang.reflect.Constructor.newInstance(Constructor.java:501)

      at java.lang.Class.newInstance0(Class.java:350)

      at java.lang.Class.newInstance(Class.java:303)

      at org.jivesoftware.openfire.starter.ServerStarter.start(ServerStarter.java:113)

      at org.jivesoftware.openfire.starter.ServerStarter.main(ServerStarter.java:58)

** END NESTED EXCEPTION **

warn.log:

2012.11.30 12:22:39 tmpdir

java.io.IOException: Permission denied

      at java.io.UnixFileSystem.createFileExclusively(Native Method)

      at java.io.File.checkAndCreate(File.java:1343)

      at java.io.File.createTempFile(File.java:1431)

      at java.io.File.createTempFile(File.java:1467)

      at org.eclipse.jetty.webapp.WebInfConfiguration.resolveTempDirectory(WebInfConfigu ration.java:295)

      at org.eclipse.jetty.webapp.WebInfConfiguration.preConfigure(WebInfConfiguration.j ava:43)

      at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:347)

      at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java :55)

      at org.eclipse.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.ja va:165)

      at org.eclipse.jetty.server.handler.ContextHandlerCollection.doStart(ContextHandle rCollection.java:162)

      at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java :55)

      at org.eclipse.jetty.server.handler.HandlerCollection.doStart(HandlerCollection.ja va:165)

      at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java :55)

      at org.eclipse.jetty.server.handler.HandlerWrapper.doStart(HandlerWrapper.java:92)

      at org.eclipse.jetty.server.Server.doStart(Server.java:228)

      at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java :55)

      at org.jivesoftware.openfire.container.AdminConsolePlugin.startup(AdminConsolePlug in.java:166)

      at org.jivesoftware.openfire.container.AdminConsolePlugin.initializePlugin(AdminCo nsolePlugin.java:201)

      at org.jivesoftware.openfire.container.PluginManager.loadPlugin(PluginManager.java :483)

      at org.jivesoftware.openfire.container.PluginManager.access$300(PluginManager.java :80)

      at org.jivesoftware.openfire.container.PluginManager$PluginMonitor.run(PluginManag er.java:1067)

      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:417)

      at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:280)

      at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:135)

      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101 (ScheduledThreadPoolExecutor.java:65)

      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodi c(ScheduledThreadPoolExecutor.java:146)

      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Schedu ledThreadPoolExecutor.java:170)

      at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java: 651)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:676)

      at java.lang.Thread.run(Thread.java:595)

2012.11.30 13:01:18 Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended.

2012.11.30 13:01:19 Going to buffer response body of large or unknown size. Using getResponseBodyAsStream instead is recommended.

info.log:

2012.11.30 12:03:26 Server halted

2012.11.30 12:11:24 Publish-Subscribe domain: pubsub.srvjab001

2012.11.30 12:11:24 Mehrbenutzerchat Domain domain: conference.srvjab001

2012.11.30 12:11:26 Openfire 3.7.0 [30.11.2012 12:11:26]

2012.11.30 12:22:33 Publish-Subscribe domain: pubsub.srvjab001

2012.11.30 12:22:33 Mehrbenutzerchat Domain domain: conference.srvjab001

2012.11.30 12:22:37 Openfire 3.7.0 [30.11.2012 12:22:37]

Just let me know, if you are missing any information.

Best regards

Justus

I had the same issue.

In my case were incorrect permissions on the /tmp folder (CentOS)

was

drw-rw-rw-. 12 root root 4096 Dec 2 11:36 tmp

after chmod 777 it begun works

drwxrwxrwx. 12 root root 4096 Dec 2 11:36 tmp