Openfire starts, but doesn't listen on any ports

Jonathan_Tai · October 1, 2007, 8:20am

I apologize if this has been solved before; I looked around in Openfire Support for about an hour and couldn’t find any threads that describe the problem I’m having.

I just downloaded Openfire 3.3.3 and installed it to /opt/openfire. When I start the server, it stays running (according to ps), but netstat -an shows that it’s not listening on any ports. /opt/openfire/bin/nohup.out is empty. /opt/openfire/logs/info.log only has one line in it:

2007.10.01 00:56:21 Openfire 3.3.3

/opt/openfire/logs/stdoutt.log is similarly short:

…

Openfire 3.3.3

I have Openfire 3.3.3 running on another machine which is running the same OS (Ubuntu Server 7.04) and the same JRE (the one in the sun-java6-jre package). java -server -version gives:

java version “1.6.0”

Java™ SE Runtime Environment (build 1.6.0-b105)

Java HotSpot™ Server VM (build 1.6.0-b105, mixed mode)

Actually, they’re not exactly the same - the other machine (the one that works) runs the 64-bit version of Ubuntu, but if anything I would expect more trouble with the 64-bit version.

Has anyone seen this issue before? Given that the logs don’t tell me much, is there anything I can do to get more debugging output?

NO_MESSAGES_OR_FRIEN · October 1, 2007, 12:56pm

I would check your firewalls on the server to make sure that they are allowing all the ports needed by the server. Can you get to the administrative web page of openfire?

Jonathan_Tai · October 1, 2007, 4:19pm

It’s not a firewall issue, because netstat shows that Openfire isn’t even listening on the ports. It’s not binding to port 9090, 5222, etc. Since it’s not listening on port 9090, I can’t get to the administrative web page.

Gaston_Dombiak · October 1, 2007, 4:59pm

Hey Jonathan,

Have you checked the other log files? What do you see in the error.log, warn.log or stderr?

Thanks,

– Gato

Jonathan_Tai · October 1, 2007, 5:23pm

All of the log files are empty except the two that I mentioned in my original post.

Aznidin · October 1, 2007, 5:38pm

Hi Jonathan,

Anything you see in /var/log/messages or any other possible system log files? Did you run into some kind of permission or SELinux issue, maybe?

Jonathan_Tai · October 1, 2007, 5:54pm

No, unfortunately /var/log/syslog and /var/log/messages are both empty. (Well, not completely empty, but nothing except for cron messages at the time that I started Openfire.) I created a system user, openfire, to run the service. The openfire user owns /opt/openfire and all files beneath it, so I doubt there are any permissions issues. I’m not running SELinux, although the server is a linode (linode.com), so it’s a virtual User-Mode Linux server.

Aznidin · October 1, 2007, 6:05pm

That’s weird. BTW, what exactly does a ps show?

Jonathan_Tai · October 1, 2007, 6:08pm

jon@thebox:/opt/openfire/bin$ ps aux | grep ^openfire

openfire 20231 17.3 10.8 207840 27448 pts/0 Sl 11:07 0:04 /usr/bin/java -server -Dinstall4j.jvmDir=/usr -Dexe4j.moduleName=/opt/openfire/bin/openfire -classpath /opt/openfire/.install4j/i4jruntime.jar:/opt/openfire/lib/activation.jar:/opt/o penfire/lib/bouncycastle.jar:/opt/openfire/lib/commons-el.jar:/opt/openfire/lib/ hsqldb.jar:/opt/openfire/lib/jasper-compiler.jar:/opt/openfire/lib/jasper-runtim e.jar:/opt/openfire/lib/jdic.jar:/opt/openfire/lib/jtds.jar:/opt/openfire/lib/ma il.jar:/opt/openfire/lib/mysql.jar:/opt/openfire/lib/openfire.jar:/opt/openfire/ lib/postgres.jar:/opt/openfire/lib/servlet.jar:/opt/openfire/lib/startup.jar com.install4j.runtime.Launcher start org.jivesoftware.openfire.starter.ServerStarter false false /opt/openfire/bin/…/logs/stderror.log /opt/openfire/bin/…/logs/stdoutt.log true true false true true 0 0 20 20 Arial 0,0,0 8 500 version 3.3.3 20 40 Arial 0,0,0 8 500 -1 -DopenfireHome=/opt/openfire -Dopenfire.lib.dir=/opt/openfire/lib

Aznidin · October 1, 2007, 6:14pm

Hrm… do you happen to run a wrong version/distribution of Openfire? cause, you’re not supposed to see install4j when you run on Linux.

Jonathan_Tai · October 1, 2007, 6:36pm

I got it from here: http://www.igniterealtime.org/downloadServlet?filename=openfire/openfire_3_3_3.t ar.gz

(http://www.igniterealtime.org/ => Downloads => Openfire 3.3.3 => Linux => openfire_3_3_3.tar.gz)

On the other machine where Openfire is running fine, ps gives:

jon 22040 0.0 38.5 357476 100528 ? Sl Sep30 0:11 /usr/bin/java -server -Dinstall4j.jvmDir=/usr -Dexe4j.moduleName=/opt/openfire/bin/openfire -classpath /opt/openfire/.install4j/i4jruntime.jar:/opt/openfire/lib/activation.jar:/opt/o penfire/lib/bouncycastle.jar:/opt/openfire/lib/jdic.jar:/opt/openfire/lib/mail.j ar:/opt/openfire/lib/startup.jar com.install4j.runtime.Launcher start org.jivesoftware.openfire.starter.ServerStarter false false /opt/openfire/bin/…/logs/stderror.log /opt/openfire/bin/…/logs/stdoutt.log true true false true true 0 0 20 20 Arial 0,0,0 8 500 version 3.3.3 20 40 Arial 0,0,0 8 500 -1 -DopenfireHome=/opt/openfire -Dopenfire.lib.dir=/opt/openfire/lib

So I didn’t think install4j was out of the ordinary.

Jonathan_Tai · October 1, 2007, 7:14pm

I just saw this post in the More Like This section on the right… in f8arr’s case it seems like he just didn’t wait long enough for Openfire to start up. I waited the better part of an hour, so I hope that’s not it… although the whole time (while Openfire was running but not yet (?) listening on any ports) it seemed to be using a good deal of CPU.

Gaston_Dombiak · October 1, 2007, 7:29pm

Could you create a thread dump so we can see what the server is doing? Execute kill -3 to get a thread dump. The dump info will be stored in the stdout.

– Gato

Aznidin · October 1, 2007, 7:40pm

Sorry Jonathan, can’t help you much. Frankly, I’ve never known of the need to have install4j as a launcher for Openfire in Linux. Gato should be able to help.

Jonathan_Tai · October 1, 2007, 8:04pm

I didn’t see an attachment feature, so here it is:

2007-10-01 13:02:38

Full thread dump Java HotSpot™ Server VM (1.6.0-b105 mixed mode):

“btpool0-0” prio=10 tid=0x084ef000 nid=0x7cd3 in Object.wait() http://0x4baee000…0x4baeeeb0

java.lang.Thread.State: TIMED_WAITING (on object monitor)

at java.lang.Object.wait(Native Method)

waiting on <0x43d24bc8> (a org.mortbay.thread.BoundedThreadPool$PoolThread)
at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:469)
locked <0x43d24bc8> (a org.mortbay.thread.BoundedThreadPool$PoolThread)

“DestroyJavaVM” prio=10 tid=0x08059400 nid=0x7cc8 waiting on condition http://0x00000000…0x40200108

java.lang.Thread.State: RUNNABLE

“pool-1-thread-1” prio=10 tid=0x08300000 nid=0x7cd2 runnable http://0x4ba94000…0x4ba94e30

java.lang.Thread.State: RUNNABLE

at java.io.FileInputStream.readBytes(Native Method)

at java.io.FileInputStream.read(FileInputStream.java:199)

at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)

at java.io.BufferedInputStream.read(BufferedInputStream.java:317)

locked <0x43404488> (a java.io.BufferedInputStream)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)
at java.io.BufferedInputStream.read(BufferedInputStream.java:317)
locked <0x433f6f38> (a java.io.BufferedInputStream)
at sun.security.provider.SeedGenerator$URLSeedGenerator.getSeedByte(SeedGenerator. java:453)
at sun.security.provider.SeedGenerator.getSeedBytes(SeedGenerator.java:123)
at sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:118)
at sun.security.provider.SecureRandom.engineGenerateSeed(SecureRandom.java:114)
at sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:171)
locked <0x433f6bb0> (a sun.security.provider.SecureRandom)
at java.security.SecureRandom.nextBytes(SecureRandom.java:433)
locked <0x433f6e30> (a java.security.SecureRandom)

at java.security.SecureRandom.next(SecureRandom.java:455)

at java.util.Random.nextLong(Random.java:284)

at org.mortbay.jetty.servlet.HashSessionIdManager.doStart(HashSessionIdManager.jav a:105)

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.mortbay.jetty.servlet.AbstractSessionManager.doStart(AbstractSessionManager .java:166)

at org.mortbay.jetty.servlet.HashSessionManager.doStart(HashSessionManager.java:53 )

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.mortbay.jetty.servlet.SessionHandler.doStart(SessionHandler.java:115)

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117)

at org.mortbay.jetty.handler.ContextHandler.startContext(ContextHandler.java:500)

at org.mortbay.jetty.servlet.Context.startContext(Context.java:135)

at org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1191)

at org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:481)

at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:434)

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)

at org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollec tion.java:120)

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117)

at org.mortbay.jetty.Server.doStart(Server.java:210)

at org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)

at org.jivesoftware.openfire.container.AdminConsolePlugin.startup(AdminConsolePlug in.java:140)

at org.jivesoftware.openfire.container.AdminConsolePlugin.initializePlugin(AdminCo nsolePlugin.java:175)

at org.jivesoftware.openfire.container.PluginManager.loadPlugin(PluginManager.java :404)

at org.jivesoftware.openfire.container.PluginManager.access$200(PluginManager.java :46)

at org.jivesoftware.openfire.container.PluginManager$PluginMonitor.run(PluginManag er.java:916)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)

at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)

at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101 (ScheduledThreadPoolExecutor.java:98)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodi c(ScheduledThreadPoolExecutor.java:181)

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(Schedu ledThreadPoolExecutor.java:205)

at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java: 885)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)

at java.lang.Thread.run(Thread.java:619)

“Thread-0” daemon prio=10 tid=0x08119400 nid=0x7cd1 waiting on condition http://0x4b932000…0x4b932db0

java.lang.Thread.State: TIMED_WAITING (sleeping)

at java.lang.Thread.sleep(Native Method)

at com.install4j.runtime.Launcher$StopWatcherThread.run(Unknown Source)

“Low Memory Detector” daemon prio=10 tid=0x08102400 nid=0x7ccf runnable http://0x00000000…0x00000000

java.lang.Thread.State: RUNNABLE

“CompilerThread1” daemon prio=10 tid=0x08100c00 nid=0x7cce waiting on condition http://0x00000000…0x4b7fd5c8

java.lang.Thread.State: RUNNABLE

“CompilerThread0” daemon prio=10 tid=0x080ff800 nid=0x7ccd waiting on condition http://0x00000000…0x4b77c548

java.lang.Thread.State: RUNNABLE

“Signal Dispatcher” daemon prio=10 tid=0x080fe400 nid=0x7ccc runnable http://0x00000000…0x00000000

java.lang.Thread.State: RUNNABLE

“Finalizer” daemon prio=10 tid=0x080ebc00 nid=0x7ccb in Object.wait() http://0x4b6aa000…0x4b6aaeb0

java.lang.Thread.State: WAITING (on object monitor)

at java.lang.Object.wait(Native Method)

waiting on <0x43aa5b50> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
locked <0x43aa5b50> (a java.lang.ref.ReferenceQueue$Lock)

at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)

at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

“Reference Handler” daemon prio=10 tid=0x080eb000 nid=0x7cca in Object.wait() http://0x4b659000…0x4b659e30

java.lang.Thread.State: WAITING (on object monitor)

at java.lang.Object.wait(Native Method)

waiting on <0x43aa5be0> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
locked <0x43aa5be0> (a java.lang.ref.Reference$Lock)

“VM Thread” prio=10 tid=0x080e8800 nid=0x7cc9 runnable

“VM Periodic Task Thread” prio=10 tid=0x08103c00 nid=0x7cd0 waiting on condition

JNI global references: 834

Heap

def new generation total 960K, used 710K [0x43360000, 0x43460000, 0x43a70000)

eden space 896K, 79% used [0x43360000, 0x434118d0, 0x43440000)

from space 64K, 0% used [0x43450000, 0x43450000, 0x43460000)

to space 64K, 0% used [0x43440000, 0x43440000, 0x43450000)

tenured generation total 5508K, used 3304K [0x43a70000, 0x43fd1000, 0x47360000)

the space 5508K, 59% used [0x43a70000, 0x43daa020, 0x43daa200, 0x43fd1000)

compacting perm gen total 16384K, used 7458K [0x47360000, 0x48360000, 0x4b360000)

the space 16384K, 45% used [0x47360000, 0x47aa8918, 0x47aa8a00, 0x48360000)

No shared spaces configured.

Gaston_Dombiak · October 1, 2007, 8:13pm

Ok, that thread dumps shows that there are no listener threads running in the JVM. Many things are missing there. I’m not sure how you installed and set up the server but could you edit the file config/openfire.xml and the set setup property to false? Restart the server and see if you can access the admin console?

Regards,

– Gato

Jonathan_Tai · October 1, 2007, 10:33pm

I added in the config file and restarted the server - no change in behavior. It doesn’t listen on any ports, so I can’t connect to the admin console.

As for how I installed Openfire - I just followed the installation document. I downloaded the tarball, unpacked it, and moved it over to /opt. I took the additional steps of adding an “openfire” system user and then (as root) chown -R openfire:openfire /opt/openfire. I start the server as the openfire user (not as root).

Gaston_Dombiak · October 1, 2007, 10:41pm

And what happens if you run it as root? Could you post another thread dump with the setup in false?

Thanks,

– Gato

Jonathan_Tai · October 2, 2007, 12:06am

Ran as root, still won’t listen on any ports. Here’s the trace when openfire is running as root.

2007-10-01 17:04:47

Full thread dump Java HotSpot™ Server VM (1.6.0-b105 mixed mode):

“btpool0-0” prio=10 tid=0x0851b000 nid=0x3a0a in Object.wait() http://0x4baee000…0x4baeef30

java.lang.Thread.State: TIMED_WAITING (on object monitor)

at java.lang.Object.wait(Native Method)

waiting on <0x43dce6c0> (a org.mortbay.thread.BoundedThreadPool$PoolThread)

at org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:469)

locked <0x43dce6c0> (a org.mortbay.thread.BoundedThreadPool$PoolThread)

“DestroyJavaVM” prio=10 tid=0x08059400 nid=0x39ff waiting on condition http://0x00000000…0x40200080

java.lang.Thread.State: RUNNABLE

“pool-1-thread-1” prio=10 tid=0x084b2400 nid=0x3a09 runnable http://0x4ba94000…0x4ba94db0

java.lang.Thread.State: RUNNABLE

at java.io.FileInputStream.readBytes(Native Method)

at java.io.FileInputStream.read(FileInputStream.java:199)

at java.io.BufferedInputStream.read1(BufferedInputStream.java:256)

at java.io.BufferedInputStream.read(BufferedInputStream.java:317)

locked <0x434106f0> (a java.io.BufferedInputStream)

at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)

at java.io.BufferedInputStream.read1(BufferedInputStream.java:258)

at java.io.BufferedInputStream.read(BufferedInputStream.java:317)

locked <0x43410330> (a java.io.BufferedInputStream)

at sun.security.provider.SeedGenerator$URLSeedGenerator.getSeedByte(SeedGenerator. java:453)

at sun.security.provider.SeedGenerator.getSeedBytes(SeedGenerator.java:123)

at sun.security.provider.SeedGenerator.generateSeed(SeedGenerator.java:118)

at sun.security.provider.SecureRandom.engineGenerateSeed(SecureRandom.java:114)

at sun.security.provider.SecureRandom.engineNextBytes(SecureRandom.java:171)

locked <0x4340ffa8> (a sun.security.provider.SecureRandom)

at java.security.SecureRandom.nextBytes(SecureRandom.java:433)

locked <0x43410228> (a java.security.SecureRandom)