Forum: Managing VoltDB

Post: Client connection failed

Client connection failed
MarcinD
Jan 16, 2014
Hi,

I have a cluster consisting of three nodes running voltdb-ent-4.0.1 enterprise edition.
Currently I am taking the steps to test snapshot functionality and analyse its impact on multiple nodes running on the same hardware.
I would like to test it with a single cluster first but here's where problem occurs.

When I am trying to pause the db I am getting the following error:


[voltdb1@dubdcr01 VoltDB]$ voltadmin pause
   ERROR: Client connection failed.
   ERROR: error Exception: [Errno 111] Connection refused

   FATAL: Exiting.
[voltdb1@dubdcr01 VoltDB]$


The deployment file looks as follows:


<?xml version="1.0"?>
<deployment>
   <cluster hostcount="3"
            sitesperhost="12"
            kfactor="2"
   />
   <httpd enabled="false">
      <jsonapi enabled="false" />
   </httpd>
   <export enabled="false" target="file">
            <configuration>
                <property name="type">csv</property>
                <property name="nonce">bm_export</property>
                <property name="period">1</property>
                <property name="skipinternals">false</property>
                <property name="outdir">/local/voltdb1/volt/exports</property>
            </configuration>
   </export>
   <commandlog enabled="true" logsize="8192" synchronous="false">
        <frequency time="100"/>
   </commandlog>
   <paths>
        <commandlog path="/local/voltdb1/volt/commandlogs" />
        <commandlogsnapshot path="/local/voltdb1/volt/snapshots" />
   </paths>
   <security enabled="false" />
   <systemsettings>
    <snapshot priority="10"/>
   </systemsettings>
   <partition-detection enabled="false">
   </partition-detection>
</deployment>


The attempt to do a snapshot from enterprise-manager fails as well.

EDIT:
Probably it is also worth to mention I didn't experience that issue with a single node configuration.

Thanks,

Marcin
aweisberg
Jan 16, 2014
Hi,

If you get connection refused it is because Volt wasn't listening on the interface and port you specified in the client. How are you starting Volt? Interfaces are specified on the command line and not in the deployment file because they differ from node to node (command line is for node specific config).

It could also be that you paused the database or started it in admin mode in which case connections would not be accepted on the client port (although the admin port would work).

-Ariel
MarcinD
Jan 16, 2014
Hi Ariel,

Thanks for your response. Below is how I start Volt on each node correspondingly


[voltdb1@dubdcr01 VoltDB]$ voltdb create ./bm_spike.jar -d deployment.xml -H 192.168.61.1 --client 21212 -l license.xml --externalinterface 192.168.61.1 --internalinterface 192.168.61.1 > volt-console.log
[voltdb1@dubdcr02 VoltDB]$ voltdb create ./bm_spike.jar -d deployment.xml -H 192.168.61.1 --client 21212 -l license.xml --externalinterface 192.168.61.2 --internalinterface 192.168.61.2 > volt-console.log
[voltdb1@dubdcr03 VoltDB]$ voltdb create ./bm_spike.jar -d deployment.xml -H 192.168.61.1 --client 21212 -l license.xml --externalinterface 192.168.61.3 --internalinterface 192.168.61.3 > volt-console.log


Regards,

Marcin
aweisberg
Jan 16, 2014
Hi,

One thing to check is the volt-console log file, to see if the server initialized message has been printed. The servers won't start accepting connections until they are ready to execute transactions.

How are you specifying the address to connect to in your client application? Is it by IP or hostname? Do you know if the hostname resolves to the correct IP for the interface being used as the external interface?

If you do "sqlcmd --servers=192.168.61.1" does it also refuse the connection?

-Ariel
MarcinD
Jan 16, 2014
Hi,

Yes, the 'Server completed initialization.' message is printed int the volt-console.log file.

In the client application address is represented with IP so I think the hostname doesn't resolve to the correct IP as "sqlcmd --servers=192.168.61.1" doesn't refuse the connection.
Also doing


[voltdb1@dubdcr01 VoltDB]$ voltadmin shutdown -H 192.168.61.1
Status: -1
Information: Connection broken

[voltdb1@dubdcr01 VoltDB]$

shuts down the database properly, Thanks for your suggestion.

Regards,
Marcin