Forum: Building VoltDB Applications

Post: kafkaloader tool - Failed to Insert Row

kafkaloader tool - Failed to Insert Row
norberto.enomoto
Apr 4, 2015
I'm using kafkaloader tool and I'm getting the following error message:

2015-04-04 19:07:09,606 ERROR [apachelog-8] KAFKALOADER: Failed to Insert Row: {"2015-04-04 22:07:08.540","elk-VirtualBox","/home/elk/Desktop/logs/access.log.2015-03-17-10_46_37","127.0.0.1","-","-","POST","/index.html","1.1","200","474","server_01","system" }

Table definition:

CREATE TABLE apachelog (
datetime TIMESTAMP,
host VARCHAR(100),
path VARCHAR(200),
clientip VARCHAR(15),
ident VARCHAR(50),
auth VARCHAR(50),
verb VARCHAR(10),
request VARCHAR(200),
httpversion VARCHAR(3),
response VARCHAR(3),
bytes INTEGER,
server VARCHAR(50),
environment VARCHAR(50)
)

If a change the datetime field to varchar(50) the kafkaloader is able to import the data to apachelog table.
What´s wrong?

Regards,

Norberto Enomoto
anish
Apr 6, 2015
Looks like your kafka message has {} around the tuples this is throwing off datetime field. When you change it to archer do you get { in timestamp column and do you have } in environment column?

Let us know what if my assumptions are correct.

Thanks
Anish
norberto.enomoto
Apr 7, 2015
Looks like your kafka message has {} around the tuples this is throwing off datetime field. When you change it to archer do you get { in timestamp column and do you have } in environment column?

Let us know what if my assumptions are correct.

Thanks
Anish


I have changed my message and now I was able to insert it. Now I'm facing the following issue:
message value = 2015-03-12 17:19:52.000
table value = 2015-03-12 20:19:52.000

What´s wrong? Do I need to set or change my time zone? The time zone of the machine that is running VoltDB is America/Sao_Paulo

Thanks,

Norberto Enomoto
anish
Apr 7, 2015
Hi,

VoltDB treats all timestamp as GMT thats why you are seeing GMT-3 for your time data. We have a ticket to allow picking timezone for kafkaloader.

Let me know how important it is.

Thanks
Anish