Forum: Managing VoltDB

Post: VoltTable.addRow(...) larger than allowed max 1024K

VoltTable.addRow(...) larger than allowed max 1024K
Jaffakeks
May 19, 2015
Hello

I have a problem with inserting data into the database via csvloader. I have two columns, each containing 10KB up to 100MB of text in a row. And now when inserting I get the following error :


ERROR: Failed to drain all buffers, some tuples may not be inserted yet.
java.util.concurrent.ExecutionException: org.voltdb.VoltOverflowException: Value in VoltTable.addRow(...) larger than allowed max 1024K
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:188)
at org.voltdb.client.VoltBulkLoader.VoltBulkLoader.drain(VoltBulkLoader.java:335)
at org.voltdb.client.VoltBulkLoader.VoltBulkLoader.close(VoltBulkLoader.java:374)
at org.voltdb.utils.CSVBulkDataLoader.close(CSVBulkDataLoader.java:73)
at org.voltdb.utils.CSVFileReader.run(CSVFileReader.java:156)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.voltdb.VoltOverflowException: Value in VoltTable.addRow(...) larger than allowed max 1024K
at org.voltdb.VoltTable.addRow(VoltTable.java:904)
at org.voltdb.client.VoltBulkLoader.PerPartitionTable.buildTable(PerPartitionTable.java:245)
at org.voltdb.client.VoltBulkLoader.PerPartitionTable.access$200(PerPartitionTable.java:49)
at org.voltdb.client.VoltBulkLoader.PerPartitionTable$2.call(PerPartitionTable.java:172)
at org.voltdb.client.VoltBulkLoader.PerPartitionTable$2.call(PerPartitionTable.java:169)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at org.voltcore.utils.CoreUtils$7$1.run(CoreUtils.java:735)
... 1 more


You can not store more than 1024kb in a row or is something else wrong?

Any help would be greatly appreciated.

Thanks
pzhao
May 19, 2015
Jaffakeks,

Unfortunately, limitations for storing a value in a column is 1MB. We'd like to hear what your trying to use VoltDB for in order to give better guidance.

Peter Zhao