Forum: Other

Post: Nodes on the fly and data size limitations

Nodes on the fly and data size limitations
some
Jul 27, 2010
Hi,

I'd like to know if there are any plans for supporting adding of new nodes on the fly, without switching off and reloading everything. If yes, when could that be expected?

And also, if I have 10 TB of data, is it possible to load and use _all_ that data in a cluster of PCs each having say 64GB RAM? Or I should have a server having 10TB-20TB of RAM (or a cluster of 10TB RAM servers) in order to be able to do that?

Thanks
re: Nodes on the fly and data size limitations
tcallaghan
Jul 28, 2010
We do plan on supporting the ability to add new nodes on the fly in a future version of VoltDB. We do not yet have an expected date for that feature.

As for your 10TB question, you need enough total memory in your cluster to support your data/index needs. So if your entire data/index set requires 10TB, you'd need a cluster with more than 10TB total RAM. If running with k-safety (where k=1), you'll need 20TB since all data is stored twice in the cluster.

-Tim
Thanks Tim, And one more
some
Aug 2, 2010
We do plan on supporting the ability to add new nodes on the fly in a future version of VoltDB. We do not yet have an expected date for that feature...


Thanks Tim,

And one more question, do you also plan VoltDB to be able to support on the fly db schema change?

I think that real life use cases will for sure demand that kind of features and that is why I am interested to know more about that.
Hi, VoltDB V1.1 already
ajgent
Aug 2, 2010
Thanks Tim,

And one more question, do you also plan VoltDB to be able to support on the fly db schema change?

I think that real life use cases will for sure demand that kind of features and that is why I am interested to know more about that.


Hi,

VoltDB V1.1 already supports the ability to add and drop database tables on the fly using the @UpdateApplicationCatalog system procedure. We plan on supporting additional schema changes at some point in the future.

You can see our current thinking about features for upcoming releases on the product roadmap. Feel free to discuss the plans either as comments on the roadmap page itself or here in the forums.

Is there a specific type of change you are interested in?

-Andrew
Thanks Andrew, That's really
some
Aug 5, 2010
Hi,

VoltDB V1.1 already supports the ability to add and drop database tables on the fly using the @UpdateApplicationCatalog system procedure. We plan on supporting additional schema changes at some point in the future...


Thanks Andrew,

That's really good. I wasn't aware.

Well, changing the table structure on the fly without deleting the table/data would be great, e.g. during a high traffic web service upgrade.

I read the road map, sounds promising.

Rgds