Skip to content Skip to sidebar Skip to footer
Showing posts with the label Pytables

Concatenate Two Big Pandas.hdfstore Hdf5 Files

This question is somehow related to 'Concatenate a large number of HDF5 files'. I have seve… Read more Concatenate Two Big Pandas.hdfstore Hdf5 Files

Pytables Duplicates 2.5 Giga Rows

I currently have a .h5 file, with a table in it consisting of three columns: a text columns of 64 c… Read more Pytables Duplicates 2.5 Giga Rows

Combining Huge H5 Files With Multiple Datasets Into One With Odo

I have a a number of large (13GB+ in size) h5 files, each h5 file has two datasets that were create… Read more Combining Huge H5 Files With Multiple Datasets Into One With Odo

What Is The Advantage Of Pytables?

I have recently started learning about PyTables and found it very interesting. My question is: Wha… Read more What Is The Advantage Of Pytables?

Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows

Problem I have a large (> 500e6 rows) dataset that I've put into a pytables database. Lets … Read more Finding A Duplicate In A Hdf5 Pytable With 500e6 Rows

Reading .h5 File Is Extremely Slow

My data is stored in .h5 format. I use a data generator to fit the model and it is extremely slow. … Read more Reading .h5 File Is Extremely Slow