Get a list of mat file variables without loading the full file in python

Question

I have a very big matlab data file(2GB) which I need to load in python with scipy.io.loadmat. It returns MemoryError. It is surely because the file is too big, loading it in matlab in the same machine return memory error, either.

But load a sequence of variables of this file succeed like this, scipy,io,loadmat('data.mat',variable_names='var1'). So I need get a list of all variables inside a mat file, without first loading the file, then data.keys().

Anyone knows how?

DSM · Accepted Answer · 2013-12-29 03:36:16Z

3

To get a list of all the variables in a .mat file, you can use scipy.io.whosmat:

>>> import numpy as np, scipy.io
>>> md = {"A": np.random.random((100,3)), "B": np.zeros((1,2,3), dtype=int)}
>>> scipy.io.savemat("test.mat", md)
>>> scipy.io.whosmat("test.mat")
[('A', (100, 3), 'double'), ('B', (1, 2, 3), 'int32')]

(Whether this is the best approach to your actual problem, I've no idea.)

answered Dec 29, 2013 at 3:36

DSM

355k67 gold badges606 silver badges504 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Get a list of mat file variables without loading the full file in python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related