Large csv pandas memory error

Question

I'm running exactly the same one line code on two similar machines to read a 1 GB csv file.

dataframe = pd.read_csv('url_here', delimiter='|')

One machine reads it correctly, the other one gives me an empty memory error ("MemoryError:")

Both machines have 8 GB ram and an i7 processor.

What could cause this? Is there a way to increase memory availability for Python?

Thanks!

whats your out_shape? Also, see stackoverflow.com/questions/19085280/… — agconti
– agconti, Commented Dec 4, 2013 at 16:49
Working machine: Windows 8 (64b) laptop, iPython 1.0 Not working machine: Windows 7, desktop, iPython 1.0 — Alexis Eggermont
– Alexis Eggermont, Commented Dec 4, 2013 at 21:27

chopper · Accepted Answer · 2014-03-13 19:27:57Z

1

Try using low_memory=False:

dataframe = pd.read_csv('url_here', delimiter='|', low_memory=False)

chopper

6,7397 gold badges40 silver badges56 bronze badges

answered Mar 13, 2014 at 19:07

Shravan

2,7332 gold badges18 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

1 Answer 1