Itertools combination Memory error with Python

Question

I have a Memory error when I use combinations with a big list of list like len 735. Any way to do a similar process but without the error?

from itertools import combinations

valores = [[5, 10.732544898986816], [9, 10.596251487731934], [11, 10.70582103729248]]
f = list(combinations(valores, 3))

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
MemoryError

Don't make a list out of it, that's the whole point of itertools. — juanpa.arrivillaga
– juanpa.arrivillaga, Commented Nov 1, 2019 at 19:12
Does this answer your question? Prevent memory error in itertools.permutation — Georgy
– Georgy, Commented Apr 30, 2020 at 17:28

kaya3 · Accepted Answer · 2019-11-01 19:14:41Z

4

If your list has 735 elements, then there are (735 choose 3) = 65907695 combinations of three elements. There is probably no need to keep all of these 3-tuples in memory at the same time, so don't build a list out of them; just iterate directly.

for c in combinations(valores, 3):
    # do something with c

answered Nov 1, 2019 at 19:14

kaya3

51.6k7 gold badges87 silver badges118 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Mert Köklü · Accepted Answer · 2019-11-01 19:15:57Z

1

You can try to prevent memory error.

comb_iter = itertools.combinations(valores,3)

for item in comb_iter:
   do_the_stuff(item)

As a result, python will keep in memory only the currently used combination, not all the combinations.

answered Nov 1, 2019 at 19:15

Mert Köklü

2,2512 gold badges19 silver badges21 bronze badges

Collectives™ on Stack Overflow

Itertools combination Memory error with Python

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related