How to make full use of CPU cores with threading in python 2

Question

The following code seems to be executed sequentially rather than concurrently. And it only made use of one CPU core. Is there a way to make it use multiple cores or switch content between threads? (I hope it could work like Thread class in java.)

import threading 

def work(s) :
    for i in range(100) :
        print s
        for j in range (12345678) :
            pass

a = []
for i in range(3) :
    thd = threading.Thread(target = work('#'+str(i)))
    a.append(thd)

for k in a : k.start()
for k in a : k.join()

print "Ended."

Jakob Bowyer · Accepted Answer · 2014-01-21 14:32:45Z

4

Threads cannot utilize multiple cores in Python. Processes however can.

multiprocessing is a package that supports spawning processes using an API similar to the threading module. The multiprocessing package offers both local and remote concurrency, effectively side-stepping the Global Interpreter Lock by using subprocesses instead of threads. Due to this, the multiprocessing module allows the programmer to fully leverage multiple processors on a given machine. It runs on both Unix and Windows.

Click here for more information

answered Jan 21, 2014 at 14:32

Jakob Bowyer

34.8k8 gold badges80 silver badges92 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Nafiul Islam · Accepted Answer · 2014-01-21 14:33:26Z

0

A friend of mine asked me this once. In your case, just use multiprocessing.process and that will use all your cores.

answered Jan 21, 2014 at 14:33

Nafiul Islam

82.9k33 gold badges145 silver badges202 bronze badges

Collectives™ on Stack Overflow

How to make full use of CPU cores with threading in python 2

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related