IPython parallel computing on Windows PCs?

Question

can someone provide an answer if it is possible to use IPython for parallel computing on Windows PCs, and if so how should connections be made?

I watched on-line courses, and they were helpful but nothing about how to actually connect available PCs. I also did search but can't find definitive answer if it's possible on Windows or only on Unix like PCs

Thanks

Yes. I was thinking about IPython and SciPy - using ipcluster and IPython MultiEngineClient. Everywhere I looked it's assumed that PCs are set and FURLs are present — Ghostly
– Ghostly, Commented Mar 30, 2011 at 14:42
Are you asking about tying multiple PCs together with IPython for parallel computing? If so, are these machines on the local network? Otherwise, are you talking about a single PC with multiple multi-engine client processes? — reckoner
– reckoner, Commented Mar 30, 2011 at 16:11

whatnick · Accepted Answer · 2011-03-30 15:17:43Z

1

The iPython cluster mode seems to be untested on Windows, you are literally on the bleeding edge there. Please test and improve iPython, the shell part of it is one of my best loved portions of Python.

That being said you have another much simpler to deploy parallel processing option for windows/linux/mac hybrid environments - Parallel Python. It can do both multiprocesser and cluster modes. To use it simply install the pp module and start up ppserver from python_home/Scripts. This pickles methods and data and passes them around ppserver instances for computation. Pure python code can be very easily parallelized. Those using natives and other libraries will require the libraries to be preinstalled on all of the cluster nodes.

answered Mar 30, 2011 at 15:17

whatnick

5,5003 gold badges22 silver badges36 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Ghostly Over a year ago

Thanks for confirmation. I thought that it's not supported on Windows as I read "somewhere", and I also posted on IP mailing list without success. My intentions are to use IP shell possibilities, thou thanks for pp module link, I'll check it out

nmichaels · Accepted Answer · 2011-03-30 14:31:17Z

0

Yes, Python can be used for parallel computing on Windows too. Use the multiprocessing module.

answered Mar 30, 2011 at 14:31

nmichaels

51.2k12 gold badges113 silver badges137 bronze badges

Collectives™ on Stack Overflow

IPython parallel computing on Windows PCs?

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related