python subprocess communicate() block

Question

I am using the subprocess module to call an external program (plink.exe) to log-in to a server; but when I call communicate to read the output, it is blocking. The code is below:

 import subprocess
 process = subprocess.Popen('plink.exe [email protected] -pw 123456'.split(), shell=False, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
 print process.communicate() #block here

I know the block is because plink.exe it still running; but I need to read the output before the subprocess terminates. Is there anyway to do that?

Do you need to interact with plink, or you just need to make the call and read the std output without blocking? — Khelben
– Khelben, Commented Jan 25, 2010 at 15:42
related: Python: read streaming input from subprocess.communicate() — jfs
– jfs, Commented May 9, 2015 at 14:14

Björn Pollex · Accepted Answer · 2015-04-18 12:08:52Z

32

The whole purpose of the communicate method is to wait for the process to finish and return all the output. If you don't want to wait, don't call communicate. Instead, read from the stdout or stderr attribute to read the output.

If the process outputs to both stdout and stderr (and you want to read it separately), you will have to be careful to actually read from both without blocking, or you can deadlock. This is fairly hard on Windows, and you may wish to use the pexpect module instead.

edited Apr 18, 2015 at 12:08

Björn Pollex

77.1k30 gold badges206 silver badges290 bronze badges

answered Jan 25, 2010 at 15:41

Thomas Wouters

134k23 gold badges153 silver badges123 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

jfs Over a year ago

pexpect doesn't work on Windows. asyncio or threads could be used to read both streams without blocking.

ZhiyongZHAO · Accepted Answer · 2018-10-22 03:20:05Z

0

Maybe because "plink.exe" needs to take in input arguments, if you don't pass them, it will block until data are given, you could try adding arguments in method communicate(input)

answered Oct 22, 2018 at 3:20

ZhiyongZHAO

12 bronze badges

Comments

Pulimon · Accepted Answer · 2012-12-11 11:48:32Z

-1

I faced a similar situation where I had to execute a single command lmstat -a and then get the output of the terminal.

If you just need to run a single command and then read the output, you can use the following code:

import subprocess

Username = 'your_username'
Password = 'your_password'
IP = 'IP_of_system'
Connection_type = '-ssh' #can have values -ssh -telnet -rlogin -raw -serial

p = subprocess.Popen(['plink', Connection_type, '-l', Username, '-pw', Password, IP], \
                     shell = False, stdin=subprocess.PIPE, stdout=subprocess.PIPE)
out, err = p.communicate('lmstat -a\nexit\n'.encode())
print(out.decode())

answered Dec 11, 2012 at 11:48

Pulimon

1,8264 gold badges33 silver badges46 bronze badges

1 Comment

Fookatchu Over a year ago

As @Thomas said, this is a blocking and not a non-blocking approach

Collectives™ on Stack Overflow

python subprocess communicate() block

3 Answers 3

1 Comment

Comments

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

1 Comment

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related