Execute awk from python-no error-no output

Question

this code works fine from terminal/bash script:

 awk '/^(name|count|region)/{sep = (/^region/? ORS:OFS);gsub(/^[^:]+:[[:space:]]*|[[:space:]]*$/, "");printf "%s%s", $0, sep}' output.txt>1.txt

Trying to execute it from inside python:

 #!/usr/bin/python
    import sys
    import json
    import re
    import os
    import subprocess




  def bash_command(cmd):
    subprocess.Popen(cmd, shell=True, executable='/bin/bash')


bash_command = ('''"awk '/^(name|count|region)/{sep = (/^region/? ORS:OFS);gsub(/^[^:]+:[[:space:]]*|[[:space:]]*$/, "");printf "%s%s", $0, sep}' output.txt> 1.txt"''')

No errors but 1.txt is not created

Why on earth are you calling a scripting language from another scripting language? why not implement what awk is doing in python? — match
– match, Commented Mar 29, 2018 at 14:14
You should ask the question again, stating what data you have, and what you are trying to do with it, and what problems you are having, in python - rather than hacking things like this. — match
– match, Commented Mar 29, 2018 at 14:18

philshem · Accepted Answer · 2018-03-29 14:24:00Z

1

To call a function with a string parameter, you have to use this pseudo-code. Instead, you were setting your function name as a string tuple.

#!/usr/bin/python
import sys
import json
import re
import os
import subprocess

def bash_command(cmd):
    subprocess.Popen(cmd, shell=True, executable='/bin/bash')


bash_command("echo test")

answered Mar 29, 2018 at 14:24

philshem

25.5k8 gold badges67 silver badges136 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Community · Accepted Answer · 2020-06-20 09:12:55Z

0

Not the answer you are looking for, but you can use the python-awk library

pawk is a python-based replacement for awk.

It uses python for line-by-line processing of files

Although the package looks like it could a cleanup.

https://github.com/jasontrigg0/pawk

edited Jun 20, 2020 at 9:12

CommunityBot

11 silver badge

answered Mar 29, 2018 at 14:20

philshem

25.5k8 gold badges67 silver badges136 bronze badges

Collectives™ on Stack Overflow

Execute awk from python-no error-no output

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related