Send large JSON string from NodeJS to Python

Question

I need to send a large JSON file from Node to Python. I can create the child_process with spawn to call the Python file, but I can't work out how to send the data to it. I've tried using pipe, but I'm not understanding the documentation.

Code:

var dataset = JSON.stringify(doc.data);

// Call the python API
try {
  var py = require('child_process').spawn('python3', ['api.py', analysis, input]);
} catch(error) {
  console.log(error);
}

// Pipe the data to the Python module
py.stdin.pipe(fs.createWriteStream(dataset));
py.stdin.end();

Error:

Uncaught Error: ENAMETOOLONG: name too long, open [file data printed to console here]

You should set up some listeners on events to handle the stream errors and when the stream ends. — simon-p-r
– simon-p-r, Commented Sep 12, 2016 at 11:52

Joakim Ericsson · Accepted Answer · 2016-09-12 12:55:02Z

3

Here is a pretty good guide on what you are trying to do!

Seems like you also should do py.stdin.write('json data');

answered Sep 12, 2016 at 12:55

Joakim Ericsson

4,6964 gold badges23 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Send large JSON string from NodeJS to Python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related