Standard ASCII File Format For Plotting from Matplotlib

Question

I am working on a large hardware testing project, and one of the things I've run into is that I'd like to plot data coming out of the Python scripts on the systems doing the testing, but they aren't stout enough to run something like matplotlib. I started to do was to define a format to pass data back to the server that logs all the data coming from test systems; however, I would prefer to use something off the shelf if it exists for writing plots in a standardized way to an ASCII file and reading them back some where else and plotting.

I am partial to plotting in matplotlib, but I have some flexibility as to what I can use. I don't have any problem defining a custom format, I would just like to use something standard if matplotlib, (or any other full featured tool) has a way to build plots on the fly from some text format. Thanks in advance for your help.

Edit: To be more specific, transferring data is pretty straighforward; I like using JSON for that. What I am kind of looking for, is to build a file that not only holds data but also how to plot the data, (i.e. the script/application loads it up and builds a plot from it, the file specifies title/xlabel/ylabel, maybe that it needs a legend, etc.) Writing data via CSV or JSON isn't hard; it's finding a way to send plotting instructions to a host in a standardized way that might be.

I would just use push the raw data + what ever meta-data you care about back to the server (json seems good for this, or just pickle dictionaries) and then write scripts that take in those as input and do what ever plotting you want. — tacaswell
– tacaswell, Commented Apr 13, 2014 at 19:28

unutbu · Accepted Answer · 2014-04-11 20:02:41Z

1

Well, you could write python code to a file, and send that to the server to be executed, but that could be a security risk.

To mitigate some of the security risk (note XML vulnerabilities), you could use xmlrpclib to restrict the set of functions that can be called from the source machine to be run on the server:

For example, you might run on the server:

from SimpleXMLRPCServer import SimpleXMLRPCServer
import matplotlib.pyplot as plt

def plot(filename, x, y):
    plt.plot(x, y)
    plt.savefig(filename)    
    return True

server = SimpleXMLRPCServer(("localhost", 8000))
server.register_function(plot, 'plot')
server.serve_forever()

And on the source machine:

import xmlrpclib
proxy = xmlrpclib.ServerProxy("http://localhost:8000/")

x = range(100)
y = [i**2 for i in x]
proxy.plot('/tmp/test.png', x, y)

You could add more parameters to the plot function to handle the title, legend, etc.

Running the code above on the source machine will generate the file /tmp/test.png on the server.

edited Apr 11, 2014 at 20:02

answered Apr 11, 2014 at 18:30

unutbu

886k197 gold badges1.9k silver badges1.7k bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

rpcope1 Over a year ago

I took your suggestion, and ran with it! Thanks. :)

Kevin Thibedeau · Accepted Answer · 2014-04-11 18:34:04Z

0

You might consider using Matlab's text format for transfering data. Scipy has a set of Matlab IO routines that you could use. You could also do it with plain Python by dumping data in JSON format or using pickle.

answered Apr 11, 2014 at 18:34

Kevin Thibedeau

3,43118 silver badges27 bronze badges

Collectives™ on Stack Overflow

Standard ASCII File Format For Plotting from Matplotlib

2 Answers 2

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related