Parex - Parallel Execution for Python and Fabric

Enki 7/10/2010
image

I've been planning for a while to release more of the tools I've developed for BBQ. Let's get this started:

Parex is a simple python module that allows you to execute multiple processes in parallel, and then block till they've all finished. I use it with fabric to make deployments significantly faster. Find the code over at github.

Usage Example:

x = TaskManager(cwd=".")
x.execute('ls') # execute commands
x.execute('ps auxw')
pid = x.execute('who') # returns pid
x.wait() # wait till all have finished
for y in x.data.values(): # keyed by pid
    print y.getvalue() # y is StringIO

Follow me on twitter here or sign up for the BBQ betatest.

Comments