Open Source Python Clustering Software

Ganglia is a scalable distributed monitoring system for high-performance computing systems such as clusters and Grids. It is based on a hierarchical design targeted at federations of clusters. Supports clusters up to 2000 nodes in size.

dispy is a generic and comprehensive, yet easy to use framework for creating and using compute clusters to execute computations in parallel across multiple processors in a single machine (SMP), among many machines in a cluster, grid or cloud. dispy is well suited for data parallel (SIMD) paradigm where a computation (Python function or standalone program) is evaluated with different (large) datasets independently. dispy supports public / private / hybrid cloud computing, fog / edge computing.

A very lightweight Python program that executes commands on multiple Linux hosts in a user-designated number of threads via SSH. Intended for management for a large number of Linux/Unix nodes

ActiveGrid is an Enterprise Web 2.0 solution that allows the composition of code-free applications that comply with corporate IT standards. Technologies include Python, Java, XForm, Xpath, WSDL, CSS, XML Schema (XSD), XACML, and BPEL.

A Console-based BitTorrent Client with built-in scheduler for handling multiple sessions. It is designed to manage sessions in queue easily without heavy-weight GUI. External module can search for new torrents in trackers and submit it automatically.

RPyC, or Remote Python Call, is a transparent and symmetrical python library for remote procedure calls, clustering and distributed-computing.

asyncoro is a Python framework for developing concurrent, distributed, network programs with asynchronous completions and coroutines. Asynchronous completions implemented in asyncoro are sockets (non-blocking sockets), database cursors, sleep timers and locking primitives. Programs developed with asyncoro have same logic and structure as Python programs with threads, except for a few syntactic changes. asyncoro supports socket I/O notification mechanisms epoll, kqueue, /dev/poll (and poll and select, where necessary), and Windows I/O Completion Ports (IOCP) for high performance and scalability, and SSL for security

This is a system for scheduling the tasks in a heterogenous environment such as grid system .It will be a effective and extensible system.

Banshell is a tool to scriptably execute commands on a remote machine. It was designed with the goal of increasing security by only allowing a specified set of commands to be executed.

Bluesfield: An experimental distributed computing platform for the support of grassroots movements.

Allows creation and manipulation of diskless Linux (and Unix) clients, using templated system configuration files to increase the flexability and compatability of this application.

java-based complete Agent (Artificial Intelligence) Framework with all the features you might expect in an Agent Framework: Mobility, Autonomy, Distributed communication, Agents can be written in Java, Jython, or Beanshell.

Freenomalism is a free, community based fork of the Enomalism web-based virtual infrastructure/cloud computing platform. The dashboard can help with issues including deployment planning, load balancing, migration, configuration management, and capacity.

GXP is a parallel/distributed shell, plus a parallel task execution engine that runs your Makefile in parallel on distributed machines. Very easy to install (no need to compile. install it on YOUR machine and use it on ALL machines).

Job Monarch is an addon to the Ganglia Monitoring System that provides batch job monitoring and archiving plus a graphical overview of clusters and assorted batch systems. Fully supported batch system: Torque, PBS and SLURM. Experimental: LSF, SGE

Infinispan is an open source, Java based data grid platform. ***IMPORTANT*** Starting with Infinispan 5.0.0.FINAL, Infinispan releases are no longer hosted in Sourceforge. They can now be located in www.jboss.org/infinispan/downloads

KestrelHPC is a software developed to make life easier to the people that want to have a Diskless Cluster. This Cluster is Multi-User and it has got many tools to configure your cluster. This software can be installed in a Debian or Ubuntu.

LinuxTuples is an open-source implementation of David Gelernter's idea of a tuple space, designed to run on a networked cluster of Linux machines.

MPY is an MPI implementation for Python using MPICH (or any other MPI implementation). MPY also provides helper functions for ease of programming, and a simple plug-in interface.

Maui Scheduler is an advanced reservation HPC parallel batch scheduler for use with Linux and BSD clusters. Maui provides a complete scientific scheduling solution, supporting running custom parallel and MPI jobs over Myrinet and ethernet.

Momoko is a framework for developing distributed, multi-user, network-aware applications. It includes facilities for storing objects in a tree structure, a shell for manipulating the object database, orthogonal persistence, scripting support, and a trans

NetWorkSpaces, developed by Scientific Computing Associates Inc., provides a framework to coordinate programs written in Python, making it easier to write distributed applications.

PBS Cluster Viz is a project to display information useful to admins and users about a computing cluster managed by a PBS-compatible resource manager. Information includes load and job distribution. Interactive as well as static output is available.

Pluster is a cluster management software developed with python. It is easy to install and maintain. Pluster Provides cluster performance monitoring and remote OS installing. It's future will be an agent-based management system.

PuSSH is Pythonic, Ubiquitous SSH, a Python wrapper/script that runs commands in parallel on clusters/ranges of linux/unix machines via SSH, ideally where SSH is configured to use Kerberos, RSA/DSA keys, or ssh-agent as to avoid password authentication.