The Parallel Tools Runtime Environment (PToolsRTE) provides a consistent environment for development and deployment of Python-based parallel applications. It is a Python distribution that can be installed easily on a variety of HPC and desktop platforms. pyMPI, mpi4py, numpy, scipy, swig, f2py, and matplotlib are all fully supported (see here for a complete list). It is available for free download.
ParaTools supports PToolsRTE on all DoD Supercomputing Resource Centers (DSRCs) as part of the DoD HPC Baseline Configuration for Common Open Source High Productivity Programming Languages (BC Policy FY10-02). The CREATE-AV projects Kestrel and Helios use PToolsRTE as their primary runtime environment.

Site System PToolsRTE Required Modules
AFRL Spirit 0.7 intel-compilers/13.0.1, intelmpi/4.0.3.008
Utility Server 0.7 TBD
ARL Harold 0.7 compiler/gcc/4.4.1, mpi/openmpi/1.4.1
Pershing 0.7 compiler/intel/13.1.0, mpi/intelmpi/4.1.0
Utility Server 0.7 compiler/intel/13.0, mpi/intel/openmpi/1.6.3
ERDC Garnet 0.7 PrgEnv-gnu/4.0.46, fftw/3.3.0.3
Diamond 0.7 compiler/intel12.1.003, mpi/intelmpi-4.0.3
Utility Server 0.7 compiler/intel/13.0, mpi/intel/openmpi/1.4.3
NAVO Haise 0.7 compiler/intel/13.0, mpi/intel/impi/4.1.0
Kilrain 0.7 compiler/intel/13.0, mpi/intel/impi/4.1.0
Utility Server 0.7 compiler/intel/13.0, mpi/intel/openmpi/1.6.3
MHPCC Riptide 0.7 intel/13.0, impi/4.1
Utility Server 0.7 compiler/intel/12.1, mpi/intel/openmpi/1.4.3

PToolsRTE 0.7

PToolsRTE 0.7 is based on Python 2.7.3 and includes the following packages:

Name Version Name Version Name Version Name Version
Cheetah 2.4.4 db 5.3.21 libpng 1.6.2 pyzmq 2.2.0.1
FormEncode 1.2.6 doxygen 1.8.4 matplotlib 1.2.1 readline 6.2
Imaging 1.1.7 expat 2.1.0 mpi4py 1.3 scipy 0.12.0
Markdown 2.3.1 fontconfig 2.10.0 ncurses 5.9 setuptools 0.9.8
PyOpenGL 3.0.2 fpconst 0.7.2 nose 1.3.0 swig 2.0.9
PyOpenGL-accelerate 3.0.2 gdbm 1.10 numpy 1.7.1 sympy 0.7.2
Python 2.7.3 gettext 0.18.2 openssl 1.0.1e SOAPpy 0.12.5
graphviz 2.30.1 paramiko 1.10.1 SQLObject 1.4.0 gtest 1.6.0
pcre 8.32 szip 2.1 SQLite 3.7.17 h5py 1.3.1
pexpect 2.3 tornado 3.0.1 Twisted 13.0.0 pip 1.3.1
virtualenv 1.9.1 basemap 1.0.6 hdf5 1.6.6 pixman 0.30.0
wstools 0.4.3 blas netlib py2cairo 1.10.0 wxPython 2.9.4.0
boost 1.53.0 ipython 0.13.2 pyMPI 2.5b0 zlib 1.2.8
bzip2 1.0.6 lapack 3.4.2 pyOpenSSL 0.13 zope.interface 4.0.5
cairo 1.10.2 lcms2 2.4 pycrypto 2.6 cmake 2.8.11
libiconv 1.14 pygments 1.6

Download

Installation

  1. Extract the compressed tar file.
  2. Run configure.sh install from the command line.
  3. Follow the on-screen instructions.

Usage

You will need to add PToolsRTE to your shell environment before you can use it. You can do this by loading the module file, or by sourcing the appropriate initialization script:

  • Module file (any shell):
    module use /path/to/ptoolsrte/etc 
    module load ptoolsrte
    
  • Bash:
    source /path/to/ptoolsrte/etc/ptoolsrte.bashrc
    
  • C-Shell:
    source /path/to/ptoolsrte/etc/ptoolsrte.cshrc
    

PToolsRTE 0.6

PToolsRTE 0.6 improves performance and includes new packages. It has not been tested on all platforms.

Download the all-in-one package.

Installation and usage are the same as 0.55.

PToolsRTE 0.55

PToolsRTE 0.55 is based on Python 2.7.2. Core packages are guaranteed to be installed and fully functional. Support packages are only installed when required. Optional packages may or may not be installed.

Core
Name Version Name Version Name Version Name Version
boost 1.47.0 hdf5 1.8.8 pycairo 1.8.10 setuptools 0.6c11
cairo 1.8.10 Markdown 2.0.3 pycrypto 2.3 SOAPpy 0.12.5
Cheetah 2.4.4 matplotlib 1.1.0 pyMPI 2.5b0 SQLObject 1.1.3
cmake 2.8.6 mpi4py 1.2.2 PyOpenGL 3.0.1 swig 2.0.4
FormEncode 1.2.4 nose 1.0.0 PyOpenGL-accelerate 3.0.1 tau 2.21.2
fpconst 0.7.2 numpy 1.6.1 pyOpenSSL 0.11 Twisted 11.0.0
gtest 1.6.0 paramiko 1.7.7.1 Python 2.7.2 wstools 0.3
h5py 2.0.1 pixman 0.20.2 scipy 0.10.0 wxPython 2.9.2.4
Support
Name Version Name Version Name Version Name Version
atlas 3.8.3 gettext 0.18.1.1 libiconv 1.14 pkg-config 0.26
binutils 2.20 glib 2.30.2 libpng 1.5.5 readline 6.2
blas 20.01.2011 graphviz 2.28.0 ncurses 5.9 scons 2.1.0
bzip2 1.0.6 gtk2 2.18.9 numscons 0.12.0 szip 2.1
doxygen 1.7.5.1 Imaging 1.1.7 openssl 1.0.0g zlib 1.2.6
expat 2.0.1 lapack 3.4.0 pango 1.24.5 zope.interface 3.8.0
fontconfig 2.8.0 lcms 1.19 pcre 8.13
freetype 2.4.6 libffi 3.0.10 pdtoolkit 3.17
Optional
Name Version Name Version Name Version
mpich2 1.4.1p1 openmpi 1.4.4 openmpi 1.5.4

Download

The following target configurations have been tested and are officially supported. If you have a similar or unsupported configuration, download the distribution that most closely matches your configuration. The all-in-one distribution is most likely to succeed.

Operating System Distribution Compiler CPU Arch.
Linux Red Hat Enterprise Linux 5.x GNU x86_64 Download
SuSE Linux Enterprise Server 11 Download
SuSE Linux Enterprise Server 10 Download
Cray CLE 3.x Download
Cray CLE 2.x Download
Fedora 16 Download
Fedora 14 Download
AIX 5.3 IBM XL powerpc64 Download
OS X (Darwin) Lion (10.7) GNU x86_64 Download
Snow Leopard (10.6) i386 Download
All-in-one download for all platforms

Installation

  1. Extract the compressed tar file.
  2. Run configure.sh install from the command line.

  3. Follow the on-screen instructions.

Usage

You will need to add PToolsRTE to your shell environment before you can use it. You can do this by loading the module file, or by sourcing the appropriate initialization script:

  • Module file (any shell):
    module use /path/to/ptoolsrte/etc 
    module load ptoolsrte
  • Bash:
    source /path/to/ptoolsrte/etc/ptoolsrte.bashrc
    
  • C-Shell:
    source /path/to/ptoolsrte/etc/ptoolsrte.cshrc

Legacy Versions

These older versions of PToolsRTE are available for download. To install a legacy version, please untar and configure the package. It will prompt you for additional packages (such as pyMPI or openmpi) that you may build on the target platform. Once it completes, simply source the cshrc or bashrc file from the ptoolsrte/etc directory to add all the packages to your PATH.

To verify that the packages are loaded correctly, please follow the following steps:

./configure
source etc/ptoolsrte.bashrc [or .cshrc]

Check to see the output:

python
>>> import numpy
>>> 
%

0.5

0.4

0.3

0.2

0.1

Support

Please contact us with questions or for support. We also encourage you to submit a ticket to help@ccac.hpc.mil.