Bulletin 187 - 2009 March 26

  1. New supercomputers
  2. CSIRO - New NCI National Facility Cluster available
  3. Traffic light upgrade
  4. Data Areas on cherax
  5. New CSIRO ASC Software
  6. CSIRO ASC Software Upgrades
  7. burnet scheduler

1. New supercomputers

The Bureau of Meteorology and ANU are pleased to announce that contracts have been signed for the acquisition of new supercomputer systems from Sun Microsystems.

The announcement can be read at http://www.bom.gov.au/announcements/media_releases/ho/20090319.shtml

More details of the systems will be available shortly.

A Sun seminar on the Bureau's supercomputer system for high performance computing application developers is planned to be held during the week of 20th-24th April.

[ page top ]



2. CSIRO - New NCI National Facility Cluster available

The following announcement was recently made to all NCI National Facility users.

A new production compute service is now available for use by all NCI National Facility users. It is a 156 compute node (1248 cpu) SGI XE Cluster (http://www.sgi.com/products/servers/altix/xe/). This system provides sustained performance equal to about 60% of the SGI AC Altix Cluster so it is a considerable addition to the Facility's computational capacity. The per cpu performance of the new system compared to AC will vary from application to application but on average is quite similar. Since the charging rates for the two systems are the same, we encourage all users to make the comparison for themselves to decide which system provides them with the most compute results for their project allocation. You can expect to see up to a factor of two difference in performance in favour of either system depending on your application.

The new system is also being used to trial and develop system software for the next major National Facility system. In general, the user visible components of the system software should be familiar to you - the Linux operating system, the filesystem structure and policies, the Intel compilers, the queueing system and queues, etc. However a very different underlying system configuration is being trialed and teething problems are to be expected. Bear with us while we try to develop a robust, scalable system for the future.

The login node of the new SGI XE cluster is xe.nci.org.au - all NF users attached to an active compute project should have an account on that system with the same username and password as AC. Details of the XE system and its use can be found at

http://nf.nci.org.au/facilities/
http://nf.nci.org.au/facilities/userguide/

In short, the system currently has 156 compute nodes each with two 64bit Xeon (x86_64) quad-core processors, i.e. each node effectively has 8 cpus. Most nodes have 2GB of memory per cpu, a small number have 4GB per cpu.

CSIRO access to NCI facilities at the Australian National University can be obtained through either the CSIRO partner share or the NCI Merit Allocation Scheme (MAS).

Applications for CSIRO Partner time are approved by Rob Bell. This application can be accessed at https://nf.nci.org.au/accounts/projects_new/partner_user.php

For more information about the NCI Merit Allocation Scheme please read https://nf.nci.org.au/accounts/projects_new/MAC.php

[ page top ]



3. Traffic light upgrade

The traffic light system at http://www.hpccc.gov.au/hpccc/system_status/ and http://intra.hpsc.csiro.au/traffic/servicestatus.xml has been upgraded recently to provide graphs of software license usage in the last 24 hours.

This information is available through the 'more' button, which also gives information about the number of licences available, and current usage.

[ page top ]



4. Data Areas on cherax

We have commenced moving significant shared data holdings out of users' home directories on the CSIRO Data Store, to enhance the access and management.

On Tuesday 31st March at 10:00, the IPCC files in the area ~ofa001/IPCC will be moved to a new area. The new area will be accessed through the variables $IPCC and $CMIP3, which will be directory names, and will be set by the command:

   module load IPCC-CMIP3

Further areas can be set up as users and groups desire. Please provide answers to the following:

  1. A name for the dataset/project
  2. The visibility required for the data: e.g. selected users within a group, users within an organisation, or users across organisations.
  3. The user name of the gatekeeper
  4. An estimate of the amount of data and number of inodes
  5. The module access required - part of a wider module, or separate
  6. Which users should have group access
  7. The name of any existing directory to be moved there. A link could be provided from the original location.

[ page top ]



5. New CSIRO ASC Software
  • forcheck - A Fortran source code analyzer and programming aid

    Forcheck performs a static analysis of Fortran programs or separate Fortran program units. Forcheck detects anomalies in your program and can locate bugs early in the development phase, saving time and helping to produce more reliable code.

    forcheck is currently installed on cherax and burnet, and can be installed on your local workstation.

    For usage instructions please see the software map - http://nf.nci.org.au/facilities/software/index.php?site=CSIRO

  • PV-meshless

    PV-meshless is a customized version of Paraview3 with some specific enhancements for working with particle based (in particular SPH) data.

    PV-meshless is available on burnet

    For usage instructions please see the software map - http://nf.nci.org.au/facilities/software/index.php?site=CSIRO

  • LAMMPS

    LAMMPS (Large-scale Atomic/Molecular Massively Parallel Simulator) is a classical molecular dynamics (MD) code. As the name implies, it's designed to run well on parallel machines, but it also runs fine on single-processor desktop machines.

    LAMMPS is available on cherax and burnet

    For usage instructions please see the software map - http://nf.nci.org.au/facilities/software/index.php?site=CSIRO

  • PyNGL and PyNIO

    PyNGL (pronounced "pingle") is a Python language module used to visualize scientific data, with an emphasis on high quality 2D visualizations.

    PyNIO is a Python package that allows read and/or write access to a variety of data formats using an interface modeled on netCDF.

    PyNGL and PyNIO are available on cherax

    For usage instructions please see the software map - http://nf.nci.org.au/facilities/software/index.php?site=CSIRO

  • Matlab - Image Processing Toolbox

    Image Processing Toolbox software provides a comprehensive set of reference-standard algorithms and graphical tools for image processing, analysis, visualization, and algorithm development. You can restore noisy or degraded images, enhance images for improved intelligibility, extract features, analyze shapes and textures, and register two images.

    Matlab Image Processing Toolbox is available on burnet and can be installed on your local workstation.

    For usage instructions see http://www.mathworks.com/access/helpdesk/help/toolbox/images/

  • XMDS

    XmdS, an extensible multi-dimensional simulator, is a code generator that integrates equations. A user writes them down in human readable form in an XML file, and it goes away and writes and compiles a C++ program that integrates those equations as fast as it can possibly be done in the user’s machine architecture. For more information see http://www.xmds.org

    XMDS is available on cherax.

    For usage instructions please see the software map - http://nf.nci.org.au/facilities/software/index.php?site=CSIRO

[ page top ]



6. CSIRO ASC Software Upgrades

The following have been recently installed:

  • Mathematica v7.0 (burnet,myhost)
  • COMSOL Multi-physics 3.5a (myhost)
  • netCDF 4.0.1 beta3 (cherax)
  • NCO 3.9.7 for netCDF4 (cherax)
  • FFTW 2.1.5 and 3.2.1 with MPI and thread support (cherax)
  • Subversion 1.5.6 with SSL support (burnet)

[ page top ]



7. burnet scheduler

The burnet scheduler (moab) has been updated and now supports requesting vmem in round numbers.

For example, it will be possible to specify vmem=1GB rather than vmem=1000MB

Note: Jobs specifying vmem=4GB are still problematic if they go to 32-bit nodes as setting a limit >=4GB fails on a 32-bit system. vmem=4095MB is OK though.

It is recommended that you request close to what is actually needed. A summary of vmem usage is printed at the end of each job.

[ page top ]





BoM Solar Help:

CSIRO ASC Help:

For urgent help at all times:
  • CSIRO users 0428 108 333
  • Bureau out of hours emergencies are managed through internal policy
HPCCC WWW Site: http://www.hpccc.gov.au/
CSIRO External ASC Site: http://www.hpsc.csiro.au/
CSIRO ASC Users' Site: http://intra.hpsc.csiro.au/

Comments to:


© Copyright 2010, CSIRO Australia
Use of this web site and information available from it is subject to our Legal Notice and Disclaimer and Privacy Statement