Bulletin 167 - 2007 April 30

1. User Survey Results
2. Senior management changes in CSIRO
3. Add security classification to email from the SX-6/TX7 system
4. NEC's MathKeisan for the SX/TX - website updated
5. SamFS bulk file retrieval script
6. Ftrace and Performance tuning Seminar: 16th May
7. CSIRO - burnet modules staying, pkgenv going
8. Deleting files and CSIRO's Recordkeeping policy

Note: "CSIRO" items can apply to BoM users of cherax and burnet

At the last HPCBull we asked for feedback on HPCCC services, and we promised to share the results.

Sadly we have only received 6 responses, and because each response did not rate every item even within topics, there are so few replies that the results provide no overall picture. As a general statement the computational platforms came out well, the web seems to be well received, and HPChelp is love us or hate us. (We are working to improve the HPChelp for the latter.)

It is never too late to respond to the feedback survey; we are always pleased to get lauded or dinged, when deserved.

http://www.hpccc.gov.au/hpccc/helpdesk/feedback.shtml

[ page top ]

Dr Robert Woodcock has recently ended his secondment as Acting Executive Manager of IM&T eScience. The process of finding and appointing a new EM is taking place. The immediate technical management of the CSIRO part of HPCCC is not affected at this stage.

Also, the day to day management of IM&T will change. Roze Frost remains CIO but will step down as General Manager of IM&T in order to take over leadership of the BETR project within IM&T. A replacement as General Manager has not yet been announced.

[ page top ]

Mandatory introduction of Protective Markings (security classification), in email subject headers, now apply to the SX-6/TX7 system. All email with destinations, external to the Bureau domain and generated from within the Bureau domain (SX-6/TX7) is effected.

The Australian Government Information Management Office (AGIMO) required that all Australian Government Agencies implement Protective Markings (Security Classifications) in e-mail by 1 April 2007.

E-mail from within the SX-6/TX7 will be deleted, unless both the following 2 conditions are resolved.

1. For Bureau-external mail destinations, the fully qualified domain must be used. E.g.

   abc123@cherax.hpc.csiro.au

2. Email Protective Tag ([SEC=UNCLASSIFIED]) must be included in subject header. E.g.

   Subject: my subject header [SEC=UNCLASSIFIED]

From within NQSII, use job options to specify the email address for the job

• [using qsub directives within the job] #PBS -M email_address e.g.

  #PBS -M abc123@mawson.hpc.csiro.au

• [using embedded options]

  "-m b abc123@mawson.hpc.csiro.au" and "-m e abc123@mawson.hpc.csiro.au".

More details are included in: System Change Notice: 2007-A011a1 Add security tag to email subject.

[ page top ]

The website (http://www.mathkeisan.com/) supporting the MathKeisan mathematical library software from NEC has had recent improvements. Of note, are

• The User's Guide has chapters detailing each MathKeisan library.
• MathKeisan Man Pages are now available online.
• Language selection is automatic.
• The new website is more accessible, and easier to navigate.

[ page top ]

A script called rcp_files_from_sam has been developed to allow you to retrieve large amounts of data from Sam using an optimal retrieval strategy. The script is available on the tx7s and gale.

The script can be used in any situation where you wish to retrieve a large number of files from Sam before processing the data. The script is of little use when you retrieve a file; process it; then retrieve another file; and then repeat the process and so on.

Examples of Use:

rcp_files_from_sam -f input_file -o /directory/to/save/them/in

-f input_file - must contain full pathnames for the files you wish to retrieve.

-o directory - the directory where the files will be copied to. If -o is not specified the files will be copied to the directory from where rcp_files_from_sam is run

Another example

cat files_to_copy_list | rcp_files_from_sam -f - -o /directory/to/save

The script assumes the following,

1. rhosts or equivalent on Samsrv2 must be setup to allow remote connections from the hosts on which you run it. NOTE: the script tries to use the Jumbo Frame Gigabit network where possible. (eg. Your .rhost file on samsrv2 should have entries in it for galejf, tx700jf and tx701jf ).

2. rsync must be in your $PATH on the host from where you run it.

Feedback regarding the script should be sent to or .

[ page top ]

On Wednesday 16 May Joerg Henrichs will present a seminar on Ftrace and Performance tuning. See http://www.hpccc.gov.au/seminars/.

[ page top ]

As mentioned in HPCBull 159 item 6 'Modules coming, pkgenv going', we are switching to using modules on HPCCC systems.

For cherax users - the transition to modules is complete. pkgenv has been disabled and modules are in use.

For burnet users - modules have been available for some time, but pkgenv remains functional. You should modify your scripts to replace pkgenv with modules. If you require assistance with migrating to modules, please contact us. We plan to disable pkgenv on Tuesday 15th May.

For more information on modules please consult: http://intra.hpsc.csiro.au/userguides/faq/env_modules.php

[ page top ]

Please see http://intranet.csiro.au/doco/policy/pc2002_03.htm and the response to req #7853.

[ page top ]