Ibnsina Hardware
Ibnsina is composed of 8 dual processor nodes. Each node consists of two
POWER 4 processors running at 1.0 GHz and sharing 2GB of memory.
There are three levels of cache on each node. Each processor has 64KB L1 cache and then each pair of processors share a 1.41 MB L2 cache, and 16 MB L3 cache.
Two communication channels exist. One handles management data(FAST Ethernet Switch); the other handles computing data(HPC IBM Switch 2).
The combined peak performance of the system is 64 GFLOPS.
See
Ibnsina Software
Ibnsina comprises a complex system of software working at
different layers:
Operating System
Ibnsina runs the AIX Operating System.
Clustering Components
The Parallel Systems Support Program (PSSP) is a comprehensive suite
of applications to manage Ibnsina as a full-function parallel processing
system.
The Parallel Operating Environment (POE) is the environment that lets users
manage parallel jobs.
The Loadleveler is a job management system that works with POE to let
users run jobs and match processing needs with system resources, in order to make better use of Ibnsina.
Programming Environment
The programming environment on Ibnsina consists of C/C++, and Fortran Compilers. Debugging,
and Profiling Tools. Parallel and Scientific libraries
See
Usage Policy
This list of computer use policies and security rules apply to all researchers
using Ibnsina.
Computers and network systems are inherently insecure. All users, are
cautioned that in general these technologies are not "private." Therefore
users should not expect privacy when using systems or networks. Take
appropriate protective measures, protecting sensitive information and
applications accordingly.
Computer Use
Ibnsina is to be used only for work as stated in account application form.
The use of Ibnsina for personal or non-project related activity is prohibited.
User Accountability
Users are accountable for their actions and may be held liable to
administrative or criminal sanctions for any unauthorized actions found to
be intentional, malicious, or grossly negligent.
Unauthorized Access
Users are not to access or attempt to access systems or information for
which they are not authorized. Users are not to attempt to receive unintended
messages or access information by some unauthorized means, such as imitating
another system, impersonating another user or other person, misuse of
legal user credentials (User IDs, passwords, etc.), or by causing some
network component to function incorrectly. Users are not to possess or
transfer information for which they are not authorized.
Passwords and User IDs
A User ID and password are required of all users.
Passwords are protected commensurate (equal) to the data and system they
protect. Passwords must be changed at least every six months. Passwords must
be at least six (6) characters long, not found in a dictionary, and cannot
be the name of a person, place, or thing.
Default passwords must be changed as soon as possible to avoid suspected compromise.
See Changing your password
Software License
All software used on Ibnsina be appropriately acquired and used according
to the appropriate licensing. This means that any illegally copied software
or use is expressly prohibited.
Software used on Ibnsina must be approved (generically or specifically) by CAMS.
Malicious Software
Users must not introduce or use malicious software such as computer viruses, Trojan horses, or worms.
Altering Authorized Access
Users are prohibited from changing access controls to allow themselves or
others to perform actions outside their authorized privileges.
Denial of Service Actions
Users are not allowed to prevent others or other systems from performing
authorized functions by actions that deny their access, their communications
capability, deliberately suppressing their messages or generating frivolous or
unauthorized traffic.
Deconstruction of Information or Software
Users are not allowed to reconstruct or recreate information or software
for which they are not authorized.
Typically, pubcc and pubc++ are the commands used to compile and
link programs. Other compilation scripts are available in the form of
pubcc_ibmsp2_aix_[PUB_COMMUNICATION]_[PUB_MODE].
See table below for possible value of PUB_COMMUNICATION and
PUB_MODE. To compile C++ files using the scripts, replace pubcc with
pubc++.
Some important and IBM specific options (see man xlf, xlc, or whatever for
more detailed explanations and more options; more information also HERE ):
Running jobs
The main node you log into on Ibnsina, e.g "ibnsina.cams.aub.edu.lb",
is where editing, compiling, and submitting of your programs to the loadleveler
should take place.
You do not have interactive access to other nodes in the cluster.
If you connect to other nodes (via rlogin/telnet/ssh) your processes will be killed,
and your account disabled.
Sequential Programs
Trial Runs
For short test runs, you can either submit your job to the tiny_serial job queue,
or run your job directly on "ibnsina.cams.aub.edu.lb" with a CPU time limit
of 2 hours.
Production Runs
For production runs, you must submit your jobs to one of the loadleveler queues
(tiny_serial, small_serial, medium_serial, large_serial, huge_serial) where each queue
3R
differs from the other according to the wall clock time allowed and the assigned queue priority.
Parallel Programs
Trial Runs
For short test runs, you can submit your job to the tiny_parallel job queue, that
will allocate 30 minutes of wall clock time for your parallel job. This should give
you a rough estimate of how long your job should take to run.
Producation Runs
For production runs, you must submit your jobs to one of the loadleveler queues
(tiny_parallel, small_parallel, medium_parallel, large_parallel, huge_parallel) where
each queue differs from the other accodring to the wall clock time allowed, and the
assigned queue priority.
See
Scientific Libraries
ESSL and PESSL
The ESSL products are compatible with public domain subroutine libraries such as Basic Linear
Algebra Subprograms (BLAS), Scalable Linear Algebra Package (ScaLAPACK), and Parallel Basic
Linear Algebra Subprograms (PBLAS), making it easy to migrate from these libraries. Contains BLAS
and LAPACK
MASS
MASS (Mathematical Accelerations SubSystem) library is available. It allows to speedup
codes that make deep usage of mathematical functions (sin, cos, exp, sqrt, ... ),
especially if used repeatedly.
