UniCluster 4.0 Test Drive

tell's picture

Well if you haven't already checked it out please go ahead and have a look on http://groups.grid.org/content/unicluster for the UniCluster 4.0 Test Drive.

UniCluster 4.0 is a big change from our previous releases of UniCluster.  We went back to the drawing board and 'put our heads together' to figure out 'what is needed for a medium sized HPC cluster?'.  UniCluster 4.0 creates the whole cluster all you need is the hardware and CentOS 5 or Oracle Enterprise Linux (the software works on RHEL as well but we didn't focus on that for the Test Drive.)

Anyhow enough talk about UniCluster 4.0 Test drive....does it really work?

 I have tried it on several vmware fusion virtual machines on my Mac Powerbook and it works fine!  It does take some time to get a 'clean' version of CentOS or Oracle Linux installed but once that is done the UniCluster installation is pretty easy.   I liked the simplicity of clicking on the 'repo rpm' that configures the yum repository for UniCluster and then all I did was a 'yum install unicluster' to download all of the base packages for UniCluster onto my new cluster 'installer node'.

Once the base packages were installed I sourced the Unicluster environment and ran the setup script. This part took some time as well since the installer asked for the CentOS media (it uses it to create the repository for the compute nodes) once the media is read and a repo is created the installer creates a disk and diskless image for the cluster.  After all that the setup finishes and the installer node is done.

 So after installing I fired up the web browser and pointed it to http://localhost.  That gave me a cluster homepage with documentation and installed 'kits'.

There a quite a few Kits available on the yum repository, you can have a look at the list by running the command:

# yum list unicluster-kit-*

I installed the SGE kit with the following command:

# yum install unicluster-kit-SGE

Then configured it by running:

# /opt/kusu/sbin/install-kit-sge

Once the Kit is installed it didn't do anything until I realized that it was not supposed to do anything until the kit is associated with a group of nodes.  To associate a kit with nodes I ran the node group editor 'ngedit' which is a menu driven tool for building clusters and associated the 'installer node' group with the SGE main component.  Once I did that and re-sync'd the node (it takes a while to do this and UniCluster displays a message saying it is busy...) I had SGE installed on the installer node in the cluster.

SGE was installed but I still had to source the environment or logout and log back in to run the SGE commands and submit jobs into the cluster....SGE takes some time to get used to but once you figure it out it is pretty easy to submit jobs to the system.

Overall the install was pretty easy...there are some concepts that take some time getting used to but after you do it once it is no problem.

The only thing I messed up was I did not sync time properly among the nodes in the cluster by running NTP....once I fixed that the system started to behave better.

Well that's all for now. I'll post more later.

 

0

Comments

flakrat's picture

I understand why SELinux is

I understand why SELinux is disabled, however what is the reason for disabling the firewall?Is this just during the initial install or does UniCluster run its own firewall? Or does the firewall need to be manually configured to trust the private network and only open a few ports to the public interface? 

tell's picture

re: iptables

Yes right now the firewall needs to be manually configured....In the final release version of UniCluster it will configure the firewall automatically....but it doesn't do that right now.

It is a mistake in the preview version, we should be configuring it even now but we are not.

I'll log a bug in bugzilla at http://bugs.grid.org and talk to dev.

 

flakrat's picture

"Clean CentOS Install"

I'm evaluating UniCluster (currently a Rocks cluster admin) and would think a set of instructions on the installation of CentOS would be valuable for those new to UniCluster.

I am expirimenting on a virtual machine, so I'll find the answers by trial and error, but a guide to the OS install would help get folks started quickly without them installing too much bloat.

I've found a few tidbits, for example ensuring NTP is configured and functioning, but nothing really detailed.

tell's picture

RE: Clean CentOS Install

Yes I agree we need to work on a clearer set of instructions for installing CentOS - I will updated the original instructions with Cameron's suggestions below...that will help for now but a more detailed instruction manual will be available for release (we want to release in November) Bill. 

Cameron's picture

Clean CentOS Install

When I install UniCluster 4.0 I typically do the following...

  • Use installation media selecting defaults for everthing except network configuration.
  • For network configuration I configure the "public" interface for DHCP and the "private" interface with a static address (typically something like 172.18.0.1/24).  I also assign a Fully Qualified Domain Name (FQDN) as the hostname for the machine (something like installer.cluster.univad.com).

During first boot I make sure to:

  • Disable SELinux
  • Disable Firewall
  • Enable NTP and make sure the time is correct (very important)

Once the machine is reboots again (do to the disabling of SELinux) I get the unicluster repo rpm and install uncluster.