The supercomputer in my basement

In the world of High Performance Computing (HPC), Beowulf clustering stands in a class of its own.

Beowulf is an approach to building a supercomputer by means of clustering commodity off-the-shelf (COTS) computers that are interconnected with a local area network technology like Ethernet and running programs optimized for parallel processing.

It is possible to assemble a collection of commodity hardware components and freely available software packages in a day and have them executing real-world applications. Traditionally, Beowulf is a class of Pile-of-PCs that leverages on low cost mass-market systems that support Unix-like operating systems at low or no cost and for which source code is readily available.

The benefits of a Beowulf cluster is that it allows even small research firms to build their own supercomputers. In addition to possible cost savings, building their own supercomputers is very much a learning investment in itself for the researchers as well as making them less dependent in the future on particular hardware and software vendors. A Beowulf cluster can upgrade and evolve as off-the-shelf technology evolves.

The development of this technology is due to the development of the causal computing market such as office automation, home computing, games and entertainment which provided system designers with cost-effective components. The COTS industry provides fully assembled subsystems such as microprocessors, motherboards, disks and network interface cards for which mass market competition has driven the prices down and reliability up for these subsystems.

Coupled with the development of standards for interoperability of subsystems which has generated an open market of COTS, it is possible to customize different versions of Beowulf or just maximizing cost advantages. Beowulf developers often choose the Linux operating system and use standard message passing protocols between the computers within the cluster for cost advantages.

This presents an opportunity for parallel computer vendors to provide a low entry-level cost to parallel systems, expanding the role of parallel computing and the number of people capable of using parallel computers, creating a larger customer base for parallel computers in the long term. In the taxonomy of parallel computing, a Beowulf cluster is placed somewhere between a massively parallel processor (MPP) and a network of workstations (NOW) that is clustered for the purpose of load balancing.

Sign up for ITworld's Daily newsletter
Follow ITworld on Twitter @IT_world

• Email
• Print
• Share
  • Slashdot
  • Digg
  • Stumble
  • Reddit
  • Newsvine