Centos Clustering for High performance computing

General support questions
Post Reply
XP_2600
Posts: 15
Joined: 2017/12/18 11:48:35

Centos Clustering for High performance computing

Post by XP_2600 » 2018/07/03 08:35:15

Hello all, i have a lab with several computers, i am trying to build a high performance cluster, mainly for processing, which solution on CentOS i could use to do so? most of online articles seems obsolete as the packages themselves are not updated, please advise, thanks.

tunk
Posts: 1206
Joined: 2017/02/22 15:08:17

Re: Centos Clustering for High performance computing

Post by tunk » 2018/07/03 13:27:48

Haven't used it myself: http://www.rocksclusters.org/

Mike_Rochefort
Posts: 215
Joined: 2016/03/16 02:34:19

Re: Centos Clustering for High performance computing

Post by Mike_Rochefort » 2018/07/07 17:38:17

At my university our cluster currently uses RHEL 6.7 (I know, I know, we have a migration to 7 planned in the next few months). Most of our packages are hand built from source so besides a few system level libraries we almost never use repository packages (outside of build tools like configure/make/cmake). So out-of-date packages don’t really affect us all that much. We also have a pretty dense cluster with some decent infrastructure ( ~350-400 nodes, infiniband, MPI, GPFS for parallel storage, etc).

Depending on how intense your setup or requirements are I might recommend a similar approach. There’s also systems like Singularity which are like Docker but designed for HPC applications.

System runs like a champ, very few/no OS related issues.

Cheers,
Mike
Solution Architect @RedHat | RHCE
Former SysAdmin @BlueSkyStudios and @Pixar
Feature animation and VFX enthusiast
--
Report CentOS Stream 8 bugs: https://da.gd/c8s-bugs
Report CentOS Stream 9 bugs: https://da.gd/c9s-bugs

Post Reply