awesome-hpc

Bare Metal Provisioning system for HPC Linux clusters ( )

xCAT is a toolkit for deployment and administration of clusters of all sizes ( )

Warewulf is a stateless and diskless container operating system provisioning system for large clusters of bare metal and/or virtual systems ( )

A Linux distribution for developing Linux clusters

Cobbler is a Linux installation server that allows for rapid setup of network installation environments ( )

Base Command Manager allows administrator to quickly build and manage heterogeneous clusters

Scyld Clusterware Scyld ClusterWare is developed based on the continuing evolution of Beowulf clusters first developed at NASA in the 1990s

BlueBanquise is an open source cluster deployment and management stack built on Python and Ansible ( )

A free and open source job scheduler ( )

A job scheduler and workload management software developed by IBM

Moab is a workload management and job scheduler

Torque is a workload management and job scheduler

OpenLava is a workload management and job scheduler

Univa Grid Engine is a workload management engine for HPC

Volcano is a batch system built on Kubernetes

Maui is a workload management and job scheduler

Kube Batch

A batch scheduler of kubernetes for high performance workload, e.g. AI/ML, BigData, HPC

OpenPBS® software optimizes job scheduling and workload management in high-performance computing (HPC) environments ( )

Data drive computational pipelines

Scientific workflow engine designed for simplicity & scalability ( )

A configurable system for mapping and executing scientific workflows over a wide range of computational infrastructure ( )

A flexible package manager that supports multiple versions, configurations, platforms, and compilers ( )

EasyBuild - building software with ease ( )

NVIDIA HPC compiler suite for Fortran, C/C++ with OpenACC

The Portland Group compilers were Fortran, C/C++ compilers now integrated into NVIDIA HPC SDK

The Intel compiler suite offers many language compilers for use in the HPC space

A suite of compilers designed and optimized to target the AMD interlagos instruction set

The GNU Compiler Collection is a suite of compilers targeting many languages ( )

The LLVM project is a collection of modular compilers and toolchains ( )

OpenMPI is an open source implementation of the MPI-3.1 standard ( )

MPICH is a high-performance and widely portable implementation of the MPI-3.1 standard ( )

MVAPICH is an open source implementation of the MPI-3.1 standard developed by Ohio State University

Intel-MPI is Intel's MPI-3.1 implementation included in their compiler suite

A general purpose tensor library that simplifies the process of software development for parallel architectures

OpenMP is an application programming interface that supports multi-platform shared-memory multiprocessing programming

A collection of benchmarking tools for MPI developed by Ohio State University

A set of benchmarks developed by Intel for use with their Intel MPI

HPCC Systems (High Performance Computing Cluster) is an open source, massive parallel-processing computing platform for big data processing and analytics ( )

LINPACK is a set of efficient fortran subroutines for solving linear systems which benchmarks are useful for HPC

IOzone is a filesystem benchmark tool

Interleaved or Random is a useful benchmarking tool for testing parallel filesystems

MDtest is an MPI-based application for evaluating the metadata performance of a file system

Flexible I/O is an advanced disk benchmark that depends upon the kernel's AIO access library ( )

elbencho

A distributed storage benchmark for files, objects & blocks with support for GPUs

Open OnDemand helps computational researchers and students efficiently utilize remote computing resources by making them easy to access from any device ( )

Open XDMoD is an open source tool to facilitate the management of high performance computing resources ( )

ColdFront is an open source resource allocation system designed to provide a central portal for administration, reporting, and measuring scientific impact of HPC resources ( )

Pavilion is a Python 3 (3.6+) based framework for running and analyzing tests targeting HPC systems ( )

A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems. ( )

The OLCF Test Harness (OTH) helps automate the testing of applications, tools, and other system software ( )

GoSlmailer

Goslmailer is a drop-in notification delivery solution for slurm that can do slack, mattermost, teams, and more

TotalView is a debugging tool for HPC applications

TAU Performance System® is a portable profiling and tracing toolkit for performance analysis of parallel programs written in Fortran, C, C++, UPC, Java, Python

Valgrind is a tool designed to profile programs to determine memory leaks ( )

Paraver is a very flexible data browser that is part of the CEPBA-Tools toolkit

Performance Application Programming Interface (PAPI) is a performance analysis tool ( )

pdsh runs terminal commands across multiple hosts in parallel ( )

Scalable cluster administration Python framework ( )

Apptainer is an open source container system ( )

Charliecloud provides user-defined software stacks (UDSS) for high-performance computing (HPC) centers ( )

Docker is a set of platform as a service products that use OS-level virtualization to deliver software in packages called containers

A basic user tool to execute simple docker containers in batch or interactive systems without root privileges ( )

Shifter is Linux containers for HPC ( )

HPC Container Maker

HPC Container Maker is an open source tool to make it easier to generate container specification files.

Scarus

An OCI-compatible container engine for HPC

Singularity Registry HPC (shpc) allows you to install containers as modules ( )

Lmod: An Environment Module System based on Lua, Reads TCL Modules, Supports a Software Hierarchy ( )

Environment Modules: provides dynamic modification of a user's environment ( )

Anaconda is a Python and R distribution for use in computational science

Mamba is a reimplementation of the conda package manager in C++ ( )

VisIt - Visualization and Data Analysis for Mesh-based Scientific Data ( )

ParaView is an open-source, multi-platform data analysis and visualization application based on Visualization Toolkit (VTK) ( )

GPFS is a high-performance clustered file system software developed by IBM

A high performance filesystem

Ceph is a distributed object, block, and file storage platform ( )

A file system designed for HPC

Lustre is an open-source, distributed parallel file system software platform designed for scalability, high-performance, and high-availability ( )

BeeGFS is a hardware-independent POSIX parallel file system developed with a strong focus on performance and designed for ease of use, simple installation, and management

OrangeFS is a next generation parallel file system for Linux clusters ( )

Moose File System is an Open-source, POSIX-compliant distributed file system developed by Core Technology ( )

Julia is a high-level, high-performance dynamic language for technical computing

Futhark is a purely functional data-parallel programming language in the ML family

Chapel is a programming language designed for productive parallel computing at scale

Slurm Exporter

Prometheus exporter for performance metrics from Slurm

Slurm Exporter

Slurm Exporter for Prometheus using Rest API

Infiniband Exporter

The InfiniBand exporter collects counters from InfiniBand switches and HCAs

Cgroup Exporter

Produces metrics from cgroups

Cgroup Exporter

A Prometheus exporter for cgroup-level metrics

GPFS Exporter

The GPFS exporter collects metrics from the GPFS filesystem

Lustre Exporter

Prometheus exporter for use with the Lustre parallel filesystem

DCGM Exporter

NVIDIA GPU metrics exporter for Prometheus leveraging DCGM

An International Journal of High-Performance Computer Design, Analysis, and Use

Each week, Intersect360 Research CEO Addison Snell and HPCwire editor Tiffany Trader dissect the week's top HPC stories

ECP's Let's Talk Exascale podcast goes behind the scenes to chat with some of the people who are bringing a capable and sustainable exascale computing ecosystem to fruition

Join Shahin Khan and Doug Black as they discuss Supercomputing technologies and the applications, markets, and policies that shape them

Since 1987 covering the fastest computers in the world and the people who run them

insideHPC is a global publication recognized for its comprehensive and insightful coverage of the HPC-AI community, linking vendors, end-users and HPC strategists

Offers in-depth coverage of high-end computing at large enterprises, supercomputing centers, hyperscale data centers, and public clouds

The Register is a leading and trusted global online enterprise technology news publication, reaching roughly 40 million readers worldwide

High-Performance Computing knowledge base articles from Dell

Practice & Experience in Advanced Research Computing

The International Conference for High Performance Computing, Networking, Storage, and Analysis

The International Conference for High Performance Computing, Networking, Storage, and Analysis

IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing

IEEE High Performance Embedded Computing

Semiconductor industry's leading conference on high-performance microprocessors and related circuits

IEEE conference on software architectures and implementations for interconnection networks of all scales

Workshop on Extreme-Scale Storage and Analysis

IEEE International Parallel & Distributed Processing Symposium

International Workshop on Extreme Scale Programming Models and Middleware

The Linux Clusters Institute (LCI) is providing education and advanced technical training for the deployment and use of computing clusters to the high performance computing community worldwide

Teaching basic skills for high-performance computing

The TOP500 project ranks and details the 500 most powerful non-distributed computer systems in the world

The MUG conference provides an open forum for all attendees (users, system administrators, researchers, engineers, and students) to discuss and share their knowledge on using MVAPICH libraries

The annual Slurm user group meeting