Welcome to Research Computing at Mines documentation!

General Information

• Overview of Research Computing at Mines
  • High Performance Computing (HPC)
  • Getting more help
• Policies
  • HPC & Storage Rates and Best Practices
  • Data Policy
  • HPC Etiquette
  • Login/Management Node
  • Scratch vs Home Directory
  • Home Directory Policy
  • Slurm
  • High-Performance Computing (HPC) Node Life Cycle
• Computing Options at Mines
  • Pay-per-use HPC
  • Free or Credit-based HPC Options
• Research Computing Consultation
  • Parallel Computing Consultation Guidance
• Frequently Asked Questions
  • What is HPC?
  • How do I acknowledge usage of HPC@Mines resources?
  • I’d like to install a Python library. How do I do that?
• Workshops
  • Fall 2024
  • Spring 2024
  • Past Workshops
• Publications using Mines HPC Systems

High Performance Computing (HPC)

• Systems
  • Wendian
    • Wendian Compute Configuration
      • Compute Node Details
      • Filesystem
    • Cooling
  • Mio
    • Students
    • Faculty
    • Mio Compute Configuration
• The Module System
  • Notes on Lmod
  • Common module commands
  • Modules for Compilers
    • MPI Compiler Wrappers
      • Build with GCC and OpenMPI
      • Build with Intel compilers and Openmpi
      • Build with Intel and Intel MPI
  • More on Compilers
    • Intel compilers
      • -ax Suboptions
      • -march Suboptions
        • Build on Mio to run anywhere
        • Build on Mio to run anywhere but include skylake instructions
        • Build on Mio to run anywhere but include skylake instructions, same as above
        • Build on Mio but can only run on skylake nodes
        • Trying to run a skylake code on Mio returns an error
    • GCC Compilers
  • Current Modules
    • Wendian
    • Mio
• Getting Started (New User Guide)
  • Introduction
    • Mines Gitlab Repository for Scripts
  • Connecting to an HPC System via SSH
    • Linux and MacOS
    • Windows
  • Introduction to Command Line and Filesystem
    • Filesystem Basics
    • Command Line Basics for Navigating the Filesystem
    • Choosing a text editor
  • Running Jobs
    • Slurm: HPC Job Scheduler
    • Slurm Job Management and Policy
    • Running your first compiled job - Hello World!
  • An Introduction to the Module System
    • Important Module commands
  • Running jobs with modules
    • Hello World! Using MPI
    • [OPTIONAL] Using Python
      • Creating your own environment using Anaconda
      • Deactivating your conda environment
      • Running Python with Slurm
  • Post-processing and Visualizing Data on HPC
  • Transferring data off HPC systems
    • Transferring files on Windows or without command line
• Connecting to Mines@HPC Systems
  • Setting up SSH keys for easier login
  • Connecting to HPC using Open OnDemand
• Using Anaconda for python environments
  • Setting up base environment
    • Loading the Python module
      • Wendian and Mio
    • Creating and activating a conda environment under your home directory
    • Creating conda environment in a custom location
  • Appliciation-specific conda environment
    • NumPy + SciPy + Matplotlib
    • Tensorflow (GPU)
    • Tensorflow (CPU-only)
  • Cleaning up conda packages
    • Remove all cached packages
  • Proper mpi4py setup to use system MPI on Wendian/Mio
• Running MATLAB on HPC Systems
  • Running an interactive job
  • Submitting a Matlab Job to {Mio, Wendian}
• Advanced Slurm Guide
  • Basics
    • General Slurm Commands
    • sbatch
    • HPC@Mines Specific Commands
    • Wendian-specific Commands
      • Using Charge Accounts
    • Mio-specific commands
  • Checking on jobs using sacct
  • Configuring compute resources
    • Determining node configuration
  • Dependencies
  • Job Arrays
• Knowing your job efficiency
  • XDMoD.mines.edu
    • Using the Efficiency Tab
  • SLURM command ‘seff’
  • Selecting Job ID in XDMoD.mines.edu
    • Example of Rscript using 3-nodes
    • Example of Ansys Fluent (interactively running)
• Parallel Scaling Guide
  • Software Prerequisities for Guide
  • Introduction
  • Prerequisities to use this Guide
  • What is parallel scalability?
  • Before considering parallel scalability
    • Parallelization Support
    • Serial Performance
  • Measuring Parallel Scalability
    • Notation
    • Performance Metrics
      • Wall Time
      • Speed-up
      • Efficiency
      • Load balancing
      • Other metrics
    • Basic Theory
      • Amdahl’s Law
      • Strong Scaling
      • Weak Scaling & Gustafson’s Law
  • Example: Parallel Matrix-Vector Multiplication using Python
    • Serial Matrix-Vector Multiplicaton using Python
      • Pure Python Implementation
      • NumPy Array Implementation
      • NumPy’s built-in Matrix-vector multiplication function: matmul()
      • Using Numba with NumPy
      • Row-wise Parallelization of Matrix-vector multiplication in Python using MPI
    • Slurm Setup
• References
• Archived Guides
  • Programming Guides
  • Scripting Guides

Budget Guidance

• Research Computing Guidance
• Case Study: Researcher using Open Source Finite Element Code FEniCS for modeling reacting flows

Cloud Resources

• Amazon Web Service (AWS)
  • Centralized Billing and Cost savings
• Google Cloud Platform (GCP)

Indices and tables

• Index

• Module Index

• Search Page