Deployments

This is a catalog of pangeo deployments that we know about. If you have deployed something like pangeo on either a HPC or cloud computing system, please let us know.

For more information on how pangeo is deployed on these systems, checkout our setup guides.

Cloud Computing Deployments

  • pangeo.pydata.org
  • Description: Flagship Pangeo JupyterHub server for scalable interactive data analysis running on Google Cloud Platform
  • Platform: Google Cloud Platform
  • Dask Deployment: dask-kubernetes
  • Jupyter Deployment: JupyterHub
    • pangeo-aws.cloudmaven.org
  • Description: Prototype JupyterHub server running on AWS
  • Platform: Amazon Web Services
  • Dask Deployment: dask-kubernetes
  • Jupyter Deployment: JupyterHub
    • Lamont Real-Time Earth Pangeo Cluster
  • Description: JupyterHub server used Earth/ocean science research
  • Platform: Microsoft Azure Cloud
  • Dask Deployment: dask-kubernetes
  • Jupyter Deployment: JupyterHub
    • RGH-Hub
  • Description: JupyterHub server used for interactive data analysis by Rhodium Group staff for climate research and analysis
  • Platform: Google Cloud Platform
  • Dask Deployment: dask-kubernetes
  • Jupyter Deployment: Jupyterhub
    • Met Office Informatics Lab
  • Description: A prototype cluster for the Met Office.
  • Platform: Amazon Web Services
  • Dask Deployment: dask-kubernetes
  • Jupyter Deployment: Jupyterhub
    • Dask Tutorial Cluster
  • Description: JupyterHub server used for dask tutorials
  • Platform: Google Cloud Platform
  • Dask Deployment: dask-kubernetes
  • Jupyter Deployment: Jupyterhub
  • High Performance Computing Deployments

    • NCAR Cheyenne Cluster
  • Description: Large HPC cluster (5.34-petaflops) running at the National Center for Atmospheric Research
  • Platform: HPC
  • Dask Deployment: dask-jobqueue and dask-mpi
  • Jupyter Deployment: Single user notebook servers
    • NASA Pleiades Cluster
  • Description: Large HPC cluster (7.24-petaflops) running at the NASA High-End Computing Capability Project
  • Platform: HPC
  • Dask Deployment: dask-mpi with custom launch scripts
  • Jupyter Deployment: Single user notebook servers
    • Columbia Habanero Cluster
  • Description: Research cluster at Columbia University
  • Platform: HPC
  • Dask Deployment: dask-mpi with custom launch scripts
  • Jupyter Deployment: Single user notebook servers
    • CNES HAL
  • Description: CNES research cluster
  • Platform: HPC
  • Dask Deployment: dask-jobqueue and custom launch scripts
  • Jupyter Deployment: Single user notebook servers
    • USGS Yeti
  • Description: USGS's Advanced Research Computing cluster
  • Platform: HPC
  • Dask Deployment: dask-jobqueue and custom launch scripts
  • Jupyter Deployment: Single user notebook servers
    • UW Hyak
  • Description: The University of Washington's shared supercomputing cluster.
  • Platform: HPC
  • Dask Deployment: dask-mpi and custom launch scripts
  • Jupyter Deployment: Single user notebook servers
    • DOD HPC Systems at AFRL and ERDC
  • Description: Unclassified Department of Defense High Performance Computing Modernization Program Supercomputing Clusters (Thunder, Topaz, Utility Servers, etc.)
  • Platform: HPC
  • Dask Deployment: dask-jobqueue, dask-mpi, and custom launch scripts
  • Jupyter Deployment: Single user notebook servers
    • GFDL Post-processing and Analysis Cluster
  • Description: HPC cluster running at the NOAA Geophyiscal Fluid Dynamics Laboratory
  • Platform: HPC
  • Dask Deployment: dask-jobqueue with a custom PBSCluster subclass
  • Jupyter Deployment: Single user notebook servers
    • Princeton Tiger Cluster
  • Description: Research computing cluster running at Princeton University
  • Platform: HPC
  • Dask Deployment: dask-jobqueue
  • Jupyter Deployment: Single user notebook servers