The GLobally Accessible Data Environment (GLADE) provides centralized high-performance file systems spanning supercomputing, data post-processing, data analysis, visualization, and HPC-based data transfer services. GLADE provides computation, analysis, and visualization work spaces common to all CISL HPC resources. Project space is allocated through NCAR’s allocation panels, while scratch and user space is available to all users of NCAR HPC resources. GLADE also hosts data from NCAR’s Research Data Archive (RDA), NCAR’s Community Data Portal, and the Earth System Grid, which curates CMIP5/AR5 data.
GLADE is fully allocated, and end-FY2011 utilization is shown in the chart. The GLADE storage cluster provides high-performance data services for NCAR’s HPC resources. GLADE provides large amounts of data storage for individual user projects as well as NCAR’s Research Data Archive, Community Data Portal, and the Earth System Grid. GLADE has significantly improved workflows for research.
The goals of this effort are focused on shifting data workflows from a process-based design to an information-based design. Through a globally accessible storage infrastructure, users now structure their workflows to use stored data directly without first needing to move or copy it. Additional services like high-performance data transfer protocols enhance our ability to bring computational data from other sites to NCAR for post-processing, analysis, and visualization.
In FY2011 we focused on enhanced data transfer protocols, allocation processes, charging mechanisms, and space management tools. This architecture became the backbone for the storage resource procurement as part of the NWSC-1 RFP process. Lessons learned from GLADE are being used to guide the deployment of NWSC resources.
This work supports CISL’s computing imperative for hardware cyberinfrastructure by provisioning storage and networking systems customized to support efficient workflows for the atmospheric and related sciences. Specifically, GLADE facilitates typical user workflows plus special efforts like supporting data flows for the IPCC AR5. GLADE also advances CISL’s computing imperative for facilities by demonstrating high-performance data services that will be critical for the next-generation resources that will operate at NWSC. By using GLADE-enabled workflows now, users are preparing for a smooth transition to NWSC’s new environment. GLADE equipment was purchased with NSF Special funds, and it is supported by NSF Core funds including CSL funding.