New Zealand Institute of Water Research Selects VAST Data

VAST Data Ltd announced that the National Institute of Water and Atmospheric Research (NIWA), New Zealand’s Crown Research Institute for environmental science, has selected the VAST Data Platform to update and future-proof its data infrastructure.

The platform will enable NIWA to synchronise its production workloads and research across primary and secondary sites, optimise storage efficiency, and prepare for next-gen GPU-based scientific workloads.

NIWA’s ground-breaking research in atmospheric science, oceanography, and climate modelling relies on over 20PB of historical weather data. With the advent of AI and ML technologies, NIWA required a solution to unify its operations, ensure scalability, and support evolving demands for HPC.

The VAST Data Platform’s active-active clustering capabilities, enabled through a global namespace, allow synchronisation and utilisation of data across multiple sites. This innovation reduces operational complexity compared to legacy systems, making it faster and easier to implement while offering advanced functionality like write-read access across both sites.

“VAST Data stood out in a crowded field for its ability to unify our sites and prepare us for the future of AI-driven research,” said Jeff Zais, HPC senior science advisor and platform architect, NIWA. “The platform not only supports our current CPU-based workloads but also gives us the flexibility and confidence to integrate GPU capabilities as we transition to new weather and climate modelling codes. VAST’s synchronisation features, density advantages, and vision for the future were critical in our decision to partner with them.“

In addition to addressing current CPU-based workloads, the VAST platform simplifies storage management with its integrated compression, de-dupe, and multi-tenancy capabilities. These features ensure optimal storage space utilisation while reducing daily management burdens, allowing NIWA to focus on advancing its research priorities.

VAST Data’s Disaggregated Shared-Everything (DASE) architecture played a pivotal role in NIWA’s selection, addressing challenges with legacy systems while reducing costs and operational complexity. The platform’s high-density design enabled NIWA to shrink its physical infrastructure footprint, cutting costs over a 6-year period while improving data accessibility and reliability.

“The VAST Data Platform will provide the backbone for NIWA’s advanced technology and intelligent data capture, empowering not only our storage and archival needs but also being able to support other research and agencies across New Zealand,” said Warrick Johnston, GM, technology and innovation, NIWA.

“NIWA is a pioneer in climate and environmental research, and it’s critical that it has the tools to access and analyse its immense datasets in real time,” said Sunil Chavan, SVP, APAC, VAST Data. “The VAST Data Platform provides the scalability, performance, and integration needed to address the complexities of modern scientific workloads. We’re proud to support NIWA as it continues to innovate and lead on a global scale.“

With the ability to fully utilise resources at its secondary site, NIWA can run more climate models simultaneously, improve disaster preparedness, and orchestrate more use cases with fewer resources. This ensures faster, more detailed insights into climate and environmental patterns, driving impactful science that benefits both New Zealand and global efforts.

The VAST Data Platform will form the backbone of NIWA’s data infrastructure as it embarks on projects involving GPU-ready applications, next gen weather modelling, and collaborative global initiatives. The deployment process is underway, with full production readiness anticipated by May 2025.

This deployment positions NIWA as a leader in using AI-driven data platforms for environmental science. By adopting VAST’s infrastructure, NIWA not only sets a benchmark for other institutions but also highlights the transformative role of modern data solutions in tackling global challenges.  

Resources:
VAST Data Platform for Research and Education    
National Centre for Supercomputing Applications to Accelerate AI Research and Discovery