HPC Storage Sector Booming – Intersect360 Research

This article was written by George Leopold on HPCwire

Nearly one-third of storage systems spanning SANs to cloud platforms reached 1PB or greater capacity in 2015, according to a user census that also protects more than half of installed storage systems will top the 1PB level by 2020.

The storage user survey released in tandem with SC15 by market watcher Intersect360 Research also said surging storage demand driven by big data projects and emerging storage technologies has resulted in “unfettered growth of total storage” over the least five years. By contrast, only 9.6% of users surveyed in 2010 reported storage capacity of 1GB or greater.

“Growth in both new data sources and existing databases is exceeding the abiliy of organizations to manage and leverge data for advancing R&D efforts and to make organizational decisions,” the user survey concluded. The push for big data analytics “is creating a new set of HPC demands and opportunities, in which storage, by definition, is a major component.“

The user survey also ranked leading HPC storage suppliers based on the number of installed systems. DataDirect Networks leads with a 13.9% share of the storage market followed by IBM with 11.8% and NetApp at 8.3%. Despite dominance by DDN and IBM, the market researcher said there remains “much opportunity for growth for [emerging] vendors as well as other storage suppliers.”

Leading storage suppliers at HPC sites
(based on number of installed systems)

(Source: Interact360 Research, 2015)

Indeed, a crop of storage start-ups is targeting both enterprises and the HPC market with technologies like scale-out NAS. Among them is Seattle-based Qumulo, which announced during tSC15 conference that the University of Utah’s Scientific Computing and Imaging Institute would use its core intelligent storage platform to manage data used in visualization, scientific computing and imaging analysis projects.

Intersect360 Research reckons there are more than 50 companies are currently vying for a share of the HPC storage market. The sector also is seeing the beginnings of consolidation, particularly with the blockbuster merger announced last month between Dell and EMC. That deal was driven in part by Dell’s desire to sharpen its focus on large enterprises and the HPC.

While the $67 billion merger reportedly still faces major hurdles such as a potential a $9 billion tax on the deal, the market researcher said a successful merger would have a significant impact of the HPC storage market in 2016.

EMC’s rivals would gain if the deal unravels, the analyst said: “EMC has a revenue position that is greater than its share of survey responses would indicate, and Dell is one of the leaders in servers for HPC. If there is any confusion, lack of communication, or strategic uncertainly in the acquisition, other storage vendors could gain share from EMC in the near term.”

Meanwhile, cloud storage platforms have made slight gains in the overall storage market, accounting for an estimated 4.7% of total storage capacity in 2015. Amazon Web Services remains the primary supplier, and the market watcher expects “cloud usage to be one of our fastest growing segments, while also being the smallest.”