HDD Outlook 2024: Technologies and Trends

This report, published on December 14, 2023, was authored by Rainer W. Kaese, senior manager, HDD business development, Toshiba Electronics Europe GmbH.

 
HDD Outlook 2024: Technologies and Trends

HDDs are a tried and trusted storage technology that has stood the test of time. Critical benefits such as high capacities and low cost per capacity unit mean they provide an excellent foundation for data storage strategies in various industries and applications such as data centres, surveillance, gaming, and cloud computing.
 
So, what does the future hold for HDDs? Can they retain their relevance in the face of other storage solutions? Here, we look at some of the significant trends that will determine the role of HDDs in the data-driven era.
 
1. Navigating the balancing act between capacity and cost 
There has been intense R&D effort to ensure that HDDs remain competitive in the medium term. Recently, Toshiba launched the 22TB MG10F, a conventional magnetic recording HDD that leverages 10-disk helium-sealed design, adding a 10% capacity increase to the 3.5-inch form-factor MG10 range. Importantly, though, engineers have managed to pack more terabytes into the same form factor and the same power consumption at roughly the same cost. This is a critical point. At present, HDDs maintain a gap in cost per capacity with flash storage of around a factor of 7. This advantage remains the lifeline of the HDD. There is little point in adding more capacity if costs rise exponentially. Indeed, these efforts mean HDDs may reach 40 or even 50TB without approaching comparable costs with flash storage.
 
Two other factors must also be considered. Firstly, there needs to be demand for higher capacity – without it, product development becomes pointless. This market driver is a certainty. Even if HDDs reached as high as 100TB of capacity, our data-driven society means we would fill it in no time at all. Secondly, it has to be technically achievable. Toshiba continues to invest in delivering these incremental advances, with teams of engineers and materials scientists performing qualification tests and other procedures daily. This effort is ongoing and will remain while demand for HDDs with higher capacities continues.
 
2. Meeting the sustainability demands of data centre operators
Data centres still depend on HDDs as the prevalent storage devices for hyperscale facilities serving the cloud. Here, the 22TB capacity increase mentioned above represents a significant advance, as higher capacities in the same form factor offer substantial advantages in rack space in often space-constrained urban locations. Increasingly, data centres combine individual HDDs through RAID techniques that can create larger and speedier storage solutions. It is common to see 24 HDDs integrated into one housing unit, and this is likely to keep rising – possibly to somewhere in the region of 60 to 120.
 
The second significant trend in data centres is sustainability, and there are 2 distinct ways that HDDs can make a difference. Firstly, regarding energy efficiency, if you want to spin a storage disk at a certain speed and access it at a specific rate, you inevitably come up against the laws of physics, typically requiring about 10W per unit. Helium technology launched several years back helped cut that figure to around 7-8W. But the only way to become more energy-efficient than that is to introduce more capacity for those 10W – which recent advances have helped deliver. Also, data centre engineers are thinking about how to use the HDD in a more power-optimised way, possibly through idle or power-down modes.
 
The other notable sustainability trend is recycling. The first wave of HDD deployments in data centres for the cloud took place 6 or 7 years ago, and those components are now coming to the end of their lifecycle and are being decommissioned. HDDs are comprised of aluminium and copper, making them much easier to recycle than other components and materials such as PCBs, chips, and plastics. Consequently, we expect HDDs to become an integral part of the circular economy based on services such as recycling and reuse.
 
3. Providing storage solutions advice to end users
Most HDDs go into cloud and enterprise applications, and these end users increasingly expect HDD suppliers to act as collaborative partners to help establish the best technologies and configurations for their specific deployments. To meet this need, Toshiba’s European HDD laboratory can combine multiple HDD combinations to test function and performance. Most recently, this has seen the installation of a high-capacity top-loading JBOD enclosure with 78x18TB HDDs, giving a total capacity of 1.4PB, which is connected to a server. This infrastructure makes it possible to exercise one single HDD to establish its performance rate per MB/s. Then, it is possible to switch to any combination of the 78 units, adding them incrementally and accurately measuring the total outputs. With all 78 HDDs active, the performance is rated at almost 17GB/s.
 
This infrastructure can also be used to perform detailed trade-off calculations, helping end users settle on the correct configuration for the task at hand. Without it, they might have to invest in their ports and HDDs as test samples, which is not always cost-effective. Recent activities at the Toshiba Electronics Europe lab have seen the testing of HDD combinations in a way that is fast enough for archiving data, video streaming for online data like navigation systems, and operating web shops. This collaborative activity is crucial for enterprises deploying HDDs in large-scale applications – ultimately extending the lifespan of this ever-evolving technology. 
 
4. Retaining relevance in write-intensive surveillance applications
The surveillance sector continues to have a high requirement for data storage, with the trend towards higher-quality, 24/7 video streams supported by affordable hardware that is reliable enough to ensure operation. Historically, if there is a requirement for a storage element inside the camera itself, this has typically been a flash component, while the central recorder often comprises one or more HDDs. In certain parts of the world, such as central Europe, where GDPR requirements mean only a small amount of recording can be retained for a short period, system vendors may consider a low-capacity SSD for that central storage too – as that small capacity means it achieves cost parity with HDD in specific scenarios. However, such a setup does not overcome the challenges of write-intensive operations. High over-ride cycles where data can only be kept for a few days would quickly wear out a flash component. There are no such constraints for HDDs.
 
Other benefits also come to the fore. Surveillance systems always deal with sequential write operations, in which data is written continuously. HDDs excel at sequential write performance, making them the obvious solution for the sustained and sequential nature of video recording. Also, HDDs are non-volatile storage devices that retain data even when the power is turned off. This is an essential consideration for surveillance systems, where data integrity and preservation are required in case of power outages or unexpected system shutdowns. Ultimately, then, HDDs will continue to play an important role in surveillance.
 
Maintaining a future role for HDDs
So, it is clear that HDDs do have a bright future. Toshiba remains committed to investing in R&D to drive incremental advances while expanding production capacity to meet demand. And it will be through continued collaboration with data centre equipment vendors, surveillance systems integrators, and computing OEMs that HDDs will continue to have a central role to play in the data-driven era.