Tencent Cloud Joins IBM and Mellanox to Break Data Sorting Records
98.8 seconds to sort 100TB
This is a Press Release edited by StorageNewsletter.com on November 17, 2016 at 2:41 pmTencent, Inc., IBM Corp. and Mellanox Technologies, Ltd. announced that Tencent Cloud has been named the winner of the sort benchmark annual global computing competition for 2016.
Tencent Cloud and the Big Data Collaboration team spent less than 99 seconds (98.8 seconds) finishing sorting 100TB of data in the Indy GraySort category, improving on 2015’s best result, 329 seconds, by a factor of 3.3.
Each year, top global companies and academic institutions participate in the contest to evaluate the capability of their software and hardware system architectures, as well as their research results. Tencent Cloud participated in two of the four competition categories, GraySort and MinuteSort, to benchmark the architecture capabilities and computing efficiencies of large distributed computing systems and real time data analytics.
The GraySort and MinuteSort benchmarks are each measured in two sub categories:
-
Indy (special purpose sort)
-
Daytona (general purpose sort)
Tencent Cloud Data Intelligence, the distributed computing platform of Tencent Cloud, won each category in both the GraySort and MinuteSort benchmarks, establishing four world records with its performance, outperforming 2015’s best speeds by two to five times.
“In the future, the ability to manage big data will be the foundation of successful Internet businesses,” said Zeus Jiang, VP, Tencent cloud and GM, data platform department, Tencent. “Tencent Cloud can provide precise high performance computing to enterprises using minimal time and resources. We will continue to improve the back end technology for our cloud service by optimizing architecture, software and hardware to help global enterprises solve complex business challenges by leveraging hyper-scale computing platforms.”
2016 sort benchmark contest result :
As a non-profit organization, sortbenchmark.org uses the basic sort computing method to evaluate distributed system software architectural capabilities such as storage, task scheduling, node communication, and data exchange. It also evaluates hardware architectural capabilities, including server selection and match, network architecture optimization, and the ability to build Internet Data Centers. The ultimate test is on the capabilities of large scale computing of a company or an organization. In this sort contest, Tencent Cloud used 512 IBM OpenPOWER servers and Mellanox’ 100Gb/s interconnect technology, improving the performance of Tencent Cloud big data products with the infrastructure.
“Industry leaders like Tencent are helping IBM and our OpenPOWER partners push performance boundaries for a cognitive era defined by big data and advanced analytics,” said Tom Rosamilia, SVP, IBM Systems. “The computing record achieved by Tencent Cloud on OpenPOWER is an important milestone for the industry.”
“Real-time-analytics and Big Data environments are extremely demanding and the network is critical in linking together the extra high performance IBM POWER-based servers and Tencent Cloud’s massive amounts of data,”said Amir Prescher, SVP, business development, Mellanox. “Tencent Cloud developed an optimized hardware/software platform to achieve new computing records, showing that Mellanox’s 100Gb/s Ethernet technology can deliver total infrastructure efficiency and improves application performance, making them ideal for Big Data applications.”