WekaIO Sets 6 Records on STAC-M3 With WekaFS Parallel File System on Amazon EC2

WekaIO, Inc. announced record-breaking performance of its Weka File System (WekaFS) on Amazon Elastic Compute Cloud (Amazon EC2) according to the STAC-M3 Benchmark.

An independent audit, conducted by Securities Technology Analysis Center (STAC), showed that the company’s solution broke 6 STAC-M3 records, confirming that the WekaFS POSIX-compliant file system on Amazon Web Services (AWS) is a capable and performant option for enterprises looking to enjoy the elasticity and agility of tick analytics in the cloud. Financial services use cases such as algorithmic trading, quantitative analytics, and back testing can benefit from these results for hybrid and cloud native workflows.

The STAC-M3 benchmark suite is an industry standard for testing solutions that enable high-speed analytics on time-series data, such as tick-by-tick market data (aka ‘tick analytics’ stacks). STAC-M3 specs were developed by the STAC Benchmark Council, which consists of over 400 financial institutions and 50 vendor organizations. User firms include the largest global banks, brokerage houses, exchanges, hedge funds, proprietary trading shops, and other market participants.

This testing was performed on Amazon EC2 NVMe instances using a kdb+ 4.0 database by KX Systems. Testing included the baseline STAC-M3 suite (Antuco) and the scaling suite (Kanaga).

Key result highlights for this solution, with 15 database server nodes and 40 storage nodes, include:

• Outperformed all publicly disclosed results in 3 of the 5 throughput benchmarks in the STAC-M3 Kanaga suite (STAC-M3.β1.1T.{3,4,5}YRHIBID.BPS )

• Outperformed all publicly disclosed results in 3 of 24 mean-response-time benchmarks in the STAC-M3 Kanaga suite

• vs. a kdb+ 4.0 solution running on a 10-node cluster with 60TB of persistent memory (KDB200603), was faster in 16 of 24 Kanaga and 9 of 17 Antuco benchmarks

• vs. a kdb+ 3.6 solution on a parallel file system with 15 database servers accessing all-flash storage appliances (KDB200915), was faster in 20 of 24 Kanaga benchmarks and 4 of 17 Antuco benchmarks

• vs. a kdb+ 3.6 solution involving 9 database servers accessing networked flash storage (KDB200914), was faster in 15 of 17 Antuco benchmarks.

“Financial firms designed the STAC-M3 benchmark suite to represent a common set of performance-related challenges in financial time-series analytics,” said Peter Nabicht, president, STAC. “Capital markets participants constantly find themselves having to analyze more data in less time, and competition requires them to do so in a cost-effective manner.”

“We first qualified WekaFS to run kdb+ on Amazon EC2, and we now see its potential record-breaking results,” said Glenn Wright, systems architect at KX Systems. “KX Systems’ time-series database kdb+ is used for large scale complex analytics on streaming, real time, and historical data. Kdb+ is used in capital markets for algorithmic trading, backtesting, surveillance, regulatory reporting, and research environments, as well as in other industries where it is used for high-speed sensor monitoring, fault detection, predictive analytics, and ML. Kx customers have come to expect the very best performance from file systems used to store kdb+ historical analytics data. Kx is pleased to recognize the excellent performance of the Weka file system supporting kdb+ as represented in this recent STAC-M3 benchmark.”

“In the financial services industry, fintech can be a critical differentiator, enabling companies to outperform their competitors and attract new investments,” said Eric Burgener, research VP, infrastructure systems, platforms and technologies group, IDC. “The ability of extremely high-performance parallel file systems like WekaFS can provide a solid foundation for differentiation in this industry, and WekaIO’s latest benchmark results using STAC-M3 show that the vendor can deliver record-breaking performance not only on in-house infrastructure but also in the public cloud using Amazon EC2 NVMe instances.“

“Capital markets around the world need to analyze more data in less time at the best economics,” said Shailesh Manjrekar, head of AI and strategic alliances, WekaIO. “Public cloud environments were not considered suitable for these workloads due to stringent latency and performance requirements. For the very first time Weka, along with its partner KX systems, demonstrated breakthrough results for STAC-M3 benchmarks, in AWS, thus enabling tick analytics in the cloud and for organizations with a Cloud-First strategy. WekaIO now enables Quants to derive the fastest time to insights and time to market, on-premises or in AWS.“

Resource:
Full STAC report (registration required)