Solution to Accelerate SAS Analytics Workloads From WekaIO and Destiny

WekaIO, Inc. together with Destiny Corporation, a business and technology consultancy specializing in SAS (an integrated software suite for advanced and predictive analytics, business intelligence, and data management) analytics and a SAS Institute gold partner, have published a reference design capable of delivering 5X runtime and wall clock time improvements for SAS analytics long running jobs, while also providing among the best storage economics.

Click to enlarge

The solution is available on-premises as well as on Amazon Web Services (AWS). Most of the Fortune Global 1000 companies rely on SAS analytics to power their businesses and transform data into intelligence.

Although SAS solutions are architected to take advantage of multi-core CPUs, their performance and scale are often constrained by access to volumes of data and storage I/O responsiveness. Even today’s on-premises and cloud storage solutions cannot keep up with modern CPU and server capabilities. As a result, SAS Grid and SAS Viya application servers remain vastly underutilized when operating across large data sets as they wait for data to be served from the storage system.

“Digital transformation is forcing organizations to modernize their IT operations, but inefficient application logic and performance limitations due to long-running jobs, processes, and pipelines negatively impacts the potential for business growth. Modernization is critical to overcoming challenges such as the better utilization, scalability, and stability of application servers, which fall over when trying to keep up with the storage performance and capacity demands. Our SAS analytics reference design solves these challenges and transforms data analytics for a more agile environment,” said Shailesh Manjrekar, head, AI and strategic alliances, WekaIO.

“As a trusted advisor to our clients, we always look for new methods and technologies to help our clients improve their analytics work. Destiny chose to partner with WekaIO because we like the disruptive capabilities of this technology. They elegantly solve our clients’ problems with no change needed to the SAS code,” said Dana Rafiee, MD, Destiny.

The reference design comprises SAS application servers configured either with SAS Foundation, SAS Grid, or SAS Viya software. These servers connect over IB or 100GbE to a storage system running the Weka File System (WekaFS), a fast parallel file system, delivering enhanced performance at any scale while offering enterprise readiness. The shared storage system starts at 8 storage nodes with local NVMe drives, either from OEM partners (on-premises) or Amazon Elastic Compute Cloud (Amazon EC2) instances (cloud), and can scale to hundreds of nodes, depending on the throughput requirements.

In addition, WekaFS integrates object storage for an economics on multi-petabyte data sets. The starting reference design can scale from 1 SAS client running 32 concurrent sessions to 8 clients running 256 concurrent sessions, it measures up to 106GB/s of mixed R/W bandwidth, while only taking 320 SAS cores to achieve this performance. The reference design is tuned to ensure the SAS application cores are not waiting for storage I/O and are fully utilized, without wasting any expensive compute cycles.

This reference design can be deployed either on-premises, on AWS, or as a hybrid cloud to get similar results. WekaFS matches the parallelism of the SAS Grid compute environment to enable the highest data loads and ETL (extract, transform, and load) processing while providing enterprise data management capabilities to SAS workloads.

“Using this reference design, organizations will be able to consolidate more users and workloads with the same SAS licensing in place, delivering exceptional economic value. Not only will this improve time to market and business outcomes, but it will eliminate racks of server infrastructure for a improved TCO. The reference design leverages object storage data lakes to extend the file namespace and provide the best economics leveraging flash and HDD media,” added Manjrekar.

“Data-driven applications using SAS analytics are increasing in volume and complexity. With Weka and Destiny Corporation providing a reference design, customers have access to a validated solution that enables predictive and cognitive analytics in financial services (FSI), risk management, IoT, and healthcare markets,” said Amita Potnis, research director, enterprise infrastructure practice, IDC.

The company’s solutions are available through the AWS Marketplace.

Resources:
Complimentary SAS health-check
SAS Analytics solutions brief
Blog: Why Cloud ready SAS Analytics solution from Weka and Destiny Corp?

Read also:
WekaIO Signs With Hitachi Vantara    
OEM agreement for HPC storage software WekaFS
July 27, 2020 | Press Release
WekaIO Delivers Record Results on 17 STAC-M3 Tick Analytics Benchmarks Using HPE Apollo Systems
Storage system had combined performance density of up to 113GB/s available bandwidth to client nodes, maximum observed read throughput of 54.7GB/s, and 8.8 million 4K IO/s in 10U.
June 9, 2020 | Press Release
WekaIO AI Accelerates Edge to Core to Cloud Data Pipelines
Expedites time-to-market and to-value while delivering agility and security at scale.
April 28, 2020 | Press Release