Graphistry and Pavilion Data Systems Partner
To accelerate graph analytics using RAPIDS and Nvidia GPUs
This is a Press Release edited by StorageNewsletter.com on April 13, 2021 at 2:30 pmPavilion Data Systems, Inc. announced a partnership with Graphistry, Inc. to support large-scale, multi-GPU, and NVIDIA Magnum IO GPUDirect technologies to supercharge how data analysts investigate event and entity data.
They will showcase their joint capabilities at NVIDIA GTC in session # SS33029 – Visually Investigating Patterns in Logs at Scale with Graphistry, RAPIDS, and Pavilion – using a performing, dense, scalable, and flexible storage platform.
Attendees will learn how to make big log volumes (including multi-petabytes) explorable by simple low-coding of GPU and graph interfaces. The session will walk attendees through how Graphistry has integrated friendly data UI tools like Jupyter notebooks, Streamlit dashboards, and Graphistry visual analytics with the NVIDIA RAPIDS GPU ecosystem (Dask_cuDF, GPU Direct storage, DGX A100) and with the Pavilion HyperParallel Data Platform. The combined result is attendees will learn how to adapt their existing familiar workflows to a style where they can now see and explore their entire dataset.
The presenters will also provide recommendations to optimize log collection and GPU storage optimization while guiding attendees regarding how they can run and fork the open-source reference architecture providing attendees with new insights that will be shared with the RAPIDS accelerated data science community.
There are just a few visualization tools that take full advantage of NVIDIA GPUs with Magnum IO GPUDirect to deliver real-time graph analytics across petabytes of incoming and stored data. Graphistry’s software and pipeline technology, combined with NVIDIA GPUs and Magnum IO GPUDirect along with Pavilion’s storage, enable the next gen of interactive visualization for incident response, SIEM optimization, and threat hunting across market segments, including financial services, federal agencies, and data science.
“Historically, teams have been excited to analyze logs at speed-of-thought by tryin GPU acceleration, but bigger-than-memry datasets have always been difficult to connect to,” said Leo Meyerovich, CEO and founder, Graphistry. “Now that we can connect GPUs to Pavilion’s HyperParallel Data Platform, we can automatically keep the GPUs running at high rates on large data sets without waiting on the storage tier, so analysts can focus more on investigating and less on massaging queries.“
“Just about every enterprise has a vast ocean of data at its fingertips, and most companies need a way to process those volumes of data into insights more quickly so that they take action,” said Rob Davis, VP of storage technology, NVIDIA. “Running data science workloads on analytics solutions like Graphistry with multiple NVIDIA GPUs powered by NVIDIA MagnumIO GPUDirect storage enables enterprises to effectively leverage high-performance storage and process massive amounts of data at scale.“
“The Pavilion HyperParallel Data Platform can hold over 2 petabytes of usable capacity in 4 rack units, making it an ideal fit for data-intensive applications like Graphistry,” said Costa Hasapopoulos, field CTO, Pavilion. “With Graphistry bringing automated queries across Splunk, Elasticsearch, Apache Spark, and CSVs, delivering the highest fidelity at scale requires NVIDIA GPUs and Magnum IO GPUDirect to enable analysts to visualize key relationships, patterns, and anomalies in real-time.“
About Graphistry Inc.
As a spinout of UC Berkeley’s Parallel Computing Lab, it is supercharging how organizations interact with their data. Powered by NVIDIA GPUs, Graphistry’s investigation platform creates visual fast paths through complex investigations by transforming diverse data into interactive graphs that visually answer complex questions like correlations, scope, progression, root cause, patterns, and outliers. Ideally suited for investigations in areas like cybersecurity incident response, threat hunting, retail anti-fraud, and anti-money laundering, the firm enables analysts to find hidden connections, pivot on the fly easily, and share their findings with other teams. Investors include Bloomberg Beta, Nvidia, In-Q-Tel, Greylock Partners, and angel investors, including Prof. Kurt Keutzer (UC Berkeley, ex-CTO Synopsys), Andy Chou (founder and ex-CTO Coverity), and Patrick O’Malley (CFO Seagate). The company’s HQs are in San Francisco, CA, with a satellite team in Austin, TX.