LANL and Pavilion Partner to Explore Analytics Offloads to Computer Storage Arrays

0

SAN JOSE, Calif., May 25, 2022 — Pavilion data systemsa leading provider of data analytics acceleration platforms and a pioneer of NVMe-Over-Fabrics (NVMe-oF), today announced a partnership with Los Alamos National Laboratories (LANL) to co -Develop and evaluate crawl acceleration by offloading crawl functions from server storage to the storage array, minimizing data movement by enabling data reduction near storage.

LANL moves its I/O from a file-based to a record-based or column-based, allowing analytics to be performed using tools from the Big Data/Analytics community. LANL has shown 1000X speedups on scan functions by leveraging data reduction near storage devices through their DeltaFS technology. Developing standards and commercializing storage capabilities to help take advantage of storage-near analytics is at the heart of the Pavilion/LANL partnership.

“For decades, our large-scale physics simulations have used file-based I/O because those simulations were suited for disk-based parallel file systems,” said Gary Grider, high-performance computing division manager at LANL. “File-based I/O had obscured the inherent data structure of these files. Switching to record/column-based I/O exposes the data structure, allowing for analysis. Leveraging technology from the big data/analytics community is a natural way to achieve this, and partnering with the industry to explore this at extreme scale is the basis of this partnership with Pavilion.

“We are thrilled to partner with LANL on this high-performance innovation as together we explore the use of HyperOS functionality to enable offloaded analyzes from large-scale scientific applications,” said Dario Zamarian, CEO of Pavilion. .

Pavilion HyperOS data processing algorithms coupled with the performance density of Pavilion HyperParallel Flash Array provides high-performance computing storage array capacity enabling large-scale analytical offloads.

About Los Alamos National Laboratory

Los Alamos National Laboratory, a multidisciplinary research institution engaged in strategic science on behalf of national security, is operated by Triad, a public service-focused national security science organization equally owned by its three founding members. : the Battelle Memorial Institute (Battelle), the Texas A&M University System (TAMUS), and the University of California (UC) Regents for the Department of Energy’s National Nuclear Security Administration.

Los Alamos strengthens national security by ensuring the safety and reliability of America’s nuclear stockpile, developing technologies to reduce threats from weapons of mass destruction, and addressing issues related to energy, environment, infrastructure, to global health and security issues.

About Pavilion Data Systems

Pavilion provides the data analytics acceleration platform that enables organizations to extract greater value from their data, faster, simpler and at scale. We are the perfect complement for AI/ML, HPC, analytics, edge and other data-driven workloads and the ideal data I/O platform for platforms GPU-based computing. The Pavilion HyperParallel Data Platform, powered by Pavilion HyperOS, delivers unmatched performance and density, ultra-low latency, and unlimited scalability and flexibility, giving customers unprecedented choice and control. Find out why Fortune 500 companies and federal government agencies choose Pavilion. To visit pavilion.io.


Source: Pavilion Data Systems

Share.

About Author

Comments are closed.