The result of its extensive web-scale NVMe Flash deployments, Excelero’s tail latency innovation allows greater speed and efficiency for AI, ML, analytics, database workloads via “fail fast” tag
SAN JOSE, Calif.–(BUSINESS WIRE)–Excelero, a disruptor in software-defined block storage, today announced that was assigned US patent #10,372,374 – its fourth US patent – governing an approach that better addresses the “tail latency” experienced by large-scale private cloud operators with demanding application workloads. Excelero’s intellectual property (IP) for tail latency reduction can enable developers building solutions for AI, ML, analytics and database applications to achieve better storage efficiency and performance from shared NVMe Flash resources across an enterprise.
Click to Tweet: @ExceleroStorage awarded patent for latency reduction technique so that large private clouds can run AI, ML, analytics, database workloads more efficiently on NVMe Flash http://bit.ly/2lNlF2T
AI, ML, analytics and database applications often experience tail latency, where the slowest overall I/O transaction determines completion time and can cause unacceptably slow response times and stall the completion of vital tasks if left unmitigated. With projections that AI applications alone will grow 20x by 2025, tail latency will become increasingly problematic and potentially drag down performance across the enterprise. Recent SNIA and the NVMe Express standards define approaches to I/O determinism that are suitable for most application workloads, including predictable latency mode, NVM sets and local modes, but today’s new scale-out architectures demand faster options.
Excelero’s patent governs a mechanism to set a timeout for an I/O operation when invoking it. It allows product engineers to determine that a specific read transaction on an NVMe drive that will have a hard time finishing quickly, and mark it to “fail fast.” Once tagged, if the drive determines that it cannot fulfill the request in the required time, the drive can notify the requestor and enable it to choose to take a different action, such as reading the data from an alternative location, or storing it elsewhere without delay.
A concept that evolved from Excelero’s extensive experience in web-scale shared NVMe deployments, Excelero’s “fail fast” tag option can help enable large private cloud operators to build scale-out networks that even out latency enterprise wide, even as highly demanding, ultra-low latency workloads proliferate.
“The industry needs a better answer to the tail latency issue, where entire workflows can get hung up by the slowest element’s completion time,” said Yaniv Romem, CTO and co-founder of Excelero. “With this and the 11 other patents we have pending, Excelero is advancing our ability to keep latency low across the board, and help customers squeeze more from their storage architectures – and budgets.”
About Excelero
Excelero delivers low-latency distributed block storage for hyperscale applications such as AI, machine learning and GPU computing, in the Cloud and on the Edge. Founded in 2014 by a team of storage veterans and inspired by the Tech Giants’ shared-nothing architectures for web-scale applications, the company has designed a software-defined block storage solution that meets the low-latency performance and scalability requirements of the largest web-scale and enterprise applications.
Excelero’s distributed NVMe technology enables customers to benefit from the performance of local flash with the convenience of centralized storage while avoiding proprietary hardware lock-in and reducing the overall storage TCO. Excelero’s storage software is deployed by major web-scale customers, for data analytics and machine learning applications and in Media & Entertainment post-production and HPC environments.
Follow us on Twitter @ExceleroStorage, on LinkedIn or visit us at www.excelero.com to learn more.
Contacts
Tom Leyden
Vice President of Corporate Marketing
Mobile US +1 818 919 8478
press@excelero.com
Federica Monsone
EMEA Media Contact (A3 Communications)
+44 (0) 1252 875 203
fred.monsone@a3communications.co.uk
Mary Kae Marinac (for A3 Communications)
US Media Contact
+ 1 978-685-3136
mk@mkmarinac.com