LUG is the primary venue for discussion and seminars on the Lustre parallel file system. As the technology leader in HPC data mobility in the cloud, we built the entire Kmesh platform on Lustre and have a lot to share with the Lustre user community. That is why we’re excited to support LUG 2019 as a Platinum Sponsor.
Our sponsorship of LUG 2019 comes at an exciting time when cloud, HPC, and Lustre have matured to the point where users realize significant benefits from “Lustre in the cloud.”
In this post, we’ll take a look at recent exciting developments for Lustre-as-a-Service and explain why it is clearly “The Now” for many organizations and the future for a wide range of High Performance Computing needs.
Why Lustre Users are Turning to Cloud in a Big Way
According to research firm Intersect360, high-performance cloud spending by HPC customers grew by 44 percent from 2016 to 2017, to approximately $1.1 billion.[i] That is about 25 times the growth rate of the overall HPC market, historically dominated by on-premise hardware clusters, and 6 times the market for HPC servers.
So, what’s driving massive growth in cloud-based HPC? First and foremost, HPC in public cloud simply rocks. Traditional HPC hardware does not age well and is quite expensive to replace, whereas modern HPC computing hardware in public clouds is higher performing and much cheaper. Why would anyone waste CapEx on jamming the data center with expensive hardware that struggles to scale with today’s more demanding HPC workloads?
That brings up the second driver for HPC in the cloud ─ budgets. Even IT organizations that have resisted the cloud have had to face the reality of budget limitations just as their need for higher-performance computing increases. This is happening across industries.
Lustre is Not Just for NASA
For many, talk of Lustre and HPC in the cloud means supercomputing-focused organizations only. These include companies and research labs studying advanced genomics, silicon chip makers, computational medicine, etc. But as a recent article in Computer Weekly pointed out, many types of “regular organizations” are adopting Lustre.
Public Health England (PHE) has put open source storage at the center of its IT strategy, with a private cloud built on Red Hat’s object storage distribution and a DDN-supported Lustre parallel file system for analytics.
PHE was created in 2013 from more than 70 agencies to provide the NHS and other public and private organizations with scientific support in the sphere of public health. They will provide infectious disease surveillance, real-time simulations to predict disease dynamics, and predict risks posed by infectious disease threats.
Lustre in the Cloud is for Everyone
As we close in on LUG 2019 in May, Kmesh is engaged ever more deeply with the Open SFS community. Kmesh SaaS incorporates all the functionality needed to real-time manage HPC app data across cloud, hybrid cloud, and multi-cloud deployments – which is why LUG 2019 is the perfect place to engage Kmesh SaaS.
Don’t want to wait until May to start your HPC in the cloud? Contact us today at firstname.lastname@example.org