Why HPC Matters

This will be like having an embedded supercomputer in your car and doing some serious HPC processing at the edge. Now imagine how much data will need to be processed in a central facility for AI training purposes when you have to correlate and cross-analyze data sets from 10 or 100 million autonomous vehicles. At the other end of the spectrum, take the SKA (Square Kilometre Array) project which will become the largest scientific instrument ever deployed with 100,000 antennas in phase 1 and possibly over 1 million in phase 2. When live, the radio telescope will generate 1 exabyte of raw data and over 1 petabyte of processed data every day. This is big data at scale and there is only one way to handle it efficiently and that is with HPC technologies.

HPC and Supercomputers have been around for decades and often perceived as being a niche IT offering reserved for large research labs or corporations due to their complexity to deploy and cost. It is fascinating to see that HPC has helped solve large problems such as understanding diseases better and finding cures for them, designing safer airplanes digitally or predicting extreme weather events more accurately. Beyond this, HPC has long been leveraged in more mundane examples to find the best curve of a crisp, to design Olympic record breaking swim suits or leak-proof diapers.

Today, HPC has really become pervasive across industries, a tool readily available to most organisations big and small and is no longer the turf of government labs, universities and large companies. But beyond the amazing processing capacity offered by HPC, I believe it offers a unique opportunity to manage efficiently the data deluge triggered by the ever more connected world we are living in. The long history and investment from the HPC industry to extract every last ounce of performance across all components of HPC architecture—be it memory, compute, storage or networking makes it uniquely positioned to facilitate and handle the required speeds and feeds of an impatient world.

No one is better positioned than an HPC expert to architect a complex solution that will seamlessly move data from the Edge to the Core, from memory to compute and then to storage, whether on premise or in the cloud and all this leveraging low latency networks and next generation wireless technologies. Most of all, nobody understands better how valuable data has become and how critical it is to be available in real time, anytime. We live in a data centric world where we need answers fast to handle the 3.5 billion Google searches per day, the 400 hours of video being added to YouTube every hour or the 31 million messages posted on Facebook every minute.

Data is the new IP and its value is derived from our ability to turn data into insight, insight into action and action into success. Finding valuable learnings from millions of sources and data types has become the new IT frontier and to predicate how data will be used to augment human capabilities and performance through machine learning and artificial intelligence.

All of this is why HPC matters.