Trends Advancing Industrial HPC

Insights Tech Trends

The global research community, be it academic or applied, has a rich heritage of driving innovation and breakthroughs enabled by HPC. From a business perspective, what are the industry trends around supercomputing and HPC in advancing innovation in key markets?

Three particularly hot topics

In the past year, three terms have been all the buzz in supercomputing: AI, machine learning, and deep learning. Supercomputing conferences feature hardware and software vendors alike offering their latest and greatest to provide solutions in these three areas. Universities, including supercomputing centers, have more academic professionals and students involved in these areas than ever. From a research perspective, including from an applied standpoint, there is significant time and resource being put into advancing capabilities in AI, machine learning, and deep learning.

Perspective on how to provide solutions

I’m a longtime corporate consultant. As such, I learned long ago that if I didn’t understand what companies needed — or thought they needed — my engagements were going to be of the one-and-done variety. I now have the best job in the world because I get to consistently work with and around people smarter than I am. Our team at the National Center for Supercomputing Applications (NCSA), the largest industry HPC outreach in the world, is comprised of mostly PhDs that are experts in HPC and a domain.

As such, we consult with and support companies all around the world with grand challenges in several domains, including data analytics (including AI, machine learning, and deep learning as well as geospatial and other analytics methodologies), bioinformatics (think genomics), modeling and simulation, visualisation (particularly applied for industry), and cyber infrastructure (compute and security.) Talk about covering some ground — we have to keep up with the latest advancements from an application and compute standpoint constantly so that we can best support our corporate partners. We always have to be consultative — hearing corporate needs and challenges and providing ideas and solutions that benefit their business operations.

Corporate perspective

The companies I talk to, which are many and around the globe, have similar needs and express those needs in similar ways. I oversimplify their statements accordingly:

  • We have a lot of data and we don’t know what we can do with it
  • We need machine learning
  • Integrating AI will make us better
  • We need to ensure that our data is secure.

Nearly all of the companies talk of wanting to be disruptive — innovative — to separate from the competition, stay a step ahead, and provide next-generation solutions to tomorrow’s challenges. They think they need deep learning but can’t tell us why. They’re pretty sure that AI could help them because they heard it somewhere but they don’t know how that gets applied to their challenges. How do we bridge those gaps and help to explain why these solutions can help and how to make that happen?

How to address

There is a lot of noise out there. How do you weed through it to get to what is beneficial to a particular business?

While we have expertise in many domains including data analytics, that domain alone includes the big three – AI, machine learning, and deep learning — and others, like geospatial. To address those why and how questions, we have to help educate on what’s possible.

While white papers and lengthy presentations can help to inform, industry is different. Time and attention is limited. Seemingly hundreds of things are being juggled simultaneously. While unfortunate, reality is that not many corporate executives or business decision-makers are taking or have the time to read white papers. There are two areas that I have found that are effective — that stick and help businesses to, in short order, realise the benefits of emerging technological solutions like AI, machine learning, and deep learning:

  1. Demonstration of real-world use – a visualisation, video, or animation, perhaps combined with audio, of an actual project or accomplishment, that can paint the picture in very short time of the benefit of a particular solution set.
  2. An ideation meeting — some call it discovery, analysis, initiation, the term is less important than the function. In these meetings, a wider range of (potentially) interested parties — corporate leaders and participants on one side and solution providers like domain experts on the other — come together to discuss current needs, future plans, and even dreams. They discuss what’s possible or what might be possible, all together, to enhance communication between themselves and internally in each group as well. Come out with an action plan, both short-term and longer, and you have success.


The three hot topics these days in HPC are AI, machine learning, and deep learning. That’s the easy part — knowing that — because everyone is talking about those areas. The trick — the challenge — is how to make it all mean something. That something involves addressing real corporate challenges with solutions in these three areas that are truly applied, pertinent to the business, and resulting in enhanced business operations.

Editor's Note: In the run-up to SC18, Verne Global is hosting an AI and HPC Field Trip to Iceland between the 23-25 October, and a further AI and HPC Field Trip (due to overwhelming demand) between the 26-28 February 2019. If you are interested in attending please contact Bob Fletcher:

Written by Brendan McGinty (Guest)

See Brendan McGinty (Guest)'s blog

Brendan McGinty is Director of Industry for the National Center for Supercomputing Applications (NCSA), University of Illinois at Urbana-Champaign.

Related blogs

G-Cloud 10 makes accessing high performance computing easier then ever...

As the Director of Research at Verne Global I spend a lot of my time working with our colleagues and partners within the UK’s publicly funded universities and research and science community. I’m privileged to get to see some of the truly innovative and inspiring research that is taking place, using high performance computing (HPC) and further encouraged with how Verne Global is helping them do this. This is why I was delighted to see Verne Global’s participation in the G-Cloud 10 (G10) framework confirmed last week and indeed strengthened for 2018/19 – enabling more public sector bodies to enjoy the benefits of our on-demand true hpcDIRECT platform.S

Read more

Next generation energy storage solutions: An emerging option for enhancing data center reliability

For years, data centers have been haunted by the threat of power outages and the associated costs of such events. This situation is getting worse, with the most recent numbers from a 2016 report by the Ponemon Institute indicating that the average costs of a data center outage rose from $505,500 in 2010 to over $740,000 in 2015, while the maximum cost increased from $1.0 million to $2.4 million. How can next generation energy storage solutions help?

Read more

Like social media, ‘social currency’ isn’t going away

The conversation about blockchain is presently dominated by cryptocurrencies, with a certain amount of attention spilling into Initial Coin Offerings (ICOs). There is no shortage of scepticism about the technology in these circumstances; cryptocurrencies look more like investment opportunities – and very risky ones at that – than actual currencies, and it’s no exaggeration to say that the majority of ICOs are scams. A recent study found that almost 80 percent are scams and just eight percent reach the trading stage.

Read more

We use cookies to ensure we give you the best experience on our website, to analyse our website traffic, and to understand where our visitors are coming from. By browsing our website, you consent to our use of cookies and other tracking technologies. Read our Privacy Policy for more information.