Trends Advancing Industrial HPC

Insights Tech Trends


The global research community, be it academic or applied, has a rich heritage of driving innovation and breakthroughs enabled by HPC. From a business perspective, what are the industry trends around supercomputing and HPC in advancing innovation in key markets?

Three particularly hot topics

In the past year, three terms have been all the buzz in supercomputing: AI, machine learning, and deep learning. Supercomputing conferences feature hardware and software vendors alike offering their latest and greatest to provide solutions in these three areas. Universities, including supercomputing centers, have more academic professionals and students involved in these areas than ever. From a research perspective, including from an applied standpoint, there is significant time and resource being put into advancing capabilities in AI, machine learning, and deep learning.

Perspective on how to provide solutions

I’m a longtime corporate consultant. As such, I learned long ago that if I didn’t understand what companies needed — or thought they needed — my engagements were going to be of the one-and-done variety. I now have the best job in the world because I get to consistently work with and around people smarter than I am. Our team at the National Center for Supercomputing Applications (NCSA), the largest industry HPC outreach in the world, is comprised of mostly PhDs that are experts in HPC and a domain.

As such, we consult with and support companies all around the world with grand challenges in several domains, including data analytics (including AI, machine learning, and deep learning as well as geospatial and other analytics methodologies), bioinformatics (think genomics), modeling and simulation, visualisation (particularly applied for industry), and cyber infrastructure (compute and security.) Talk about covering some ground — we have to keep up with the latest advancements from an application and compute standpoint constantly so that we can best support our corporate partners. We always have to be consultative — hearing corporate needs and challenges and providing ideas and solutions that benefit their business operations.

Corporate perspective

The companies I talk to, which are many and around the globe, have similar needs and express those needs in similar ways. I oversimplify their statements accordingly:

  • We have a lot of data and we don’t know what we can do with it
  • We need machine learning
  • Integrating AI will make us better
  • We need to ensure that our data is secure.

Nearly all of the companies talk of wanting to be disruptive — innovative — to separate from the competition, stay a step ahead, and provide next-generation solutions to tomorrow’s challenges. They think they need deep learning but can’t tell us why. They’re pretty sure that AI could help them because they heard it somewhere but they don’t know how that gets applied to their challenges. How do we bridge those gaps and help to explain why these solutions can help and how to make that happen?

How to address

There is a lot of noise out there. How do you weed through it to get to what is beneficial to a particular business?

While we have expertise in many domains including data analytics, that domain alone includes the big three – AI, machine learning, and deep learning — and others, like geospatial. To address those why and how questions, we have to help educate on what’s possible.

While white papers and lengthy presentations can help to inform, industry is different. Time and attention is limited. Seemingly hundreds of things are being juggled simultaneously. While unfortunate, reality is that not many corporate executives or business decision-makers are taking or have the time to read white papers. There are two areas that I have found that are effective — that stick and help businesses to, in short order, realise the benefits of emerging technological solutions like AI, machine learning, and deep learning:

  1. Demonstration of real-world use – a visualisation, video, or animation, perhaps combined with audio, of an actual project or accomplishment, that can paint the picture in very short time of the benefit of a particular solution set.
  2. An ideation meeting — some call it discovery, analysis, initiation, the term is less important than the function. In these meetings, a wider range of (potentially) interested parties — corporate leaders and participants on one side and solution providers like domain experts on the other — come together to discuss current needs, future plans, and even dreams. They discuss what’s possible or what might be possible, all together, to enhance communication between themselves and internally in each group as well. Come out with an action plan, both short-term and longer, and you have success.

Summary

The three hot topics these days in HPC are AI, machine learning, and deep learning. That’s the easy part — knowing that — because everyone is talking about those areas. The trick — the challenge — is how to make it all mean something. That something involves addressing real corporate challenges with solutions in these three areas that are truly applied, pertinent to the business, and resulting in enhanced business operations.

Editor's Note: In the run-up to SC18, Verne Global is hosting an AI and HPC Field Trip to Iceland between the 23-25 October, and a further AI and HPC Field Trip (due to overwhelming demand) between the 26-28 February 2019. If you are interested in attending please contact Bob Fletcher: bob.fletcher@verneglobal.com


Written by Brendan McGinty (Guest)

See Brendan McGinty (Guest)'s blog

Brendan McGinty is Director of Industry for the National Center for Supercomputing Applications (NCSA), University of Illinois at Urbana-Champaign.

Related blogs

Explainable AI

SC18 here in Dallas is proving once again to be a fascinating melting pot of HPC insights and observations, and it's intriguing to see the continuing convergence of AI into the supercomputing ecosystem. Along these lines I started to think about the movement towards 'Explainable AI'. Being able to explain and understand how models work when making predictions about the real world is a fundamental tenet of science. Whether solving equations in a dynamic system for precise answers or using statistical analysis to examine a distribution of events, the results sought from these methods are intended to increase our clarity and knowledge of how the world works.

Read more


Next generation energy storage solutions: An emerging option for enhancing data center reliability

For years, data centers have been haunted by the threat of power outages and the associated costs of such events. This situation is getting worse, with the most recent numbers from a 2016 report by the Ponemon Institute indicating that the average costs of a data center outage rose from $505,500 in 2010 to over $740,000 in 2015, while the maximum cost increased from $1.0 million to $2.4 million. How can next generation energy storage solutions help?

Read more


What to look out for at SC18

SC: The big show with an international HPC audience celebrates its 30th year in 2018. It’s the World Cup of supercomputing and now it’s more than “just” supercomputing. Advancements in data analytics have topics like artificial intelligence (AI), including machine learning and deep learning, as stars of the show. Here's what I am looking forward to seeing in Dallas...

Read more

We use cookies to ensure we give you the best experience on our website, to analyse our website traffic, and to understand where our visitors are coming from. By browsing our website, you consent to our use of cookies and other tracking technologies. Read our Privacy Policy for more information.