Deep Learning and GPU Acceleration in Hadoop 3.0 - Hortonworks

Recently Raj Verma (President & COO of Hortonworks) spoke to Jim McHugh from Nvidia at the DataWorks Summit keynote in San Jose (video). Jim began by talking about how parallel processing that is used in gaming is also essential to Deep Learning*. And the lifeblood of Deep Learning is data. With its insatiable desire for data, Deep Learning is best suited to customers that have lots and lots of data and, naturally, Hortonworks customers come to mind. The paradigm shift comes to how data at scale is the the new way to develop Artificial Intelligence applications – or how it is used to train new models that are the critical component of these applications.[1]

What are the applications of Machine Learning? Jim McHugh gave two examples: healthcare and autonomous cars. In healthcare we are seeing models that are better at predicting patient outcomes than health practitioners. For example, Deep Learning models can be better at recognizing images than radiologists. In autonomous cars we are seeing applications of a variety of types of models: some are responsible for perceiving (e.g. detecting signs), others for modeling the behavior of other cars on the road, and still others learn from the human drivers how to actually drive a car.[2]


The key takeaway here is that none of the rules are hard-coded, but rather they evolve through incremental experience or exposure to massive amounts of examples.

Other hot Machine Learning examples that Jim mentioned were fraud detection, customer service (by understanding customer sentiment and recommending the next best action, e.g. the right person or product), deep insights on asset and supply management, smart cities and drone delivery. And what he really stressed, was that before any model training can take place, data preparation and data organization are critical, pointing to the Hortonworks Data Flow (HDF) and Hortonworks Data Platform (HDP) that together manage the entire data lifecycle, from the edge all the way to the data center, on-prem, in the cloud, or in a hybrid architecture of the two. Only then applying Nvidia’s powerful GPUs to train Deep Learning models to drive new insights makes sense.[3][4]

Key Enablers behind Deep Learning

There are three key enablers driving Deep Learning:

  • New Graphical Processing Units (GPUs) and optimized Architectures
  • Maturing Open-Source Frameworks
  • Ability to Access and Process All Data – Data Lake 3.0

New Graphical Processing Units (GPUs) and optimized Architectures

While typical Machine Learning, such as linear regression, random forest etc., can take place using a cluster of powerful servers with multi-core CPUs, Deep Learning has much heavier processing requirements. This is where new Graphical Processing Units (GPUs) with 1000s of processing cores come into play. This is why IBM has recently released PowerAI with NVLink optimizing GPU performance for key open source deep learning frameworks. And the competition is doing the same by focusing on removing disk, memory, and CPU bottlenecks, and releasing faster-and-faster GPU cards with tens of TeraFlops per card computation capability. Ultimately, faster processing at a lower cost allows more companies to develop their own unique Deep Learning solutions.[5]

Maturing Open-Source Frameworks

The ecosystem of open-source frameworks for Deep Learning is also fast-maturing. TensorFlow (Google) has seen the highest spike in community contributions over the past year, while others have their champions and large companies behind them, such as Caffe (Yahoo!), CNTK (Microsoft), MxNet (Amazon), Torch (Facebook), Theano, Chainer and others. Keras, which is a high-level API written in python that can run on top of TensorFlow, CNTK or Theano,  was developed with a focus on enabling fast experimentation and has seen a wide adoption – “being able to go from idea to result with the least possible delay.”[6][7][8][9][10][11][12][13]

Ability to Access and Process All Data – Data Lake 3.0

Since data is the lifeblood of Deep Learning it only makes sense to train models where the data resides. With Hadoop 3.0 YARN will enable running all types of clusters and mix CPU and GPU intensive processes. For example, by integrating TensorFlow with YARN an end-user can seamlessly manage resources across multiple Deep Learning applications and other workloads, such as Spark, Hive or MapReduce. Checkout this blog for more details on Data Lake 3.0.[14]

What’s Next?

If you would like to learn more about a specific application of Deep Learning, then checkout this  blog on Self-driving Car and Data Lake 3.0. And if you would to like to learn more about Data Science in general then head to our page Data Science & Machine Learning.[15][16]

*Deep Learning is a subset of Machine Learning that uses Artificial Neural Networks (ANNs) to solve problems such as image or voice recognition, language generation and so on. It has really taken off over the last five years after several technological and algorithmic breakthroughs at Google, Stanford University et al. Deep Learning requires hundreds of thousands or millions of examples (e.g. labeled images) to train the models and often takes weeks or months of training. There are shortcuts, however, by downloading pre-trained models, and adjusting the model weights of the last few layers for a specific application and cutting down the training time to a matter of hours by using powerful GPU servers.

References

  1. ^ video (youtu.be)
  2. ^ autonomous cars (hortonworks.com)
  3. ^ Hortonworks Data Flow (HDF) (hortonworks.com)
  4. ^ Hortonworks Data Platform (HDP) (hortonworks.com)
  5. ^ PowerAI with NVLink (www.ibm.com)
  6. ^ TensorFlow (www.tensorflow.org)
  7. ^ Caffe (caffe.berkeleyvision.org)
  8. ^ CNTK (github.com)
  9. ^ MxNet (mxnet.io)
  10. ^ Torch (torch.ch)
  11. ^ Theano (deeplearning.net)
  12. ^ Chainer (chainer.org)
  13. ^ Keras (keras.io)
  14. ^ blog (hortonworks.com)
  15. ^ blog on Self-driving Car and Data Lake 3.0 (hortonworks.com)
  16. ^ Data Science & Machine Learning (hortonworks.com)

Comments

Post a Comment

Popular posts from this blog

New Article Posted: Seven Things You Should Do in Your AMS

Given how advanced and thorough the modern association management software (AMS) system has become, there are many opportunities for your organization to leverage it. Here are seven ways I believe every association should be using their AMS. Click here to read the rest of the article . Of course, if you’re already on my  announcements list , you would have received notice of this new article right in your email box. Not signed up yet?  Click here to sign up . Go to the article
Read more

10 Common Mistakes Biblical Counselors Sometimes Make, Part 8

Image
A Word from Bob: You’re reading Part 8 of a 10-part blog series on 10 Common Mistakes Biblical Counselors Sometimes Make . Mistake #1: We Elevate Data Collection Above Soul Connection . Mistake #2: We Share God’s Eternal Story Before We Listen Well and Wisely to Our Friend’s Earthly Story . Mistake #3: We Talk at Counselees Rather Than Exploring Scriptures with Counselees . Mistake #4: We Practice Half-Biblical Counseling If We Address Sin but Neglect Suffering . Mistake #5: We Fail to Follow the Trinity’s Model of Comforting Care . Mistake #6: We Tend to View People One-Dimensionally . Mistake #7: We Devalue Emotions Rather Than Seeing Emotions as God’s Idea . Mistake #8: We Minimize the Complexity of the Soul-Body Interconnection Because we are soul physicians and soul care-givers, our tendency is to focus on matters of the soul. Most biblical counselors are not trained in the medical field, so we wisely avoid offering medical guidance. Yet, that appropr
Read more