Deep Learning On Distribued Systems

Tutorials

Large Scale Distributed Systems for Training Neural Networks

• intro: By Jeff Dean & Oriol Vinyals, Google. NIPS 2015.
• slides: https://media.nips.cc/Conferences/2015/tutorialslides/Jeff-Oriol-NIPS-Tutorial-2015.pdf
• video: http://research.microsoft.com/apps/video/default.aspx?id=259564&l=i
• video: http://pan.baidu.com/s/1mgXV0hU

Papers

SparkNet: Training Deep Networks in Spark

• arXiv: http://arxiv.org/abs/1511.06051
• github: https://github.com/amplab/SparkNet
• blog: http://www.kdnuggets.com/2015/12/spark-deep-learning-training-with-sparknet.html

A Scalable Implementation of Deep Learning on Spark (Alexander Ulanov)

• page: http://www.slideshare.net/AlexanderUlanov1/a-scalable-implementation-of-deep-learning-on-spark-alexander-ulanov
• slides: http://pan.baidu.com/s/1jHiNW5C

Codes

CaffeOnSpark: Open Sourced for Distributed Deep Learning on Big Data Clusters (Yahoo)

• blog: http://yahoohadoop.tumblr.com/post/139916563586/caffeonspark-open-sourced-for-distributed-deep
• github: https://github.com/yahoo/CaffeOnSpark

Videos

A Scalable Implementation of Deep Learning on Spark

• youtube: https://www.youtube.com/watch?v=pNYBBhuK8yU
• video: http://pan.baidu.com/s/1mhzF1uK

Distributed TensorFlow on Spark: Scaling Google’s Deep Learning Library (Spark Summit)

• youtube: https://www.youtube.com/watch?v=-QtcP3yRqyM
• video: http://pan.baidu.com/s/1mgOR1GG

Deep Recurrent Neural Networks for Sequence Learning in Spark (Spark Summit)

• youtube: https://www.youtube.com/watch?v=mUuqLcl8Jog
• video: http://pan.baidu.com/s/1sklHTPr

Blogs

Hadoop, Spark, Deep Learning Mesh on Single GPU Cluster

http://www.nextplatform.com/2016/02/24/hadoop-spark-deep-learning-mesh-on-single-gpu-cluster/

The Unreasonable Effectiveness of Deep Learning on Spark

https://databricks.com/blog/2016/04/01/unreasonable-effectiveness-of-deep-learning-on-spark.html