Deep Learning and Hardware

Papers

Accelerating Deep Convolutional Neural Networks Using Specialized Hardware

• paper: http://research.microsoft.com/pubs/240715/CNN%20Whitepaper.pdf

Hardware System

Building a Deep Learning (Dream) Machine

• blog: http://graphific.github.io/posts/building-a-deep-learning-dream-machine/

A Full Hardware Guide to Deep Learning

• blog: http://timdettmers.com/2015/03/09/deep-learning-hardware-guide/

GPU

Course on CUDA Programming on NVIDIA GPUs, July 27–31, 2015

http://people.maths.ox.ac.uk/gilesm/cuda/

An Introduction to GPU Programming using Theano

• youtube: https://www.youtube.com/watch?v=eVd2TqEkVp0
• video: http://pan.baidu.com/s/1c1i6LtI#path=%252F

从深度学习选择什么样的gpu来谈谈gpu的硬件架构

• blog: http://chenrudan.github.io/blog/2015/12/20/introductionofgpuhardware.html

GPU折腾手记——2015 (by 李沐)

• blog: http://mli.github.io/gpu/2016/01/17/build-gpu-clusters/

HPC, Deep Learning and GPUs(2016 Stanford HPC Conference)

• youtube: https://www.youtube.com/watch?v=JwgoC-1V_38
• video: http://pan.baidu.com/s/1pKrSvOZ

Modern GPU 2.0: Design patterns for GPU computing

• intro: Modern GPU is code and commentary intended to promote new and productive ways of thinking about GPU computing.
• homepage: http://nvlabs.github.io/moderngpu/
• github: https://github.com/nvlabs/moderngpu

FPGA

Recurrent Neural Networks Hardware Implementation on FPGA

• arXiv: http://arxiv.org/abs/1511.05552

Is implementing deep learning on FPGAs a natural next step after the success with GPUs?

• quora: https://www.quora.com/Is-implementing-deep-learning-on-FPGAs-a-natural-next-step-after-the-success-with-GPUs

Efficient Implementation of Neural Network Systems Built on FPGAs, Programmed with OpenCL

• paper: https://www.altera.com/content/dam/altera-www/global/en_US/pdfs/literature/solution-sheets/efficient_neural_networks.pdf?utm_source=Altera&utm_medium=link&utm_campaign=OpenCL_15_1&utm_content=NA_efficient-neural-networks-solution-sheet-download-link

Deep Learning on FPGAs: Past, Present, and Future

• arxiv: http://arxiv.org/abs/1602.04283

SRAM

ShiDianNao: Shifting Vision Processing Closer to the Sensor

http://lap.epfl.ch/files/content/sites/lap/files/shared/publications/DuJun15_ShiDianNaoShiftingVisionProcessingCloserToTheSensor_ISCA15.pdf