Deep Learning Study with Gluon

Deep learning to learn while making

Schedule

Topic	Date/Time	Location	Etc
Gluon Introduction	12/22,17:00	분석실
Convolution & Transfer Learning	12/28,18:00	T-Lounge, Room G

Topic

Gluon Basic

• Gluon Introduction, 12/22
• intro mxnet NDArray, Symbol, Model
• intro Grad

Fully Connected

• Classification model with MNIST (@seujung)

Convolution

• Image classification with Convolution (@haven-jeon, cats and dogs )

• Transfer Leraning (@haven-jeon, cats and dogs classification)

• Image classification with MNIST, CIFAR10 (@soohwanjo)

• AlexNet

  • https://papers.nips.cc/paper/4824-imagenet-classification-with-deep-convolutional-neural-networks.pdf

• ResNet

  • https://arxiv.org/pdf/1512.03385.pdf

• Inception V4

  • https://arxiv.org/pdf/1602.07261.pdf

• DenseNet

  • https://arxiv.org/pdf/1608.06993.pdf

• CapsNet

  • https://arxiv.org/pdf/1710.09829.pdf

Recurrent

• Sound Data Classification with Whale Sound Data (@hongdm7)
• Stock Price Prediction with Amazon Stock Data (@hyeminchoe)

Image

Neural Style Transfer

• style transfer (@seujung)

NLP

• Sentiment Classification (@supark, 네이버 영화 평점)
• seq2seq (@haven-jeon, Addition model)
• seq2seq with Attention Mechanism (@haven-jeon, Addition model)
• Text Generation(@EVA01)

high-performance learning

Autoencoder

• simple & conv. Autoencoder compared to Keras (@ljy3795)

Recommandation

XAI

• The Bayesian Case Model: A Generative Approach for Case-Based Reasoning and Prototype Classification (@kionkim)
  • https://arxiv.org/pdf/1503.01161.pdf
• Distilling a Neural Network Into a Soft Decision Tree (@kionkim)
  • https://arxiv.org/pdf/1711.09784.pdf

GAN(Generative Adversarial Networks)

• DCGAN (@seujung)
  • https://arxiv.org/pdf/1511.06434.pdf
• DiscoGAN
  • https://arxiv.org/pdf/1703.05192.pdf
• WGAN
  • https://arxiv.org/pdf/1701.07875.pdf
• BeGAN
  • https://arxiv.org/pdf/1703.10717.pdf

VAE(Variational Auto Encoder)

• Tutorial on Variational Autoencoders (@kionkim)
  • https://arxiv.org/pdf/1606.05908.pdf

Embedding

• Word2Vec (@hjkim, imdb)
  • http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.764.2227&rep=rep1&type=pdf
• Doc2Vec (@hjkim, imdb)
  • https://arxiv.org/pdf/1405.4053v2.pdf
• Sentiment Analysis using Doc2vec (@hjkim, imdb)
  • http://linanqiu.github.io/2015/10/07/word2vec-sentiment/

Reference

• https://github.com/zackchase/gluon-slides/blob/master/sept18-gluon.pdf
• https://github.com/zackchase/mxnet-the-straight-dope
• https://github.com/SherlockLiao/mxnet-gluon-tutorial
• https://github.com/gluon-api/gluon-api
• http://blog.creation.net/mxnet-part-1-ndarrays-api#.WjyR21SFiu7