BBP-Setup

Getting started with the work from the BBP Tutorial

Videos

The screen-capture of the workshop are available on youtube at https://www.youtube.com/playlist?list=PLTWuXgjdOrnksa9FFC9a46gVJ6r12dD5T

Docker

The docker image is in the root directory.

Slides

The slides as ipython notebooks including the relevant links

First Session (November 2016)

Second Session (8-9 May 2017)

8 May

• 9:00 – 10:45 Spark performance optimization
• 11:00 – 12:00 Updates on BBP use cases
• 13:00 – 17:30 Hackathon: Test and optimise pyqae and RIQAE in BBP Spark environment

9 May

• 9:00 – 12:00 Deep learning in Spark
• 13:00 – 17:00 Hackathon: Test and optimise pyqae and RIQAE in BBP Spark environment

Resources

Setup

• https://github.com/rokroskar/sparkhpc

Pipelines

• Spark Pipelines

Deep Learning

• Multilayer Perceptron Demo
• U-Net Color -> Depth

Distributed Deep Learning

• Introduction
• https://github.com/maxpumperla/elephas
• http://joerihermans.com/work/distributed-keras/

Practice Datasets

• https://www.kaggle.com/kmader/high-content-screening-celegans
• https://www.kaggle.com/kmader/finding-lungs-in-ct-data
• https://www.kaggle.com/4quant/soft-tissue-sarcoma