Skip to content

Recent Work [UPDATES]

Jump to bottom
George Mihaila edited this page Jan 28, 2019 · 10 revisions

Personal contribution (starting with most recent updates):


MXNET for Python available on Talon!:

CPU support: it will work with any new versions of python available on Talon (3.6.0, 3.6.5, 3.7.0)

GPU support:

UNDER WORK

Notebook (CPU and GPU) demo that will run on Talon: here


Keras model save and load not working [FIX]:

This will not work

model.save("my_model.h5")

You need to specify absolute path:

model.save("/home/user/my_path/my_model.h5")

To load a saved keras model:

from keras.models import load_model

load_model("/home/user/my_path/my_model.h5")

Using Keras on GPUs

When using GPUs on Talon with Keras load the modules in this exact order:

module load tensorflow/1.10.1-gpu keras/2.2.0 python/3.6.0

Talon Workshop [november 30, 2018]:

What are Neural Networks, and why everyone is talking about them?

This workshop is meant to give a general overview of why Neural Networks and Deep Learning are getting so much attention and help shed some light on how they work and what applications are possible because of them.

Presentation

Code


Auto Machine Learning on Talon:

Provide library that can automate process of finding best machine learning model for a given data:


Issue discovered & fixed on Talon:

Issue discovered & fixed in using pip install with certain versions of python on Talon.

We mostly care about the versions of python that works by default with the latest version of tensorflow for GPU and non-GPU.

  • For tensorflow/1.10.1 python/3.6.5 is loaded by default.

  • For tensorflow/1.10.1-gpu python/3.6.0 is loaded by default.

  • pip install works on both Talon Login1 and Talon Login2 only for python/3.6.0 BUT the libraries remains installed when switching to python/3.6.5. Make sure you run in user mode so the libraries get installed locally:

pip install numpy --user

pip uninstall numpy

Python support on Talon:

Checking all python libraries common to Data Science and make sure they are running correctly.


Use screen on Talon:

Created tutorial on how to use screen on Talon. Very useful when performing experiments where you need a terminal open. here


SSH configuration for Talon:

Created tutorial on how to setup shortcuts on ssh to easily login on Talon. here


GitHub for Talon:

Started GitHub repository dedicated to Talon. Here I will keep posting:

  • tutorials
  • toolkits for most popular programming languages (R, python, etc.)
  • mahcine learning tools with toy example ready to be implemented on Talon
  • shortcuts, tricks and tips that can speed up work on Talon
  • tutorials with different approach from existing ones for Talon
  • code snippets
  • available material for any future workshops
  • easy and accessible material that can be used on Talon
  • re-format current material resources for easy acces and undestanding.






Clone this wiki locally