Skip to content

Demo minimum requirement

Yipeng Hu edited this page Aug 1, 2020 · 17 revisions

v0.5

The demos folder directly under the DeepReg root directory contains a set of demonstration using DeepReg for different clinical applications. Contributions are welcome, whilst there is a set of requirements for any contribution to be included as a DeepReg Demo.

  • Each demo must have an independent folder directly under the 'Demos';
  • Name the folder as [loader-type]_[image-modality]_[organ-disease]_[optional:brief-remark], e.g. unpaired_ultrasound_prostate or grouped_mr_brain_logitudinal;
  • For simplicity, avoid sub-folders (other than those specified below) and separate files for additional functions/classes;
  • Experiment using cross-validation or random splitting is NOT encouraged, unless the purpose of the demo is to demonstrate how to design experiments.

Open accessible data

  • Each demo must have a 'demo_data.py' script to automatically download demo data;
  • Data should be downloaded under the demo folder named dataset;
  • Data should be hosted in a reliable and efficient (this repo will not store demo data or model) online storage, Kaggle, GitHub and Zendoo are all options for non-login access (avoid google drive for known accessibility issues);
  • Relevant dataset folder structure to utilise the supported loaders can be either pre-arranged in data source or scripted in 'demo_data.py' after downloading;
  • Avoid slow and large data set download.

Training

  • Each demo must have a 'demo_train.py' script;
  • This is accompanied by a config yaml file in the same folder - please use the same folder name for the config file.

Predicting

  • Each demo must have a 'demo_predict.py' script;
  • A pre-trained model must be available for downloading, e.g. the same as data (not stored in this repo please);
  • The pre-trained model, e.g. a ckpt file, should also be downloaded under dataset folder;
  • Results: Provide at least one piece of numerical metric (Dice, distance error, etc) and one piece of visualisation to show the efficacy of the registration (optimum performance is not required here).

A 'readme.md' file

The markdown file should contain the following sections:

  • [Demo name] - Use the first-level subheading with # and all the following are using the second-level subheadings with ##;
  • [Author] Author name and email;
  • [Application] Briefly describe the clinical application and the need for registration;
  • [Instruction] A step-by-step instruction how the demo can be run - preferably using the demo folder as working directory;
  • [Data] Acknowledge data source.
  • [Tested DeepReg Version] Demos do not need to be unit-tested. Record the version # commit tag on which it is tested.

Code style

Clone this wiki locally