tl.layers API Refactoring and various modifications (#667)

* Decorators API Refactored

* extra_requires `all`, `all_cpu` and `all_gpu` added

* Error fix

* YAPF Formating Correction

* Test for private method decorator added

* Test Logging Verbosity Fixed to Debug when runned individually

* YAPF corrections applied

* Changelog Added

* Changelog updated

* PR number changed

* First Refactoring Pass done

* cleaning second pass

* Refactoring 3rd pass

* Refactoring 4th Pass

* Code Error fix

* YAPF Formating Fix

* Arguments now using self

* YAPF error correction

* Bug Fix in Decorator

* act name bug fix

* Error Correction

* YAPF formating fix

* Useless tf.identity removed

* Error Fix

* Changelog Updated

* Error fix in tl.activation

* Documentation error fix

* Lazy Import added

* Import Refactoring with LazyImport when necessary

* Changelog Updated

* Gitter Removed

* Fixed proposed by @zsdonghao

* Documentation updated

* Missing requirements added

* Update to TensorLayer 1.8.6rc1

* Requirements error fix

* Docker Files updated

Author: Jonathan DEKHTIAR

CHANGELOG.md

@@ -71,20 +71,21 @@ To release a new version, please update the changelog as followed:
 ### Added
 - API:
   - `tl.alphas` and `tl.alphas_like` added following the tf.ones/zeros and tf.zeros_like/ones_like (by @DEKHTIARJonathan in #580)
+  - `tl.lazy_imports.LazyImport` to import heavy libraries only when necessary (by @DEKHTIARJonathan in #667)
 - CI Tool:
   - [Stale Probot](https://github.com/probot/stale) added to clean stale issues (by @DEKHTIARJonathan in #573)
   - [Changelog Probot](https://github.com/mikz/probot-changelog) Configuration added (by @DEKHTIARJonathan in #637)
   - Travis Builds now handling a matrix of TF Version from TF==1.6.0 to TF==1.8.0 (by @DEKHTIARJonathan in #644)
   - CircleCI added to build and upload Docker Containers for each PR merged and tag release (by @DEKHTIARJonathan in #648)
 - Decorator:
   - `tl.decorators` API created including `deprecated_alias` and `private_method` (by @DEKHTIARJonathan in #660)
-- Docker:  
+- Docker:
   - Containers for each release and for each PR merged on master built (by @DEKHTIARJonathan in #648)
-  - Containers built in the following configurations (by @DEKHTIARJonathan in #648): 
+  - Containers built in the following configurations (by @DEKHTIARJonathan in #648):
     - py2 + cpu
     - py2 + gpu
     - py3 + cpu
-    - py3 + gpu 
+    - py3 + gpu
 - Documentation:
   - Release semantic version added on index page (by @DEKHTIARJonathan in #633)
   - Optimizers page added (by @DEKHTIARJonathan in #636)
@@ -121,10 +122,15 @@ To release a new version, please update the changelog as followed:
 - Ternary Convolution Layer added in unittest (by @DEKHTIARJonathan in #658)
 - Convolution Layers unittests have been cleaned & refactored (by @DEKHTIARJonathan in #658)
 - All the tests are now using a DEBUG level verbosity when run individualy (by @DEKHTIARJonathan in #660)
+- `tf.identity` as activation is **ignored**, thus reducing the size of the graph by removing useless operation (by @DEKHTIARJonathan in #667)
+- argument dictionaries are now checked and saved within the `Layer` Base Class (by @DEKHTIARJonathan in #667)
 
 ### Deprecated
+- `tl.layers.TimeDistributedLayer` argurment `args` is deprecated in favor of `layer_args` (by @DEKHTIARJonathan in #667)
 
 ### Removed
+- `assert()` calls remove and replaced by `raise AssertionError()` (by @DEKHTIARJonathan in #667)
+- `tl.identity` is removed, not used anymore and deprecated for a long time (by @DEKHTIARJonathan in #667)
 
 ### Fixed
 - Issue #498 - Deprecation Warning Fix in `tl.layers.RNNLayer` with `inspect` (by @DEKHTIARJonathan in #574)
@@ -135,10 +141,11 @@ To release a new version, please update the changelog as followed:
 - Error in `tl.layers.TernaryConv2d` fixed - self.inputs not defined (by @DEKHTIARJonathan in #658)
 - Deprecation warning fixed in `tl.layers.binary._compute_threshold()` (by @DEKHTIARJonathan in #658)
 - All references to `tf.logging` replaced by `tl.logging` (by @DEKHTIARJonathan in #661)
+- Duplicated code removed when bias was used (by @DEKHTIARJonathan in #667)
 - Tutorial:
   - `tutorial_word2vec_basic.py` saving issue #476 fixed (by @DEKHTIARJonathan in #635)
   - All tutorials tested and errors have been fixed (by @DEKHTIARJonathan in #635)
-  
+
 ### Security
 
 ### Dependencies Update
@@ -149,25 +156,26 @@ To release a new version, please update the changelog as followed:
 ### Contributors
 @lgarithm @DEKHTIARJonathan @2wins @One-sixth @zsdonghao @luomai
 
-## [1.8.6] - 2018-05-30
+## [1.8.6] - 2018-06-02
 
 ### Added
 - API:
   - `tl.alphas` and `tl.alphas_like` added following the tf.ones/zeros and tf.zeros_like/ones_like (by @DEKHTIARJonathan in #580)
+  - `tl.lazy_imports.LazyImport` to import heavy libraries only when necessary (by @DEKHTIARJonathan in #667)
 - CI Tool:
   - [Stale Probot](https://github.com/probot/stale) added to clean stale issues (by @DEKHTIARJonathan in #573)
   - [Changelog Probot](https://github.com/mikz/probot-changelog) Configuration added (by @DEKHTIARJonathan in #637)
   - Travis Builds now handling a matrix of TF Version from TF==1.6.0 to TF==1.8.0 (by @DEKHTIARJonathan in #644)
   - CircleCI added to build and upload Docker Containers for each PR merged and tag release (by @DEKHTIARJonathan in #648)
 - Decorator:
   - `tl.decorators` API created including `deprecated_alias` and `private_method` (by @DEKHTIARJonathan in #660)
-- Docker: 
+- Docker:
   - Containers for each release and for each PR merged on master built (by @DEKHTIARJonathan in #648)
-  - Containers built in the following configurations (by @DEKHTIARJonathan in #648): 
+  - Containers built in the following configurations (by @DEKHTIARJonathan in #648):
     - py2 + cpu
     - py2 + gpu
     - py3 + cpu
-    - py3 + gpu 
+    - py3 + gpu
 - Documentation:
   - Release semantic version added on index page (by @DEKHTIARJonathan in #633)
   - Optimizers page added (by @DEKHTIARJonathan in #636)
@@ -204,6 +212,15 @@ To release a new version, please update the changelog as followed:
 - Ternary Convolution Layer added in unittest (by @DEKHTIARJonathan in #658)
 - Convolution Layers unittests have been cleaned & refactored (by @DEKHTIARJonathan in #658)
 - All the tests are now using a DEBUG level verbosity when run individualy (by @DEKHTIARJonathan in #660)
+- `tf.identity` as activation is **ignored**, thus reducing the size of the graph by removing useless operation (by @DEKHTIARJonathan in #667)
+- argument dictionaries are now checked and saved within the `Layer` Base Class (by @DEKHTIARJonathan in #667)
+
+### Deprecated
+- `tl.layers.TimeDistributedLayer` argurment `args` is deprecated in favor of `layer_args` (by @DEKHTIARJonathan in #667)
+
+### Removed
+- `assert()` calls remove and replaced by `raise AssertionError()` (by @DEKHTIARJonathan in #667)
+- `tl.identity` is removed, not used anymore and deprecated for a long time (by @DEKHTIARJonathan in #667)
 
 ### Fixed
 - Issue #498 - Deprecation Warning Fix in `tl.layers.RNNLayer` with `inspect` (by @DEKHTIARJonathan in #574)
@@ -214,6 +231,7 @@ To release a new version, please update the changelog as followed:
 - Error in `tl.layers.TernaryConv2d` fixed - self.inputs not defined (by @DEKHTIARJonathan in #658)
 - Deprecation warning fixed in `tl.layers.binary._compute_threshold()` (by @DEKHTIARJonathan in #658)
 - All references to `tf.logging` replaced by `tl.logging` (by @DEKHTIARJonathan in #661)
+- Duplicated code removed when bias was used (by @DEKHTIARJonathan in #667)
 - Tutorial:
   - `tutorial_word2vec_basic.py` saving issue #476 fixed (by @DEKHTIARJonathan in #635)
   - All tutorials tested and errors have been fixed (by @DEKHTIARJonathan in #635)
@@ -265,6 +283,6 @@ To release a new version, please update the changelog as followed:
 ### Contributors
 @zsdonghao @luomai @DEKHTIARJonathan
 
-[Unreleased]: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...master
-[1.8.6]: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...1.8.5
+[Unreleased]: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc1...master
+[1.8.6]: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc1...1.8.5
 [1.8.5]: https://github.com/tensorlayer/tensorlayer/compare/1.8.4...1.8.5

README.md

@@ -6,7 +6,7 @@
 
 [![Build Status](https://img.shields.io/travis/tensorlayer/tensorlayer.svg?label=Travis&branch=master)](https://travis-ci.org/tensorlayer/tensorlayer)
 [![PyPI version](https://badge.fury.io/py/tensorlayer.svg)](https://pypi.org/project/tensorlayer/)
-[![Github commits (since latest release)](https://img.shields.io/github/commits-since/tensorlayer/tensorlayer/latest.svg)](https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...master)
+[![Github commits (since latest release)](https://img.shields.io/github/commits-since/tensorlayer/tensorlayer/latest.svg)](https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc1...master)
 [![PyPI - Python Version](https://img.shields.io/pypi/pyversions/tensorlayer.svg)](https://pypi.org/project/tensorlayer/)
 [![Supported TF Version](https://img.shields.io/badge/tensorflow-1.6.0+-blue.svg)](https://github.com/tensorflow/tensorflow/releases)
 [![Codacy Badge](https://api.codacy.com/project/badge/Grade/ca2a29ddcf7445588beff50bee5406d9)](https://app.codacy.com/app/tensorlayer/tensorlayer)
@@ -16,7 +16,6 @@
 [![Documentation Status](https://img.shields.io/readthedocs/tensorlayer/latest.svg?label=ReadTheDocs-EN)](https://tensorlayer.readthedocs.io/)
 [![Documentation Status](https://img.shields.io/readthedocs/tensorlayercn/latest.svg?label=ReadTheDocs-CN)](https://tensorlayercn.readthedocs.io/)
 [![PyUP Updates](https://pyup.io/repos/github/tensorlayer/tensorlayer/shield.svg)](https://pyup.io/repos/github/tensorlayer/tensorlayer/)
-[![Gitter](https://badges.gitter.im/Join%20Chat.svg)](https://gitter.im/tensorlayer/Lobby)
 
 <br/>
 

README.rst

@@ -13,7 +13,7 @@
     :target: https://pypi.org/project/tensorlayer/
 
 .. image:: https://img.shields.io/github/commits-since/tensorlayer/tensorlayer/latest.svg
-    :target: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc0...master
+    :target: https://github.com/tensorlayer/tensorlayer/compare/1.8.6rc1...master
 
 .. image:: https://img.shields.io/pypi/pyversions/tensorlayer.svg
     :target: https://pypi.org/project/tensorlayer/
@@ -45,9 +45,6 @@
 .. image:: https://pyup.io/repos/github/tensorlayer/tensorlayer/shield.svg
     :target: https://pyup.io/repos/github/tensorlayer/tensorlayer/
 
-.. image:: https://badges.gitter.im/Join%20Chat.svg
-    :target: https://gitter.im/tensorlayer/Lobby
-
 .. raw:: html
 
    <br/><br/>

docker/python2/cpu/Dockerfile

@@ -12,7 +12,7 @@ RUN if [ -z "$TL_VERSION" ]; then \
         && cd /tensorlayer_dist/ \
         && git clone https://github.com/tensorlayer/tensorlayer.git \
         && cd tensorlayer \
-        && pip install -e .[db,dev,doc,extra,test] \
+        && pip install -e .[all] \
         && rm -rf /var/lib/apt/lists/* ; \
     else \
         echo "Building Tag Release:" "$TL_VERSION" \

docker/python2/gpu/Dockerfile

@@ -12,7 +12,7 @@ RUN if [ -z "$TL_VERSION" ]; then \
         && cd /tensorlayer_dist/ \
         && git clone https://github.com/tensorlayer/tensorlayer.git \
         && cd tensorlayer \
-        && pip install -e .[db,dev,doc,extra,test] \
+        && pip install -e .[all] \
         && rm -rf /var/lib/apt/lists/* ; \
     else \
         echo "Building Tag Release:" "$TL_VERSION" \

docker/python3/cpu/Dockerfile

@@ -12,7 +12,7 @@ RUN if [ -z "$TL_VERSION" ]; then \
         && cd /tensorlayer_dist/ \
         && git clone https://github.com/tensorlayer/tensorlayer.git \
         && cd tensorlayer \
-        && pip install -e .[db,dev,doc,extra,test] \
+        && pip install -e .[all] \
         && rm -rf /var/lib/apt/lists/* ; \
     else \
         echo "Building Tag Release:" "$TL_VERSION" \

docker/python3/gpu/Dockerfile

@@ -12,7 +12,7 @@ RUN if [ -z "$TL_VERSION" ]; then \
         && cd /tensorlayer_dist/ \
         && git clone https://github.com/tensorlayer/tensorlayer.git \
         && cd tensorlayer \
-        && pip install -e .[db,dev,doc,extra,test] \
+        && pip install -e .[all] \
         && rm -rf /var/lib/apt/lists/* ; \
     else \
         echo "Building Tag Release:" "$TL_VERSION" \

docs/conf.py

@@ -145,7 +145,7 @@
 # The name for this set of Sphinx documents.
 # "<project> v<release> documentation" by default.
 #
-# html_title = 'TensorLayer v1.8.5'
+# html_title = 'TensorLayer'
 
 # A shorter title for the navigation bar.  Default is the same as html_title.
 #

docs/modules/activation.rst

@@ -26,18 +26,13 @@ For more complex activation, TensorFlow API will be required.
 
 .. autosummary::
 
-   identity
    ramp
    leaky_relu
    swish
    sign
    hard_tanh
    pixel_wise_softmax
 
-Identity
--------------
-.. autofunction:: identity
-
 Ramp
 ------
 .. autofunction:: ramp

example/tutorial_binarynet_cifar10_tfrecord.py

@@ -173,7 +173,7 @@ def model(x_crop, y_, reuse):
             net = tl.layers.BinaryDenseLayer(net, 384, act=tf.nn.relu, name='d1relu')
             net = tl.layers.SignLayer(net)
             net = tl.layers.BinaryDenseLayer(net, 192, act=tf.nn.relu, name='d2relu')
-            net = tl.layers.DenseLayer(net, 10, act=tf.identity, name='output')
+            net = tl.layers.DenseLayer(net, 10, act=None, name='output')
 
             y = net.outputs