Skip to content
This repository was archived by the owner on Jul 10, 2025. It is now read-only.

Commit 0a2db5d

Browse files
committed
Add Keras activations
1 parent 8f1af58 commit 0a2db5d

File tree

1 file changed

+4
-3
lines changed

1 file changed

+4
-3
lines changed

rfcs/20200525-gelu-migration.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,8 +5,8 @@
55
| **RFC #** | TBD after PR | |
66
| **Authors** | Tzu-Wei Sung (@WindQAQ) & Sean Morgan (@seanpmorgan) |
77
| **Sponsor** | TBD |
8-
| **Updated** | 2020-05-XX |
9-
| **Sponsorship Deadline** | 2020-07-XX (45 Days after submission) |
8+
| **Updated** | 2020-06-02 |
9+
| **Sponsorship Deadline** | 2020-07-17 (45 Days after submission) |
1010

1111
## Rationale for Migration
1212
* [Gaussian Error Linear Units (GELUs)](https://arxiv.org/pdf/1606.08415.pdf) cited 600+ times
@@ -58,7 +58,8 @@ upstream version.
5858

5959

6060
## Transition Plan
61-
* The activation would land in [nn_ops.py](https://github.com/tensorflow/tensorflow/blob/r2.2/tensorflow//python/ops/nn_ops.py) as well as in [keras advaced_activations](https://github.com/tensorflow/tensorflow/blob/r2.2/tensorflow/python/keras/layers/advanced_activations.py)
61+
* The activation would land in [nn_ops.py](https://github.com/tensorflow/tensorflow/blob/r2.2/tensorflow//python/ops/nn_ops.py), [keras activations](https://github.com/tensorflow/tensorflow/blob/r2.2/tensorflow/python/keras/activations.py),
62+
and possibly in [keras advaced_activation layers](https://github.com/tensorflow/tensorflow/blob/r2.2/tensorflow/python/keras/layers/advanced_activations.py)
6263
* No planned changes to the parameter signatures at this time
6364
* Addons would deprecate our activation and make a call to the core functionality.
6465
* After merging to TF Core:

0 commit comments

Comments
 (0)