|
100 | 100 | " disabled\n",
|
101 | 101 | " * Align random number generation, check numerical equivalence in inference\n",
|
102 | 102 | " * (Optional) Check checkpoints are loaded properly and TF1.x/TF2 models\n",
|
103 |
| - " generate identitcal output\n", |
| 103 | + " generate identical output\n", |
104 | 104 | "\n",
|
105 | 105 | " b. On single GPU/TPU device\n",
|
106 | 106 | "\n",
|
|
124 | 124 | "\n",
|
125 | 125 | " d. With multi-device strategies (check the intro for [MultiProcessRunner](https://github.com/tensorflow/tensorflow/blob/master/tensorflow/python/distribute/multi_process_runner.py#L108) at the bottom)\n",
|
126 | 126 | "\n",
|
127 |
| - "4. End-to-end covergence testing on real dataset\n", |
| 127 | + "4. End-to-end convergence testing on real dataset\n", |
128 | 128 | "\n",
|
129 | 129 | " a. Check training behaviors with TensorBoard\n",
|
130 | 130 | "\n",
|
|
586 | 586 | " # adopt different tolerance strategies before and after 10 steps\n",
|
587 | 587 | " first_n_step = 10\n",
|
588 | 588 | "\n",
|
589 |
| - " # abosolute difference is limited below 1e-5\n", |
| 589 | + " # absolute difference is limited below 1e-5\n", |
590 | 590 | " # set `equal_nan` to be False to detect potential NaN loss issues\n",
|
591 | 591 | " abosolute_tolerance = 1e-5\n",
|
592 | 592 | " np.testing.assert_allclose(\n",
|
|
622 | 622 | "\n",
|
623 | 623 | "tf.print vs print/logging.info\n",
|
624 | 624 | "\n",
|
625 |
| - "- With configurable arguments, `tf.print` can recursively display show first and last few elements of each dimension for printed tensors. Check the [API docs](https://www.tensorflow.org/api_docs/python/tf/print) for details.\n", |
| 625 | + "- With configurable arguments, `tf.print` can recursively display the first and last few elements of each dimension for printed tensors. Check the [API docs](https://www.tensorflow.org/api_docs/python/tf/print) for details.\n", |
626 | 626 | "- For eager execution, both `print` and `tf.print` print the value of the tensor. But `print` may involve device-to-host copy, which can potentially slow down your code. \n",
|
627 | 627 | "- For graph mode including usage inside `tf.function`, you need to use `tf.print` to print the actual tensor value. `tf.print` is compiled into an op in the graph, whereas `print` and `logging.info` only log at tracing time, which is often not what you want. \n",
|
628 | 628 | "- `tf.print` also supports printing composite tensors like `tf.RaggedTensor` and `tf.sparse.SparseTensor`.\n",
|
|
0 commit comments