|
275 | 275 | "### Prefetching\n",
|
276 | 276 | "\n",
|
277 | 277 | "Prefetching overlaps the preprocessing and model execution of a training step.\n",
|
278 |
| - "While the model is executing training step `s`, the input pipeline is reading the data for step `s+1`.\n", |
| 278 | + "While the model is executing training `steps`, the input pipeline is reading the data for `steps+1`.\n", |
279 | 279 | "Doing so reduces the step time to the maximum (as opposed to the sum) of the training and the time it takes to extract the data.\n",
|
280 | 280 | "\n",
|
281 | 281 | "The `tf.data` API provides the `tf.data.Dataset.prefetch` transformation.\n",
|
|
713 | 713 | "Here is a summary of the best practices for designing performant TensorFlow\n",
|
714 | 714 | "input pipelines:\n",
|
715 | 715 | "\n",
|
716 |
| - "* [Use the `prefetch` transformation](#Pipelining) to overlap the work of a producer and consumer\n", |
717 |
| - "* [Parallelize the data reading transformation](#Parallelizing-data-extraction) using the `interleave` transformation\n", |
718 |
| - "* [Parallelize the `map` transformation](#Parallelizing-data-transformation) by setting the `num_parallel_calls` argument\n", |
719 |
| - "* [Use the `cache` transformation](#Caching) to cache data in memory during the first epoch\n", |
720 |
| - "* [Vectorize user-defined functions](#Map-and-batch) passed in to the `map` transformation\n", |
721 |
| - "* [Reduce memory usage](#Reducing-memory-footprint) when applying the `interleave`, `prefetch`, and `shuffle` transformations" |
| 716 | + "* [Use the `prefetch` transformation](#prefetching) to overlap the work of a producer and consumer\n", |
| 717 | + "* [Parallelize the data reading transformation](#parallelizing_data_extraction) using the `interleave` transformation\n", |
| 718 | + "* [Parallelize the `map` transformation](#parallelizing_data_transformation) by setting the `num_parallel_calls` argument\n", |
| 719 | + "* [Use the `cache` transformation](#caching) to cache data in memory during the first epoch\n", |
| 720 | + "* [Vectorize user-defined functions](#vectorizing_mapping) passed in to the `map` transformation\n", |
| 721 | + "* [Reduce memory usage](#reducing_memory_footprint) when applying the `interleave`, `prefetch`, and `shuffle` transformations" |
722 | 722 | ]
|
723 | 723 | },
|
724 | 724 | {
|
|
0 commit comments