|
| 1 | +# Chapter Summary |
| 2 | + |
| 3 | +1. The computational graph technology is introduced to machine learning |
| 4 | + frameworks in order to achieve a trade-off between programming |
| 5 | + flexibility and computational efficiency. |
| 6 | + |
| 7 | +2. A computational graph contains tensors (as units of data) and |
| 8 | + operators (as units of operations). |
| 9 | + |
| 10 | +3. A computational graph represents the computational logic and status |
| 11 | + of a machine learning model and offers opportunities for |
| 12 | + optimizations. |
| 13 | + |
| 14 | +4. A computational graph is a directed acyclic graph. Operators in the |
| 15 | + graph are directly or indirectly dependent on or independent of each |
| 16 | + other, without circular dependencies. |
| 17 | + |
| 18 | +5. Control flows, represented by conditional control and loop control, |
| 19 | + determines how data flows in a computational graph. |
| 20 | + |
| 21 | +6. Computational graphs come in two types: static and dynamic. |
| 22 | + |
| 23 | +7. Static graphs support easy model deployment, offering high |
| 24 | + computational efficiency and low memory footprint at the expense of |
| 25 | + debugging performance. |
| 26 | + |
| 27 | +8. Dynamic graphs provide computational results on the fly, which |
| 28 | + increases programming flexibility and makes debugging easy for model |
| 29 | + optimization and iterative algorithm improvement. |
| 30 | + |
| 31 | +9. We can appropriately schedule the execution of operators based on |
| 32 | + their dependencies reflected in computational graphs. |
| 33 | + |
| 34 | +10. For operators that run independently, we can consider concurrent |
| 35 | + scheduling to achieve parallel computing. For operators with |
| 36 | + computational dependencies, schedule them to run in serial. |
| 37 | + |
| 38 | +11. Specific training tasks of a computational graph can run |
| 39 | + synchronously or asynchronously. The asynchronous mechanism |
| 40 | + effectively improves the hardware efficiency and shortens the |
| 41 | + training time. |
0 commit comments