|
| 1 | +# Release r1.15.5-deeprec2306 |
| 2 | + |
| 3 | +## **Major Features and Improvements** |
| 4 | + |
| 5 | +### **Embedding** |
| 6 | + |
| 7 | +- Support StaticGPUHashMap to optimize EmbeddingVariable in inference. |
| 8 | +- Update logic of GroupEmbedding in feature_column API. |
| 9 | +- Refine APIs for foward-backward optimization. |
| 10 | +- Move insertions of new features into the backward process when lti-tier storage. |
| 11 | +- Move insertion of new features into the backward ops. |
| 12 | +- Modify calculation logic of embedding lookup sparse combiner. |
| 13 | +- Add memory and performance tests of EmbeddingVariable. |
| 14 | + |
| 15 | +### **Graph & Grappler Optimization** |
| 16 | + |
| 17 | +- Support IteratorGetNext for SmartStage as a starting node for searching. |
| 18 | +- Reimplement PrefetchRunner in C++. |
| 19 | + |
| 20 | +### **Runtime Optimization** |
| 21 | + |
| 22 | +- Dispatch expensive ops via multiple threads in theadpool. |
| 23 | +- Enable multi-stream in session_group by default. |
| 24 | +- Support for loading saved_model with device information when use p and multi_stream. |
| 25 | +- Make ARENA_ARRAY_SIZE to be configurable. |
| 26 | +- Optimize EV allocator performance. |
| 27 | +- Integrate HybridBackend in collective training mode. |
| 28 | + |
| 29 | +### **Ops & Hardware Acceleration** |
| 30 | + |
| 31 | +- Disable MatMul fused with LeakyRule when MKL is disabled. |
| 32 | + |
| 33 | +### **Serving** |
| 34 | + |
| 35 | +- Clear virtual_device configurations before load new checkpoint. |
| 36 | + |
| 37 | +### **Environment & Build** |
| 38 | + |
| 39 | +- Update docker images in user documents. |
| 40 | +- Update DEFAULT_CUDA_VERSION and DEFAULT_CUDNN_VERSION in configure.py. |
| 41 | +- Move thirdparties from WORKSPACE to workspace.bzl. |
| 42 | +- Update urls corresponding to colm, ragel, aliyun-oss-sdk and uuid. |
| 43 | +- Update default TF_CUDA_COMPUTE_CAPABILITIES to 7.0,7.5,8.0,8.6. |
| 44 | +- Update SparseOperationKit to v23.5.01 and docker file. |
| 45 | + |
| 46 | +### **BugFix** |
| 47 | + |
| 48 | +- Fix issue of missing params while constructing the ngScope. |
| 49 | +- Fix memory leak to avoid OOM. |
| 50 | +- Fix shape validation in API shared_embedding_columns. |
| 51 | +- Fix the device placement bug of stage_subgraph_on_cpu in distributed. |
| 52 | +- Fix hung issue when using both SOK and SmartStaged simultaneously. |
| 53 | +- Fix bug: init global_step before saving variables |
| 54 | +- Fix bug: reserve input nodes, clear saver devices on demand. |
| 55 | +- Fix memory leak when a graph node is invalid. |
| 56 | + |
| 57 | +### **ModelZoo** |
| 58 | + |
| 59 | +- Add examples and docs to demonstrate Collective Training. |
| 60 | +- Update documents and config files for modelzoo benchmark. |
| 61 | +- Update modelzoo README. |
| 62 | + |
| 63 | +### **Tool & Documents** |
| 64 | + |
| 65 | +- Update cases of configure TF_CUDA_COMPUTE_CAPABILITIES for H100. |
| 66 | +- Update COMMITTERS.md. |
| 67 | +- Update device placement documents. |
| 68 | +- Update document for SmartStage. |
| 69 | +- Update session_group documents. |
| 70 | +- Update the download link of the library that Processor depends on. |
| 71 | +- Update sok to 1.20. |
| 72 | + |
| 73 | +More details of features: [https://deeprec.readthedocs.io/zh/latest/](url) |
| 74 | + |
| 75 | +## **Release Images** |
| 76 | + |
| 77 | +### **CPU Image** |
| 78 | + |
| 79 | +`alideeprec/deeprec-release:deeprec2306-cpu-py38-ubuntu20.04` |
| 80 | + |
| 81 | +### **GPU Image** |
| 82 | + |
| 83 | +`alideeprec/deeprec-release:deeprec2306-gpu-py38-cu116-ubuntu20.04` |
| 84 | + |
1 | 85 | # Release r1.15.5-deeprec2304 |
2 | 86 |
|
3 | 87 | ## **Major Features and Improvements** |
|
0 commit comments