|
114 | 114 | * Added official support for Python 3.13 ([#34869](https://github.com/apache/beam/issues/34869)). |
115 | 115 | * Added an optional output_schema verification to all YAML transforms ([#35952](https://github.com/apache/beam/issues/35952)). |
116 | 116 | * Support for encryption when using GroupByKey added, along with `--gbek` pipeline option to automatically replace all GroupByKey transforms (Java/Python) ([#36214](https://github.com/apache/beam/issues/36214)). |
| 117 | +* In Python SDK, the `--element_processing_timeout_minutes` option will also interrupt the SDK process if slowness happens during DoFn initialization, for example in `DoFn.setup()` ([#36518](https://github.com/apache/beam/issues/36518)). |
117 | 118 |
|
118 | 119 | ## Breaking Changes |
119 | 120 |
|
120 | | -* X behavior was changed ([#X](https://github.com/apache/beam/issues/X)). |
121 | 121 | * (Python) `dill` is no longer a required, default dependency for Apache Beam ([#21298](https://github.com/apache/beam/issues/21298)). |
122 | 122 | - This change only affects pipelines that explicitly use the `pickle_library=dill` pipeline option. |
123 | 123 | - While `dill==0.3.1.1` is still pre-installed on the official Beam SDK base images, it is no longer a direct dependency of the apache-beam Python package. This means it can be overridden by other dependencies in your environment. |
124 | 124 | - If your pipeline uses `pickle_library=dill`, you must manually ensure `dill==0.3.1.1` is installed in both your submission and runtime environments. |
125 | 125 | - Submission environment: Install the dill extra in your local environment `pip install apache-beam[gcpdill]`. |
126 | 126 | - Runtime (worker) environment: Your action depends on how you manage your worker's environment. |
127 | | - - If using default containers or custom containers with the official Beam base image e.g. `FROM apache/beam_python3.10_sdk:2.69` |
| 127 | + - If using default containers or custom containers with the official Beam base image e.g. `FROM apache/beam_python3.10_sdk:2.69.0` |
128 | 128 | - Add `dill==0.3.1.1` to your worker's requirements file (e.g., requirements.txt) |
129 | 129 | - Pass this file to your pipeline using the --requirements_file requirements.txt pipeline option (For more details see [managing Dataflow dependencies](https://cloud.google.com/dataflow/docs/guides/manage-dependencies#py-custom-containers)). |
130 | 130 | - If custom containers with a non-Beam base image e.g. `FROM python:3.9-slim` |
|
142 | 142 | * (Java) DoFn OutputReceiver now requires implementing a builder method as part of extended metadata support for elements ([#34902](https://github.com/apache/beam/issues/34902)). |
143 | 143 | * (Java) Removed ProcessContext outputWindowedValue introduced in 2.68 that allowed setting offset and record Id. Use OutputReceiver's builder to set those field ([#36523]https://github.com/apache/beam/pull/36523). |
144 | 144 |
|
145 | | -## Deprecations |
146 | | - |
147 | | -* X behavior is deprecated and will be removed in X versions ([#X](https://github.com/apache/beam/issues/X)). |
148 | | - |
149 | 145 | ## Bugfixes |
150 | 146 |
|
151 | 147 | * Fixed X (Java/Python) ([#X](https://github.com/apache/beam/issues/X)). |
|
0 commit comments