We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 2449f60 commit 9bcc6bcCopy full SHA for 9bcc6bc
README.md
@@ -146,6 +146,15 @@ result_metrep_df = repository.load() \
146
.getSuccessMetricsAsDataFrame()
147
```
148
149
+### Wrapping up
150
+
151
+After you've ran your jobs with PyDeequ, be sure to shut down your Spark session to prevent any hanging processes.
152
153
+```python
154
+spark.sparkContext._gateway.shutdown_callback_server()
155
+spark.stop()
156
+```
157
158
## [Contributing](https://github.com/awslabs/python-deequ/blob/master/CONTRIBUTING.md)
159
Please refer to the [contributing doc](https://github.com/awslabs/python-deequ/blob/master/CONTRIBUTING.md) for how to contribute to PyDeequ.
160
0 commit comments