Skip to content

Commit 94ef24c

Browse files
Manul from Pathwayembe-pwjanchorowskiXGendredxtrous
committed
Release 0.7.3
Co-authored-by: Michał Bartoszkiewicz <embe@pathway.com> Co-authored-by: Jan Chorowski <janek@pathway.com> Co-authored-by: Xavier Gendre <xavier@pathway.com> Co-authored-by: Adrian Kosowski <adrian@pathway.com> Co-authored-by: Jakub Kowalski <kuba@pathway.com> Co-authored-by: Sergey Kulik <sergey@pathway.com> Co-authored-by: Mateusz Lewandowski <mateusz@pathway.com> Co-authored-by: Mohamed Malhou <mohamed@pathway.com> Co-authored-by: Krzysztof Nowicki <krzysiek@pathway.com> Co-authored-by: Richard Pelgrim <richard.pelgrim@pathway.com> Co-authored-by: Kamil Piechowiak <kamil@pathway.com> Co-authored-by: Paweł Podhajski <pawel.podhajski@pathway.com> Co-authored-by: Olivier Ruas <olivier@pathway.com> Co-authored-by: Przemysław Uznański <przemek@pathway.com> Co-authored-by: Sebastian Włudzik <sebastian.wludzik@pathway.com> GitOrigin-RevId: 52eb53335aafe2bc78d71c58089a9a8813ee51aa
1 parent 131b76a commit 94ef24c

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

65 files changed

+2516
-720
lines changed

CHANGELOG.md

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,24 @@ All notable changes to this project will be documented in this file.
55
This project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
66
## [Unreleased]
77

8+
## [0.7.3] - 2023-11-30
9+
10+
### Added
11+
- A method `weekday` has been added to the `dt` namespace, that can be called on column expressions containing datetime data. This method returns an integer that represents the day of the week.
12+
- **EXPERIMENTAL**: Methods `show` and `plot` on Tables, providing visualizations of data using HoloViz Panel.
13+
- Added support for `instance` parameter to `groupby`, `join`, `windowby` and temporal join methods.
14+
- `pw.PersistenceMode.UDF_CACHING` persistence mode enabling automatic caching of `AsyncTransformer` invocations.
15+
16+
### Changed
17+
- Methods `round` and `floor` on columns with datetimes now accept duration argument to be a string.
18+
- `pw.debug.compute_and_print` and `pw.debug.compute_and_print_update_stream` have a new argument `n_rows` that limits the number of rows printed.
19+
- `pw.debug.table_to_pandas` has a new argument `include_id` (by default `True`). If set to `False`, creates a new index for the Pandas DataFrame, rather than using the keys of the Pathway Table.
20+
- `windowby` function `shard` argument is now deprecated and `instance` should be used.
21+
- Special column name `_pw_shard` is now deprecated, and `_pw_instance` should be used.
22+
- `pw.ReplayMode` now can be accessed as `pw.PersistenceMode`, while the `SPEEDRUN` and `REALTIME` variants are now accessible as `SPEEDRUN_REPLAY` and `REALTIME_REPLAY`.
23+
- **EXPERIMENTAL**: `pw.io.gdrive.read` has a new argument `with_metadata` (by default `False`). If set to `True`, adds a `_metadata` column containing file metadata to the resulting table.
24+
- Methods `get_nearest_items` and `get_nearest_items_asof_now` of `KNNIndex` allow to specify `k` (number of returned elements) separately in each query.
25+
826
## [0.7.2] - 2023-11-24
927

1028
### Added

Cargo.lock

Lines changed: 52 additions & 45 deletions
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Cargo.toml

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
[package]
22
name = "pathway"
3-
version = "0.7.2"
3+
version = "0.7.3"
44
edition = "2021"
55
publish = false
66
rust-version = "1.72.0"
@@ -39,22 +39,22 @@ log = { version = "0.4.20", features = ["std"] }
3939
ndarray = { version = "0.15.6", features = ["serde"] }
4040
nix = { version = "0.27.1", features = ["fs", "user"] }
4141
num-integer = "0.1.45"
42-
numpy = "0.19.0"
42+
numpy = "0.20.0"
4343
once_cell = "1.18.0"
4444
ordered-float = { version = "4.1.1", features = ["serde"] }
4545
pipe = "0.4.0"
4646
postgres = { version = "0.19.7", features = ["with-chrono-0_4", "with-serde_json-1"] }
4747
prometheus-client = "0.22.0"
48-
pyo3 = { version = "0.19.2", features = ["abi3-py310", "multiple-pymethods"] }
49-
pyo3-asyncio = "0.19.0"
48+
pyo3 = { version = "0.20.0", features = ["abi3-py310", "multiple-pymethods"] }
49+
pyo3-asyncio = "0.20.0"
5050
pyo3-log = "0.9.0"
5151
rand = "0.8.5"
5252
rdkafka = { version = "0.36.0", features = ["ssl-vendored", "cmake-build", "zstd"] }
5353
rusqlite = { version = "0.30.0", features = ["bundled"] }
5454
rust-s3 = { version = "0.33.0", features = ["sync-native-tls-vendored", "sync-native-tls", "fail-on-err"], default-features = false }
5555
scopeguard = "1.2.0"
5656
send_wrapper = "0.6.0"
57-
serde = { version = "1.0.192", features = ["derive", "rc"] }
57+
serde = { version = "1.0.193", features = ["derive", "rc"] }
5858
serde_json = "1.0"
5959
serde_with = "3.4.0"
6060
smallvec = { version = "1.11.2", features = ["union", "const_generics"] }
@@ -86,4 +86,4 @@ inherits = "release"
8686
debug = true
8787

8888
[build-dependencies]
89-
pyo3-build-config = "0.19.2"
89+
pyo3-build-config = "0.20.0"

README.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@
3535

3636
[Pathway](https://pathway.com) is an open framework for high-throughput and low-latency real-time data processing. It is used to create Python code which seamlessly combines batch processing, streaming, and real-time API's for LLM apps. Pathway's distributed runtime (🦀-🐍) provides fresh results of your data pipelines whenever new inputs and requests are received.
3737

38-
![Screencast animation of converting batch code to streaming by changing one keyword argument in the script.](https://github.com/pathwaycom/pathway/assets/68642378/79f4250d-0641-4b97-87f8-0820d9399c6b)
38+
![Pathway is an incremental data stream processing engine](https://github.com/pathwaycom/IoT-Pathway/assets/28102878/084593de-9325-4eee-b84a-06b8666efcd1)
3939

4040
Pathway provides a high-level programming interface in Python for defining data transformations, aggregations, and other operations on data streams.
4141
With Pathway, you can effortlessly design and deploy sophisticated data workflows that efficiently handle high volumes of data in real time.
@@ -48,6 +48,8 @@ In Pathway, data is represented in the form of Tables. Live data streams are als
4848

4949
For any questions, you will find the community and team behind the project [on Discord](https://discord.com/invite/pathway).
5050

51+
![Screencast animation of converting batch code to streaming by changing one keyword argument in the script.](https://github.com/pathwaycom/pathway/assets/68642378/79f4250d-0641-4b97-87f8-0820d9399c6b)
52+
5153
## Getting started<a id="getting-started"></a>
5254

5355

@@ -236,4 +238,4 @@ If you have any questions, issues, or just want to chat about Pathway, we're her
236238
- Reach out to us via email at [contact@pathway.com](mailto:contact@pathway.com).
237239

238240
Our team is always happy to help you and ensure that you get the most out of Pathway.
239-
If you would like to better understand how best to use Pathway in your project, please don't hesitate to reach out to us.
241+
If you would like to better understand how best to use Pathway in your project, please don't hesitate to reach out to us.

pyproject.toml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,8 @@ dependencies = [
3333
"boto3 >= 1.26.76",
3434
"google-api-python-client >= 2.108.0",
3535
"typing_extensions >= 4.8.0",
36+
"panel >= 1.3.1",
37+
"jupyter_bokeh >= 3.0.7",
3638
]
3739

3840
[project.optional-dependencies]

0 commit comments

Comments
 (0)