-
Notifications
You must be signed in to change notification settings - Fork 4.5k
[Feature Request]: Make Reshuffle transform available to Beam YAML #38014
Copy link
Copy link
Open
Description
What would you like to happen?
Reshuffle transform [1] can be very useful when developing performant Beam pipelines. Currently, this transform is not exposed directly to Beam YAML [2] and trying to use it via a Python provider results in a translation error.
[1]
beam/sdks/python/apache_beam/transforms/util.py
Line 1561 in e08e9d5
| class Reshuffle(PTransform): |
[2] https://beam.apache.org/releases/yamldoc/current/
Issue Priority
Priority: 2 (default / most feature requests should be filed as P2)
Issue Components
- Component: Python SDK
- Component: Java SDK
- Component: Go SDK
- Component: Typescript SDK
- Component: IO connector
- Component: Beam YAML
- Component: Beam examples
- Component: Beam playground
- Component: Beam katas
- Component: Website
- Component: Infrastructure
- Component: Spark Runner
- Component: Flink Runner
- Component: Samza Runner
- Component: Twister2 Runner
- Component: Hazelcast Jet Runner
- Component: Google Cloud Dataflow Runner
Reactions are currently unavailable