Runner support status for Beam 3 (#35908)

* Deprecate Samza runner

* Deprecate Twister2 runner
  * Remove twister2 runner test from validation task and consolidate validation task

* Note nomi runner as retired in website

Author: Abacn

CHANGES.md

@@ -92,6 +92,8 @@
 * X behavior is deprecated and will be removed in X versions ([#X](https://github.com/apache/beam/issues/X)).
 * Python SDK native SpannerIO (apache_beam/io/gcp/experimental/spannerio) is deprecated. Use cross-language wrapper
   (apache_beam/io/gcp/spanner) instead (Python) ([#35860](https://github.com/apache/beam/issues/35860)).
+* Samza runner is deprecated and scheduled for removal in Beam 3.0 ([#35448](https://github.com/apache/beam/issues/35448)).
+* Twister2 runner is deprecated and scheduled for removal in Beam 3.0 ([#35905](https://github.com/apache/beam/issues/35905))).
 
 ## Bugfixes
 

release/build.gradle.kts

@@ -41,7 +41,9 @@ task("runJavaExamplesValidationTask") {
   dependsOn(":runners:spark:3:runQuickstartJavaSpark")
   dependsOn(":runners:flink:1.19:runQuickstartJavaFlinkLocal")
   dependsOn(":runners:direct-java:runMobileGamingJavaDirect")
-  dependsOn(":runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow")
-  dependsOn(":runners:twister2:runQuickstartJavaTwister2")
+  if (project.hasProperty("ver") || !project.version.toString().endsWith("SNAPSHOT")) {
+    // only run one variant of MobileGaming on Dataflow for nightly
+    dependsOn(":runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow")
+  }
   dependsOn(":runners:google-cloud-dataflow-java:runMobileGamingJavaDataflowBom")
 }

runners/samza/src/main/java/org/apache/beam/runners/samza/SamzaRunner.java

@@ -59,10 +59,13 @@
 /**
  * A {@link PipelineRunner} that executes the operations in the {@link Pipeline} into an equivalent
  * Samza plan.
+ *
+ * @deprecated The support for Samza is scheduled for removal in Beam 3.0.
  */
 @SuppressWarnings({
   "nullness" // TODO(https://github.com/apache/beam/issues/20497)
 })
+@Deprecated
 public class SamzaRunner extends PipelineRunner<SamzaPipelineResult> {
   private static final Logger LOG = LoggerFactory.getLogger(SamzaRunner.class);
   private static final String BEAM_DOT_GRAPH = "beamDotGraph";

runners/twister2/src/main/java/org/apache/beam/runners/twister2/Twister2Runner.java

@@ -61,11 +61,14 @@
  * A {@link PipelineRunner} that executes the operations in the pipeline by first translating them
  * to a Twister2 Plan and then executing them either locally or on a Twister2 cluster, depending on
  * the configuration.
+ *
+ * @deprecated The support for twister2 is scheduled for removal in Beam 3.0.
  */
 @SuppressWarnings({
   "rawtypes", // TODO(https://github.com/apache/beam/issues/20447)
   "nullness" // TODO(https://github.com/apache/beam/issues/20497)
 })
+@Deprecated
 public class Twister2Runner extends PipelineRunner<PipelineResult> {
 
   private static final Logger LOG = Logger.getLogger(Twister2Runner.class.getName());

website/www/site/content/en/documentation/runners/nemo.md

@@ -18,6 +18,8 @@ limitations under the License.
 -->
 # Using the Apache Nemo Runner
 
+**Note** Apache Nemo has been retired from incubation ([status](https://incubator.apache.org/projects/index.html#nemo)).
+
 The Apache Nemo Runner can be used to execute Beam pipelines using [Apache Nemo](https://nemo.apache.org).
 The Nemo Runner can optimize Beam pipelines with the Nemo compiler through various optimization passes
 and execute them in a distributed fashion using the Nemo runtime. You can also deploy a self-contained application

website/www/site/content/en/documentation/runners/samza.md

@@ -19,6 +19,8 @@ limitations under the License.
 
 # Using the Apache Samza Runner
 
+**Note** Samza runner is deprecated and the support is planned to be removed in Beam 3.0 ([Issue](https://github.com/apache/beam/issues/35448)).
+
 The Apache Samza Runner can be used to execute Beam pipelines using [Apache Samza](https://samza.apache.org/). The Samza Runner executes Beam pipeline in a Samza application and can run locally. The application can further be built into a .tgz file, and deployed to a YARN cluster or Samza standalone cluster with Zookeeper.
 
 The Samza Runner and Samza are suitable for large scale, stateful streaming jobs, and provide:

website/www/site/content/en/documentation/runners/twister2.md

@@ -20,6 +20,8 @@ limitations under the License.
 
 ## Overview
 
+**Note** Twister2 runner is deprecated and the support is planned to be removed in Beam 3.0 ([Issue](https://github.com/apache/beam/issues/35905)).
+
 Twister2 Runner can be used to execute Apache Beam pipelines on top of a Twister2
 cluster. Twister2 Runner runs Beam pipelines as Twister2 jobs, which can be executed on
 a Twister2 cluster either as a local deployment or distributed deployment using, Nomad,

website/www/site/content/en/roadmap/nemo-runner.md

@@ -17,7 +17,9 @@ limitations under the License.
 
 # Apache Nemo Runner Roadmap
 
-This roadmap is in progress. In the meantime, here are available resources:
+**Note** Apache Nemo has been retired from incubation ([status](https://incubator.apache.org/projects/index.html#nemo)).
+
+For references, here are available resources:
 
  - [Runner documentation](/documentation/runners/nemo)
  - JIRA: [runner-nemo](https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-nemo) / [nemo-jira](https://issues.apache.org/jira/projects/NEMO/issues/filter=allopenissues)

website/www/site/content/en/roadmap/samza-runner.md

@@ -17,7 +17,9 @@ limitations under the License.
 
 # Samza Runner Roadmap
 
-This roadmap is in progress. In the meantime, here are available resources:
+**Note** Samza runner is deprecated and the support is planned to be removed in Beam 3.0 ([Issue](https://github.com/apache/beam/issues/35448)).
+
+For references, here are available resources:
 
  - [Runner documentation](/documentation/runners/samza)
  - Issues: [runner-samza](https://github.com/apache/beam/issues?q=is%3Aopen+is%3Aissue+label%3Arunner-samza)

website/www/site/content/en/roadmap/twister2-runner.md

@@ -17,7 +17,9 @@ limitations under the License.
 
 # Twister2 Runner Roadmap
 
-This roadmap is in progress. In the meantime, here are available resources:
+**Note** Twister2 runner is deprecated and the support is planned to be removed in Beam 3.0 ([Issue](https://github.com/apache/beam/issues/35905)).
+
+For references, here are available resources:
 
  - [Runner documentation](/documentation/runners/twister2)
  - Issues: [runner-twister2](https://github.com/apache/beam/issues?q=is%3Aopen+is%3Aissue+label%3Arunner-twister2)