DO Jobs: Spark and Airflow docs redirect to our new docs url+naming (#22699)

* spark and airflow docs redirect to new docs url+naming

* Apply suggestions from code review

Co-authored-by: Ryan Warrier <6912096+warrierr@users.noreply.github.com>

---------

Co-authored-by: Ryan Warrier <6912096+warrierr@users.noreply.github.com>

Author: aboitreaud

airflow/README.md

@@ -1,7 +1,7 @@
 # Agent Check: Airflow
 
 <div class="alert alert-info">
-<a href="https://docs.datadoghq.com/data_jobs/">Data Jobs Monitoring</a> (in Preview for Airflow) provides out-of-the-box tracing for Airflow DAG runs, helping you quickly troubleshoot problematic tasks, correlate DAG runs to logs, and understand complex pipelines with data lineage across DAGs.<br/><br/>
+<a href="https://docs.datadoghq.com/data_observability/jobs_monitoring/">Data Observability: Jobs Monitoring</a> provides out-of-the-box tracing for Airflow DAG runs, helping you quickly troubleshoot problematic tasks, correlate DAG runs to logs, and understand complex pipelines with data lineage across DAGs.<br/><br/>
 <strong>Note</strong>: This page covers only the documentation for collecting Airflow integration metrics and logs using the Datadog Agent.
 </div>
 

spark/README.md

@@ -1,7 +1,7 @@
 # Spark Check
 
 <div class="alert alert-warning">
-<a href="https://docs.datadoghq.com/data_jobs/">Data Jobs Monitoring</a> helps you observe, troubleshoot, and cost-optimize your Spark and Databricks jobs and clusters.<br/><br/>
+<a href="https://docs.datadoghq.com/data_observability/jobs_monitoring/">Data Observability: Jobs Monitoring</a> helps you observe, troubleshoot, and cost-optimize your Spark and Databricks jobs and clusters.<br/><br/>
 This page only documents how to ingest Spark metrics and logs. 
 </div>