Remove RefreshStaleParserResponses job, superseded by taxicab rescrape queue

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

Author: caseydm

AGENTS.md

@@ -53,7 +53,7 @@ Local (when needed): `./scripts/deploy.sh` — never run `databricks bundle depl
 
 **CRITICAL**: Always `git pull` before deploying. Shared state means deploys overwrite everyone's job definitions.
 
-**DAB-managed jobs**: authors, refresh_stale_parser_responses, sync_all_works_to_elasticsearch, sync_content_index_to_d1, taxicab, vacuum_optimize_tables, vector_embeddings, walden_end2end
+**DAB-managed jobs**: authors, sync_all_works_to_elasticsearch, sync_content_index_to_d1, taxicab, vacuum_optimize_tables, vector_embeddings, walden_end2end
 
 **Migrating existing jobs to DAB**: Do NOT use `databricks bundle deployment bind` — it causes issues. Instead: add the job YAML to `jobs/` and `databricks.yml`, deploy (which creates a new job), then delete the old standalone job from the Databricks UI.
 

databricks.yml

@@ -16,7 +16,6 @@ include:
   - jobs/authors.yaml
   - jobs/concepts_frontfill.yaml
   - jobs/institutions.yaml
-  - jobs/refresh_stale_parser_responses.yaml
   - jobs/sync_all_works_to_elasticsearch.yaml
   - jobs/sync_awards_to_elasticsearch.yaml
   - jobs/sync_concepts_to_elasticsearch.yaml