Skip to content

Conversation

@qqmyers
Copy link
Member

@qqmyers qqmyers commented Jul 2, 2025

What this PR does / why we need it: When users share PIDs from draft datasets/files or share a URL to a dataset/file page with issues such as a trailing '.' character, they get a 404 response but there is no easy way for admins to track these cases. This PR adds a capability to log such failure, optionally enabled by a new Feature Flag, that collects these events. The result can be used with the pidreport.py Python script at gdcc/dataverse-recipes#26 and cron to send monthly alerts to Dataverse admins/curators.

Which issue(s) this PR closes:

  • Closes #

Special notes for your reviewer:

Suggestions on how to test this: Turn the flag on, request some non-existent datasets/files by PID using the JSF interface and/or API and verify that you see a new PIDFailures_.log file recording those failures.

Does this PR introduce a user interface change? If mockups are available, please link/include them here:

Is there a release notes update needed for this change?:

Additional documentation:

@coveralls
Copy link

coveralls commented Jul 2, 2025

Coverage Status

coverage: 23.412% (-0.01%) from 23.425%
when pulling 4aa12ca on QualitativeDataRepository:PIDFailTracking
into f0abe94 on IQSS:develop.

@qqmyers qqmyers added this to the 6.8 milestone Jul 11, 2025
@cmbz cmbz added FY26 Sprint 4 FY26 Sprint 4 (2025-08-13 - 2025-08-27) and removed FY26 Sprint 4 FY26 Sprint 4 (2025-08-13 - 2025-08-27) labels Aug 16, 2025
@cmbz cmbz moved this to SPRINT READY in IQSS Dataverse Project Aug 27, 2025
@pdurbin pdurbin self-assigned this Sep 3, 2025
@pdurbin pdurbin moved this from SPRINT READY to In Review 🔎 in IQSS Dataverse Project Sep 3, 2025
Copy link
Member

@pdurbin pdurbin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, this looks ok (I didn't test it) but @qqmyers please feedback in this review.



;

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm just adding this at the end...

https://jenkins.dataverse.org/job/IQSS-Dataverse-Develop-PR/job/PR-11601/3/testReport/junit/edu.harvard.iq.dataverse.api/DataverseFeaturedItemsIT/testCreateFeaturedItemWithBadDvOdbjectIds/ is failing with a 500 error. Can you please merge the latest from develop and see if tests pass?

@pdurbin pdurbin added the Status: Merge Conflicts Merge conflicts must be resolved. label Sep 8, 2025
@qqmyers qqmyers removed their assignment Sep 8, 2025
@pdurbin pdurbin removed the Status: Merge Conflicts Merge conflicts must be resolved. label Sep 8, 2025
Copy link
Member

@pdurbin pdurbin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I haven't tested this PR myself but I'm approving it because I think it's ready for manual testing.

@ofahimIQSS please don't merge until the Jenkins issues you identified have been resolved:

This PR is failing with this one:

TASK [dataverse : download and unzip solr] *************************************
client_loop: send disconnect: Broken pipe

@github-project-automation github-project-automation bot moved this from In Review 🔎 to Ready for QA ⏩ in IQSS Dataverse Project Sep 8, 2025
@pdurbin pdurbin removed their assignment Sep 8, 2025
@ofahimIQSS ofahimIQSS self-assigned this Sep 8, 2025
@ofahimIQSS ofahimIQSS moved this from Ready for QA ⏩ to QA ✅ in IQSS Dataverse Project Sep 8, 2025
@cmbz cmbz added the FY26 Sprint 5 FY26 Sprint 5 (2025-08-27 - 2025-09-10) label Sep 10, 2025
@ofahimIQSS
Copy link
Contributor

looks good, merging

@ofahimIQSS ofahimIQSS merged commit d5f49b6 into IQSS:develop Sep 11, 2025
15 checks passed
@github-project-automation github-project-automation bot moved this from QA ✅ to Merged 🚀 in IQSS Dataverse Project Sep 11, 2025
@ofahimIQSS ofahimIQSS removed their assignment Sep 11, 2025
@cmbz cmbz added the FY26 Sprint 6 FY26 Sprint 6 (2025-09-10 - 2025-09-24) label Sep 14, 2025
@scolapasta scolapasta moved this from Merged 🚀 to Done 🧹 in IQSS Dataverse Project Sep 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

FY26 Sprint 5 FY26 Sprint 5 (2025-08-27 - 2025-09-10) FY26 Sprint 6 FY26 Sprint 6 (2025-09-10 - 2025-09-24) Size: 3 A percentage of a sprint. 2.1 hours.

Projects

Status: Done 🧹

Development

Successfully merging this pull request may close these issues.

5 participants