Skip to content

Conversation

@MarcelMatsal
Copy link
Contributor

@MarcelMatsal MarcelMatsal commented Oct 3, 2025

Description

This code introduces functionality for injecting spurious correlations (SSTI from our paper) into huggingface datasets. This will allow us to see how these correlations affect the pretraining of models. It will be expanded to other modalities. Currently only textual injections are possible but soon will add functionality to add injections into image data.

Added an additional dependency of "termcolor" to the dataset additional dependencies

Checklist

  • I have read the Contributing document.
  • The documentation is up-to-date with the changes I made (check build artifacts).
  • All tests passed, and additional code has been covered with new tests.
  • I have added the PR to the RELEASES.rst file.

@MarcelMatsal MarcelMatsal changed the title [WIP] Package to inject Spurious Correlation(s) in huggingface datasets Package to inject Spurious Correlation(s) in huggingface datasets Oct 4, 2025
@MarcelMatsal MarcelMatsal changed the title Package to inject Spurious Correlation(s) in huggingface datasets [Feature] Package to inject Spurious Correlation(s) in huggingface datasets Oct 4, 2025
Copy link
Collaborator

@huguesva huguesva left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks a lot @MarcelMatsal , are there some plans to include examples of pretraining or finetuning of LLMs later in the library? @RandallBalestriero don't hesitate to review as well if you have time since you know more than me

@MarcelMatsal
Copy link
Contributor Author

@huguesva Our current plan was to finetune/pretrain some VLMs like CLIP with spurious data and I could include those examples in this library. I could definitely also include some finetuning examples of pure LLMs down the line or we could fully do the pretaining step

@huguesva
Copy link
Collaborator

Thanks @MarcelMatsal ! @RandallBalestriero do you validate this PR ? thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants