Set up pre-commit hooks

[afuetterer]

What does this PR do?

Fixes #2274

I used the same config like the KeyBERT repo, but updated the hooks versions. Should the extra lint ci job be removed? I did not want to remove it without asking for permission.

This now leads to a lot of "trailing whitespace" fixes. Also there are a few findings from ruff.

Do you want (me) to fix those in this PR?

• remove extra lint ci job
• rebase
• ignore html and svg files in end-of-file-fixer hook
• fix linting issues
• fix ruff issues
• add commit sha to ignore file (once PR is merged)

Before submitting

• Did you read the contributor guideline?
• Was this discussed/approved via a Github issue? Please add a link to it if that's the case.

[afuetterer]

For comparison: The lint step using the pre-commit hooks (without installing BERTopic itself) took 22 seconds, whereas the lint job (with installing BERTopic and dev dependencies) took 3m 11s.

[MaartenGr]

I used the same config like the KeyBERT repo, but updated the hooks versions. Should the extra lint ci job be removed? I did not want to remove it without asking for permission.

Sounds good.

This now leads to a lot of "trailing whitespace" fixes.

Ah, I was wondering why there were suddenly so many changes!

Do you want (me) to fix those in this PR?

Yeah, considering this influences the tests, let's fix them here, thanks!

[afuetterer]

A pre-commit hook wants to add a newline to the HTML files. Accept or ignore?

[MaartenGr]

A pre-commit hook wants to add a newline to the HTML files. Accept or ignore?

Let's ignore that one.

[afuetterer]

All done. Rebased to master.

[MaartenGr]

Thank you again for your work on this. It is highly appreciated!!