Add server example

[thealmightygrant]

What does this PR do?

This is a followup to 9848. The aim of this is to serve as a fix for several issues around concurrent, multithreaded usage of diffusers:

Fixes #3672, #5749, #9833, #7851, #4920, #2916

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?
• Was this discussed/approved via a GitHub issue. Link to GH Issue
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

@yiyixuxu, anyone else that is interested

[sayakpaul]

Can we also add some notes on the multi-threaded nature of this example and show some GPU utilization numbers with and without threading?

[thealmightygrant]

Yes. I'll add that in the next commit.

[sayakpaul]

Thanks so much for working on this example! I think it's definitely helpful.

But I would like to take opinions from @stevhliu and @yiyixuxu regarding the location of the example as well.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

[stevhliu]

Very nice example! I think this would make the most sense under Inference techniques. You can add this doc to the toctree with the title, "Create a server".

[thealmightygrant]

I gave it my best shot at getting those docs in there. I think I did it correctly, but tbh, I am having trouble getting the docs up and running on my macbook 😅

[stevhliu]

Thanks, left a few more comments. Your docs look great here :)

[Jaid844]

So just changing scheduler will do the thing, right? I am facing same issue where different clients cannot access the endpoint.
Any help would do the job :).

[stevhliu]

Thanks for adding this example use case! 🤗