Run a mix of async and non-async methods in LitAPI like FastAPI

[aniketmaurya]

🚀 Feature

LitAPI can automatically identify if the function is a coroutine and run accordingly.

class MyAPI(ls.LitAPI):
    def predict(self, x):
        return y

    async def encode_response(self, out):
        return {"output": out}

Motivation

Pitch

Alternatives

Additional context