Prefect with SQLMesh (TLDR set MAX_FORK_WORKERS env to 1 if you work with them)

[IqbalLx]

Just a tips for anyone who try to automate sqlmesh command with prefect, set MAX_FORK_WORKERS into 1 in your prefect deployment. It is due to sqlmesh is defaulted to use parallel loading when in linux env, and somehow that didn't works with prefect task that are executed inside a child process too. Setting the value into 1 will disable this sqlmesh behaviour

reference: https://sqlmesh.readthedocs.io/en/stable/reference/configuration/?h=max+fork+workers#parallel-loading