The local directory of the container should be used as the temporary directory of fluss client when the Flink job is deployed to YARN

[yulei0824]

Search before asking

• I searched in the issues and found nothing similar.

Fluss version

0.8.0 (latest release)

Please describe the bug 🐞

I deploy a flink streaming job to YARN. This job reads some fluss tables. It's taskmanager (YARN container) use /tmp/fluss as the temporary directory. I think that the local directory of the container should typically be used as the temporary directory of fluss read client.

Solution

Use one directory in the option 'io.tmp.dirs' of flink configuration to set the option ‘client.scanner.io.tmpdir’ of fluss configuration after the taskmanager startup

Are you willing to submit a PR?

• I'm willing to submit a PR!

[yulei0824]

@wuchong Please take a look at this.

[loserwang1024]

@yulei0824 same problem as #1845