Skip to content

Commit 836371d

Browse files
leixmFMX
authored andcommitted
[CELEBORN-1467] celeborn.worker.storage.dirs should support soft link
### What changes were proposed in this pull request? `celeborn.worker.storage.dirs` supports soft link ### Why are the changes needed? NPE will be thrown when StorageManager.createWriter if `celeborn.worker.storage.dirs` contains soft link. ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Existing uts. Closes #2576 from leixm/CELEBORN-1467. Authored-by: Xianming Lei <31424839+leixm@users.noreply.github.com> Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com> (cherry picked from commit 759638e) Signed-off-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
1 parent de4b177 commit 836371d

File tree

1 file changed

+3
-1
lines changed

1 file changed

+3
-1
lines changed

common/src/main/scala/org/apache/celeborn/common/meta/DeviceInfo.scala

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -288,7 +288,9 @@ object DeviceInfo {
288288
val deviceInfo = mountPointToDeviceInfo.get(mountPoint)
289289
val diskInfo = new DiskInfo(
290290
mountPoint,
291-
dirs.map(_._1).toList,
291+
dirs.map { workingDir =>
292+
new File(workingDir._1.getCanonicalPath)
293+
}.toList,
292294
deviceInfo,
293295
conf)
294296
val (_, maxUsableSpace, threadCount, storageType) = dirs(0)

0 commit comments

Comments
 (0)