Commit 48a41aa
Make statistics physical size threadsafe (#451)
Summary:
Pull Request resolved: #451
There is a thread safety issue when updating the physical size statistics with parallel encodings. Previously the code holds one state per stream id, but now the accounting unit is per schema node, causing the contention.
The fix is to specifically make the physical size state atomic in the column statistics.
Reviewed By: apurva-meta
Differential Revision: D91933623
fbshipit-source-id: 3aad65f9d4bd0e0abf90d2c535398d13272ed1ae1 parent f46436b commit 48a41aa
1 file changed
+1
-1
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
84 | 84 | | |
85 | 85 | | |
86 | 86 | | |
87 | | - | |
| 87 | + | |
88 | 88 | | |
89 | 89 | | |
90 | 90 | | |
| |||
0 commit comments