Skip to content

Commit a097d82

Browse files
committed
Readme new known issue
1 parent 05f5023 commit a097d82

File tree

2 files changed

+18
-7
lines changed

2 files changed

+18
-7
lines changed

Readme.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -112,6 +112,18 @@ BrokenPipeError: [Errno 32] Broken pipe
112112
This is an `multiprocessing.Queue` closing error, when some items are still in the Queue.
113113
This should not affect the app in any meaningful way.
114114

115+
#### Tensorflow not releasing GPU memory
116+
Sometimes Tensorflow session will not release all allocated GPU memory when you stop the analysis. This will result in OOM (out of memory) error.
117+
See more on that issue on [tensorflow github](https://github.com/tensorflow/tensorflow/issues/19731)
115118

119+
The error itself looks like this:
120+
```
121+
2020-02-10 13:44:49.972600: E tensorflow/stream_executor/cuda/cuda_driver.cc:806] failed to allocate 635,29M (666146048 bytes) from device: CUDA_ERROR_OUT_OF_MEMORY: out of memory
122+
```
123+
124+
The issue can be resolved by closing and opening the app. If not, manually kill all python processes
125+
```
126+
killall -9 python
127+
```
116128

117129
## License

settings.ini

Lines changed: 6 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -2,18 +2,17 @@
22
RESOLUTION = 848, 480
33
FRAMERATE = 30
44
STREAMS = color, depth, infrared
5-
OUTPUT_DIRECTORY = E:\Output
6-
MULTIPLE_DEVICES = False
7-
VIDEO_SOURCE = 2
8-
ANIMALS_NUMBER = 1
5+
OUTPUT_DIRECTORY = /home/agschwarz/Output
6+
MULTIPLE_DEVICES = True
7+
CAMERA_SOURCE = 2
98

109
[DeepLabCut]
11-
DLC_PATH = D:\DeepLabCut\DeepLabCut-master\deeplabcut
12-
MODEL = 13PointsFeb3-trainset95shuffle1
10+
DLC_PATH = /home/agschwarz/DeepLabCut/deeplabcut
11+
MODEL = openfield_testset2Nov07-trainset95shuffle1
1312

1413
[Experiment]
1514
EXP_NUMBER = 1
1615
RECORD_EXP = True
1716

1817
[Video]
19-
VIDEO_SOURCE = E:\Output\DeepLabCutVideos\ExperimentD1_G2_37-16092019-141541.avi
18+
VIDEO_SOURCE = /home/agschwarz/Output/ExperimentD1_G2_37-16092019-141541.avi

0 commit comments

Comments
 (0)