Skip to content

Commit 1570d04

Browse files
willmjanhuong
andauthored
build: Set triton environment variables (#370)
Signed-off-by: Will Johnson <mwjohnson728@gmail.com> Co-authored-by: Anh Uong <anh.uong@ibm.com>
1 parent d138858 commit 1570d04

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

build/Dockerfile

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -169,6 +169,12 @@ RUN mkdir /app && \
169169
chown -R $USER:0 /app /tmp && \
170170
chmod -R g+rwX /app /tmp
171171

172+
# Set Triton environment variables for qLoRA
173+
ENV TRITON_HOME="/tmp/triton_home"
174+
ENV TRITON_DUMP_DIR="/tmp/triton_dump_dir"
175+
ENV TRITON_CACHE_DIR="/tmp/triton_cache_dir"
176+
ENV TRITON_OVERRIDE_DIR="/tmp/triton_override_dir"
177+
172178
# Need a better way to address these hacks
173179
RUN if [[ "${ENABLE_AIM}" == "true" ]] ; then \
174180
touch /.aim_profile && \

0 commit comments

Comments
 (0)