Partial revert of LLAMA_CACHE=tmp (unless set explicitly in env)

ochafik · ochafik · commit a810c37c764f · 2025-01-29T23:16:18.000Z
diff --git a/examples/server/tests/utils.py b/examples/server/tests/utils.py
@@ -191,7 +191,7 @@ def start(self, timeout_seconds: int | None = DEFAULT_HTTP_TIMEOUT) -> None:
             creationflags=flags,
             stdout=sys.stdout,
             stderr=sys.stdout,
-            # env={**os.environ, "LLAMA_CACHE": "tmp"},
+            env={**os.environ, "LLAMA_CACHE": "tmp"} if "LLAMA_CACHE" not in os.environ else None,
         )
         server_instances.add(self)
 

Original file line number	Diff line number	Diff line change
`@@ -191,7 +191,7 @@ def start(self, timeout_seconds: int \| None = DEFAULT_HTTP_TIMEOUT) -> None:`
`191`	`191`	`creationflags=flags,`
`192`	`192`	`stdout=sys.stdout,`
`193`	`193`	`stderr=sys.stdout,`
`194`		`- # env={**os.environ, "LLAMA_CACHE": "tmp"},`
	`194`	`+ env={**os.environ, "LLAMA_CACHE": "tmp"} if "LLAMA_CACHE" not in os.environ else None,`
`195`	`195`	`)`
`196`	`196`	`server_instances.add(self)`
`197`	`197`