We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
olla
sherpa
1 parent b647d9f commit 39f4e02Copy full SHA for 39f4e02
config/config.yaml
@@ -29,7 +29,7 @@ proxy:
29
# NOTE: From v0.1.0+ we'll switch to Olla as the default proxy engine
30
# Sherpa will continue to be maintained and supported for the
31
# foreseeable future
32
- engine: "sherpa" # Available: sherpa, olla
+ engine: "olla" # Available: sherpa, olla
33
# Profile controls proxy engine (http) transport buffer behaviour
34
# - "auto": Dynamically selects based on request size, type and other factors (default)
35
# - "streaming": No buffering, tokens stream immediately, low latency & low memory usage
0 commit comments