File tree Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Original file line number Diff line number Diff line change @@ -803,9 +803,11 @@ You can read more about the inference response parameters in the [parameters
803803extension] ( https://github.com/triton-inference-server/server/blob/main/docs/protocol/extension_parameters.md )
804804documentation.
805805
806- Inference response parameters is supported when using BLS as well, i.e. when
807- using BLS to call another model A, you can access the the optional parameters
808- if set by A in its response.
806+ The parameters associated with an inference response can be retrieved using the
807+ ` inference_response.parameters() ` function. This function returns a JSON string
808+ where the keys are the keys of the parameters object and the values are the
809+ values for the parameters field. Note that you need to parse this string using
810+ ` json.loads ` to convert it to a dictionary.
809811
810812## Managing Python Runtime and Libraries
811813
You can’t perform that action at this time.
0 commit comments