unexpected keyword argument 'temperature'

[truechupa]

Help me, please. Every time I try to run the first workflow, I get an error. I'm using ComfyUI's latest portable version with Python 3.12, and it's really annoying because Comfy loads without any problems in the console. But every time i try to run workflow it's happening again.

In workflow i get this warning: StructuredOutput
LlamaCppAgent.get_chat_response() got an unexpected keyword argument 'temperature'

And i have this in the console:

!!! Exception during processing !!! LlamaCppAgent.get_chat_response() got an unexpected keyword argument 'temperature'
Traceback (most recent call last):
File "E:\Neural_Networks\Stable_Diffusion\ComfyUI\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Neural_Networks\Stable_Diffusion\ComfyUI\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Neural_Networks\Stable_Diffusion\ComfyUI\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "E:\Neural_Networks\Stable_Diffusion\ComfyUI\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "E:\Neural_Networks\Stable_Diffusion\ComfyUI\ComfyUI\custom_nodes\comfyui_vlm_nodes\nodes\suggest.py", line 611, in keyword_extract
response = wrapped_model.get_chat_response(prompt, temperature=temperature, grammar=grammar)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: LlamaCppAgent.get_chat_response() got an unexpected keyword argument 'temperature'
Prompt executed in 1.70 seconds

Maybe I'm not the first to encounter such a mistake. And it would be great to get advice from people who have already gone through this path.

Thank you for your attention.

[squishybone]

I am also running into the same issue. Have you found a solution for this?

I made sure that the latest versions of llama cpp and specifically llama_cpp_agent are installed but the same error still occurs.

[Kozatiju]

Do we need to downgrade our llama_cpp_agent version ? and to which version ? I wonder what was the last fully compatible one.

EDIT : found it here ( sometimes it's good to search a tiny bit more on the "pull request" section :
#138

Proper version is : llama-cpp-agent==0.0.26

Thanks @dinerburger