Random data showing up in output and no image descriptions

[kyle-redyeti]

I start up the container with:

jetson-containers run $(autotag nano_llm:humble) \
  ros2 launch ros2_nanollm camera_input_example.launch.py

I believe it should be running with:
Efficient-Large-Model/Llama-3-VILA1.5-8B
I am running on an Orin-NX (jetpack 6.0)
I am running the Orin-NX in multiuser mode (command line) to conserve resources and ssh'ing in to run commands and monitor ros2 topics...

This is the kind of things I see in when I run:

[cam2image-1] [INFO] [1740783579.798777373] [cam2image]: Publishing image #7648
[cam2image-1] [INFO] [1740783579.850746604] [cam2image]: Publishing image #7649
[nano_llm_py-2] [INFO] [1740783579.885537552] [nano_llm_subscriber]: Published output: 1. What is the purpose of this chat?;
[nano_llm_py-2] 2. Can you explain how this chat works?;
[nano_llm_py-2] 3. How does the chat work?;
[nano_llm_py-2] 4. Can you explain what happens during the chat?;
[nano_llm_py-2] 5. Can you explain what happens during the chat?;
[nano_llm_py-2] 6. Can you explain what happens during the chat?;
[nano_llm_py-2] 7. Can you explain what happens during the chat?;
[nano_llm_py-2] 8. Can you explain what happens during the chat?;
[nano_llm_py-2] 9. Can you explain what happens during the chat?;
[nano_llm_py-2] 10. Can you explain what happens during the chat?;
[nano_llm_py-2] 11. Can you explain what happens during the chat?;
[nano_llm_py-2] 12. Can you explain what happens during the chat?;
[nano_llm_py-2] <|end_of_text|>
[nano_llm_py-2] [INFO] [1740783579.889965456] [nano_llm_subscriber]: Your query: ['Describe the image.']

but I never actually see any descriptions.

Am I doing something wrong?

Kyle

[kyle-redyeti]

I seem to have "fixed" some of the issues... One I did add a self.chat_history.reset() before it added the images and the prompt. But I think the main change that made it work... at least for me was change the query to ['Can you describe the attached image?'] it then responds with something like "Sure, I can describe the image. The image shows a..." It seems like making it a question seems to be the key... Hope that helps those who have a similar issue!