GitHub - apppps/comfyui-agent: comfyui-agent

With the AI agent included in ComfyUI, it can be a great help for those who are just starting out or are beginners.
For basic information about ComfyUI, please refer to: https://github.com/comfyanonymous/ComfyUI.
It reflects the BASE flow nodes in real time and can be directly supervised by the AI.
It is very informative and comfortable for beginners, and it can answer the explanation of various settings immediately.
The agent can judge the settings and recommend prompts, connection status, and various numbers.
It detects flows in real time, so you can immediately identify problems with complex node connections.
system default ai chatgpt-4o-mini. and you needs chatgpt api.

very easy work flow : user prompt -> send button.-> workflow.json -> session.json -> AI (inc. chat gpt system prompt) -> user.
First, input your ChatGPT API in ai_agent_api.py .
When the user prompt Send button is clicked, the user's workflow file [workflow.json] is copied to [session.json]. (This creates a workflow session file inside the ComfyUI-workflow folder.)
Next, the session.json file is included in the ChatGPT system prompt and sent.
default system prompt can be modified in the server.py file.
The user receives a response from AI.

This version is an early release and is currently connected to GPT. The reason is that, so far, GPT has shown the best understanding of ComfyUI JSON files.
Sometimes it fails to accurately interpret the JSON. This is presumed to be a limitation of the GPT-4o-mini's performance.
It will gradually be updated, and others may contribute to its development as well. comfyui-agent will continue to improve.
I tried to create a node store integrated with AI, but there were so many people requesting comfyui agent. it that I couldn't implement it. I hope someone else can make it.
Upgrading to a higher AI model can provide more accurate assistance.
Currently, responses are kept as concise as possible. If desired, the system prompt can be modified.

Thank you.

4. ScreenShot.

Name		Name	Last commit message	Last commit date
Latest commit History 3,321 Commits
.ci		.ci
.github		.github
api_server		api_server
app		app
comfy		comfy
comfy_execution		comfy_execution
comfy_extras		comfy_extras
custom_nodes		custom_nodes
input		input
models		models
notebooks		notebooks
output		output
script_examples		script_examples
tests-unit		tests-unit
tests		tests
utils		utils
web		web
.gitattributes		.gitattributes
.gitignore		.gitignore
CODEOWNERS		CODEOWNERS
CONTRIBUTING.md		CONTRIBUTING.md
LICENSE		LICENSE
README.md		README.md
ai_agent_api.py		ai_agent_api.py
comfyui_version.py		comfyui_version.py
cuda_malloc.py		cuda_malloc.py
execution.py		execution.py
extra_model_paths.yaml.example		extra_model_paths.yaml.example
fix_torch.py		fix_torch.py
folder_paths.py		folder_paths.py
latent_preview.py		latent_preview.py
main.py		main.py
new_updater.py		new_updater.py
node_helpers.py		node_helpers.py
nodes.py		nodes.py
pyproject.toml		pyproject.toml
pytest.ini		pytest.ini
requirements.txt		requirements.txt
server.py		server.py

Provide feedback