Dynamic agent node addition in workflow

[SomankarB]

Like we have graph.add_node and graph.compile we should have graph.recompile which can be called after graph.add_node to add agent nodes dynamically at runtime. There should be a graph.remove_node to remove nodes. It will help manage graph size as the complexity increases. What are your thoughts?

[ariel-frischer]

I was thinking about this method of add/removing nodes as a solution for dynamic parallelism: #770
Seems like langgraph does not seem to have that ability to change the graph during runtime? (new langgraph user here)
So perhaps you could generate a new dynamic subgraph, compile it, then invoke that during runtime? Gonna try that out.

[ariel-frischer]

Update: Found this in the documentation -> exactly what I was looking for: https://langchain-ai.github.io/langgraph/concepts/low_level/#send (use Send API)

[levi-katarok]

I'm interesting in a similar problem, I'd like to have flexible (albeit simple) graph structure that could be created at run time. I.e, when user 1 sends a request to a base agent, their chat can have access to X,Y agents, vs user 2 maybe has access only X,Z agents.

[ariel-frischer]

@levi-katarok
That looks similar to the code here: https://langchain-ai.github.io/langgraph/how-tos/branching/#conditional-branching

[levi-katarok]

Thanks! Yeah that's in the right direction for now. Down the road, I'm thinking if say I had 100 agents to choose from and I pull from a db that user 1 has access to agent_id 23,23, 29, I probably don't want one file with 100 conditional edges though.

[ariel-frischer]

Gotcha, yea seems like Send API could be the way to go but I'm no Langgraph expert by any means.

[rvndbalaji]

I worked on this and actually created a basic version of it

#1898

https://gist.github.com/rvndbalaji/2f50bf3d2fc635bf2f36f71c724e3347

[shrawanibawage]

@guidorietbroek I am working for a company that has a similar requirement. They want use langgraph agents which will do tasks based on a json config file. This would require the ability to add nodes and edges dynamically up front. Can anyone help me with the same?

[guidorietbroek]

we are moving away from LangGraph due to this big limitation.

[lakshaytalkstomachines]

moving on to where?

[ziv-conntour]

we are moving away from LangGraph due to this big limitation.

Any updates on where you moved to or what other solutions you found interesting?

[guidorietbroek]

We created our own framework that sits on top of Langchain. It follows a similar concept to LangGraph but we took a different direction with the implementation. We reduced some of the complexity and focused on improving runtime assistant creation. The main difference is in how we handle configuration - rather than having one config object that flows through the entire graph, we opted for more targeted configuration approaches for specific agents. We are now able to setup our agents within an assistant from our dashboard where we can easily configure these agents within specific settings.

We found this to be more straightforward and flexible for our use cases where we built multi agent solutions as chat and workflow.