Issue with Langgraph deployment with redis and postgress enabled

[dheerajiiitv]

@hwchase17 It's been bugging us for days now, we deployed langgraph on our cloud run with suffiencient CPU resources in all deployed services. But somehow we are getting asyncio timeout error

Here's small trace :

DEFAULT 2025-02-12T12:17:37.620139Z [2m2025-02-12T12:17:37.619084Z[0m [[31m[1merror [0m] [1mBackground task failed [0m [[0m[1m[34mlanggraph_api.asyncio[0m][0m [36mapi_revision[0m=[35mcfcc057[0m [36mapi_variant[0m=[35mlocal[0m

ERROR 2025-02-12T12:17:37.620184Z Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/coredis/connection.py", line 584, in fetch_push_message
    await self._read_flag.wait()
  File "/usr/local/lib/python3.11/asyncio/locks.py", line 213, in wait
    await fut

DEFAULT 2025-02-12T12:17:37.620188Z asyncio.exceptions.CancelledError

DEFAULT 2025-02-12T12:17:37.620195Z The above exception was the direct cause of the following exception:

ERROR 2025-02-12T12:17:37.620211Z Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/coredis/connection.py", line 581, in fetch_push_message
    async with async_timeout.timeout(
  File "/usr/local/lib/python3.11/asyncio/timeouts.py", line 115, in __aexit__
    raise TimeoutError from exc_val

DEFAULT 2025-02-12T12:17:37.620214Z TimeoutError

DEFAULT 2025-02-12T12:17:37.620219Z During handling of the above exception, another exception occurred:

ERROR 2025-02-12T12:17:37.620228Z Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/langgraph_storage/ops.py", line 2029, in listen_for_cancellation
    event = await pubsub.listen()
  File "/usr/local/lib/python3.11/site-packages/coredis/commands/pubsub.py", line 322, in listen
    response = await self.parse_response(block=True)
  File "/usr/local/lib/python3.11/site-packages/coredis/commands/pubsub.py", line 242, in parse_response
    return await asyncio.wait_for(
  File "/usr/local/lib/python3.11/asyncio/tasks.py", line 452, in wait_for
    return await fut
  File "/usr/local/lib/python3.11/site-packages/coredis/commands/pubsub.py", line 216, in _execute
    return await command(*args)
  File "/usr/local/lib/python3.11/site-packages/coredis/connection.py", line 586, in fetch_push_message
    raise TimeoutError

DEFAULT 2025-02-12T12:17:37.620301Z coredis.exceptions.TimeoutError

[nfcampos]

Hi, sorry this was due to a configuration mistake in the timeout settings we use for the redis connection pool. This has been fixed in the latest version, so you can just update and this will be fixed

[amitchaudharyc]

Hey @nfcampos , I have been trying to deploy the agents and it fails everytime with below error:

08/07/2025, 13:40:56 Successfully submitted metadata to LangSmith instance
08/07/2025, 13:40:56 HTTP Request: POST https://api.smith.langchain.com/v1/metadata/submit "HTTP/1.1 204 No Content"
08/07/2025, 13:35:56 Successfully submitted metadata to LangSmith instance
08/07/2025, 13:35:56 HTTP Request: POST https://api.smith.langchain.com/v1/metadata/submit "HTTP/1.1 204 No Content"
08/07/2025, 13:30:56 Successfully submitted metadata to LangSmith instance
08/07/2025, 13:30:56 HTTP Request: POST https://api.smith.langchain.com/v1/metadata/submit "HTTP/1.1 204 No Content"
08/07/2025, 13:25:57 Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
08/07/2025, 13:25:57 Application startup complete.
08/07/2025, 13:25:57 Starting cron scheduler
08/07/2025, 13:25:57 N_JOBS_PER_WORKER is 0. Skipping queue.
08/07/2025, 13:25:57 Registering graph with id 'agent'
08/07/2025, 13:25:57 Listening to 127.0.0.1:5556
08/07/2025, 13:25:57 🛠️ [GRAPH] Tool registry: 1 tools registered (1 enabled)
08/07/2025, 13:25:57 📊 [GRAPH] Graph compiled with refactored tool architecture
08/07/2025, 13:25:57 ✅ [TOOL REGISTRY] Tool 'list-work-orders' registered successfully
08/07/2025, 13:25:57 Resolving graph agent
08/07/2025, 13:25:56 Successfully submitted metadata to LangSmith instance
08/07/2025, 13:25:56 HTTP Request: POST https://api.smith.langchain.com/v1/metadata/submit "HTTP/1.1 204 No Content"
08/07/2025, 13:25:55 Uvicorn running on http://127.0.0.1:5555 (Press CTRL+C to quit)
08/07/2025, 13:25:55 Application startup complete.
08/07/2025, 13:25:55 Waiting for application startup.
08/07/2025, 13:25:55 Started server process [1]
08/07/2025, 13:25:55 Starting thread TTL sweeper with interval 5 minutes
08/07/2025, 13:25:55 Starting store TTL sweeper with interval 5.0 minutes
08/07/2025, 13:25:55 Starting metadata loop
08/07/2025, 13:25:55 Redis ping timed out
Traceback (most recent call last):
  File "/usr/local/lib/python3.12/asyncio/tasks.py", line 520, in wait_for
    return await fut
           ^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/commands/_wrappers.py", line 206, in wrapped
    async with command_cache(callable, *args, **kwargs) as response:
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/contextlib.py", line 210, in __aenter__
    return await anext(self.gen)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/commands/_wrappers.py", line 103, in __call__
    yield await func(*args, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/commands/core.py", line 1304, in ping
    return await self.execute_command(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/client/basic.py", line 945, in execute_command
    return await self.retry_policy.call_with_retries(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/retry.py", line 55, in call_with_retries
    return await func()
           ^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/client/basic.py", line 974, in _execute_command
    request = await connection.create_request(
              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/site-packages/coredis/connection.py", line 610, in create_request
    await self.connect()
  File "/usr/local/lib/python3.12/site-packages/coredis/connection.py", line 287, in connect
    await self._connect()
  File "/usr/local/lib/python3.12/site-packages/coredis/connection.py", line 781, in _connect
    transport, _ = await connection
                   ^^^^^^^^^^^^^^^^
  File "uvloop/loop.pyx", line 2033, in create_connection
  File "uvloop/loop.pyx", line 2020, in uvloop.loop.Loop.create_connection
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/site-packages/langgraph_runtime_postgres/redis.py", line 147, in start_redis
  File "/usr/local/lib/python3.12/asyncio/tasks.py", line 519, in wait_for
    async with timeouts.timeout(timeout):
               ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__
    raise TimeoutError from exc_val
TimeoutError
08/07/2025, 13:25:50 No LANGGRAPH_STORE configuration found, using default configuration
08/07/2025, 13:25:50 Applied database migration