Timed out waiting for Azure Developer CLI

[cforce]

This issue started after upgrading from changes of roughly the last 3 months
It was already running successfully on python 3.13.4 before
Not sure if its related to #2339
Running #2339 (comment) succeeds immediate

---

DEBUG:asyncio:Using selector: EpollSelector

• Serving Quart app 'app'
• Debug mode: False
• Please use an ASGI server (e.g. Hypercorn) directly in production
• Running on http://localhost:50505 (CTRL + C to quit)
  INFO:app:Setting up Azure credential using AzureDeveloperCliCredential with tenant_id XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
  INFO:app:AZURE_USE_AUTHENTICATION is true, setting up search index client
  DEBUG:azure.identity.aio._credentials.azd_cli:Executing subprocess with the following arguments ['/home/linuxbrew/.linuxbrew/bin/azd', 'auth', 'token', '--output', 'json', '--scope', 'https://search.azure.com/.default', '--tenant-id', 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX']
  WARNING:azure.identity.aio._internal.decorators:AzureDeveloperCliCredential.get_token_info failed: Timed out waiting for Azure Developer CLI
  Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 507, in wait_for
  return await fut
  ^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/subprocess.py", line 201, in communicate
  stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/subprocess.py", line 181, in _read_stream
  output = await stream.read()
  ^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 723, in read
  block = await self.read(self._limit)
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 730, in read
  await self._wait_for_data('read')
  File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 539, in _wait_for_data
  await self._waiter
  asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 506, in wait_for
async with timeouts.timeout(timeout):
~~~~~~~~~~~~~~~~^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/timeouts.py", line 116, in aexit
raise TimeoutError from exc_val
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
token = await fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
return await self._get_token_base(*scopes, options=options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
output = await _run_command(command_args, self._process_timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI
ERROR:app:Exception
Traceback (most recent call last):
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 507, in wait_for
return await fut
^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/subprocess.py", line 201, in communicate
stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/subprocess.py", line 181, in _read_stream
output = await stream.read()
^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 723, in read
block = await self.read(self._limit)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 730, in read
await self._wait_for_data('read')
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 539, in _wait_for_data
await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 506, in wait_for
async with timeouts.timeout(timeout):
~~~~~~~~~~~~~~~~^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/timeouts.py", line 116, in aexit
raise TimeoutError from exc_val
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/app.py", line 1768, in startup
await self.ensure_async(func)()
File "/mnt/c/git/azure-search-demo/app/backend/app.py", line 560, in setup_clients
search_index = await search_index_client.get_index(AZURE_SEARCH_INDEX)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
return await func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/search/documents/indexes/aio/_search_index_client.py", line 157, in get_index
result = await self._client.indexes.get(name, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
return await func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/search/documents/indexes/_generated/aio/operations/_indexes_operations.py", line 624, in get
pipeline_response: PipelineResponse = await self._client._pipeline.run( # pylint: disable=protected-access
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
_request, stream=_stream, **kwargs
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 229, in run
return await first_node.send(pipeline_request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Previous line repeated 2 more times]
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_redirect_async.py", line 76, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_retry_async.py", line 178, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 101, in send
await await_result(self.on_request, request)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
return await result
^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 72, in on_request
await self._request_token(*self._scopes)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 218, in _request_token
self._token = await self._get_token(*scopes, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 200, in _get_token
return await await_result(
^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
return await result
^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
token = await fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
return await self._get_token_base(*scopes, options=options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
output = await _run_command(command_args, self._process_timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI
Traceback (most recent call last):
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 507, in wait_for
return await fut
^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/locks.py", line 213, in wait
await fut
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/lifespan.py", line 94, in wait_for_startup
await asyncio.wait_for(self.startup.wait(), timeout=self.config.startup_timeout)
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 506, in wait_for
async with timeouts.timeout(timeout):
~~~~~~~~~~~~~~~~^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/timeouts.py", line 116, in aexit
raise TimeoutError from exc_val
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/main.py", line 6, in
main()
~~~~^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/cli.py", line 776, in main
cli.main()
~~~~~~~~^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/click/core.py", line 1082, in main
rv = self.invoke(ctx)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/click/core.py", line 1697, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/click/core.py", line 1443, in invoke
return ctx.invoke(self.callback, **ctx.params)
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/click/core.py", line 788, in invoke
return __callback(*args, **kwargs)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/click/decorators.py", line 92, in new_func
return ctx.invoke(f, obj, *args, **kwargs)
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/click/core.py", line 788, in invoke
return __callback(*args, **kwargs)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/cli.py", line 656, in run_command
app.run(
~~~~~~~^
debug=debug,
^^^^^^^^^^^^
...<4 lines>...
use_reloader=reload,
^^^^^^^^^^^^^^^^^^^^
)
^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/app.py", line 878, in run
loop.run_until_complete(asyncio.gather(*tasks))
~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/base_events.py", line 725, in run_until_complete
return future.result()
~~~~~~~~~~~~~^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/init.py", line 44, in serve
await worker_serve(
wrap_app(app, config.wsgi_max_body_size, mode), config, shutdown_trigger=shutdown_trigger
)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/run.py", line 84, in worker_serve
await lifespan.wait_for_startup()
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/lifespan.py", line 96, in wait_for_startup
raise LifespanTimeoutError("startup") from error
hypercorn.utils.LifespanTimeoutError: Timeout whilst awaiting startup. Your application may not support the ASGI Lifespan protocol correctly, alternatively the startup_timeout configuration is incorrect.
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name='Task-3' coro=<Lifespan.handle_lifespan() done, defined at /mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/lifespan.py:42> exception=LifespanFailureError("Lifespan failure in startup. 'Timed out waiting for Azure Developer CLI'")>
Traceback (most recent call last):
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 507, in wait_for
return await fut
^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/subprocess.py", line 201, in communicate
stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/subprocess.py", line 181, in _read_stream
output = await stream.read()
^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 723, in read
block = await self.read(self._limit)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 730, in read
await self._wait_for_data('read')
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/streams.py", line 539, in _wait_for_data
await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/tasks.py", line 506, in wait_for
async with timeouts.timeout(timeout):
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.13/lib/python3.13/asyncio/timeouts.py", line 116, in aexit
raise TimeoutError from exc_val
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/asgi.py", line 365, in call
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/app.py", line 1768, in startup
await self.ensure_async(func)()
File "/mnt/c/git/azure-search-demo/app/backend/app.py", line 560, in setup_clients
search_index = await search_index_client.get_index(AZURE_SEARCH_INDEX)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
return await func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/search/documents/indexes/aio/_search_index_client.py", line 157, in get_index
result = await self._client.indexes.get(name, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
return await func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/search/documents/indexes/_generated/aio/operations/_indexes_operations.py", line 624, in get
pipeline_response: PipelineResponse = await self._client._pipeline.run( # pylint: disable=protected-access
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
_request, stream=_stream, **kwargs
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 229, in run
return await first_node.send(pipeline_request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[Previous line repeated 2 more times]
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_redirect_async.py", line 76, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_retry_async.py", line 178, in send
response = await self.next.send(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 101, in send
await await_result(self.on_request, request)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
return await result
^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 72, in on_request
await self._request_token(*self._scopes)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 218, in _request_token
self._token = await self._get_token(*scopes, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 200, in _get_token
return await await_result(
^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
return await result
^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
token = await fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
return await self._get_token_base(*scopes, options=options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
output = await _run_command(command_args, self._process_timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/lifespan.py", line 55, in handle_lifespan
await self.app(
...<5 lines>...
)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/app_wrappers.py", line 34, in call
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/app.py", line 1735, in call
await self.asgi_app(scope, receive, send)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/app.py", line 1761, in asgi_app
await asgi_handler(receive, send)
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/quart/asgi.py", line 367, in call
File "/mnt/c/git/azure-search-demo/.venv/lib/python3.13/site-packages/hypercorn/asyncio/lifespan.py", line 119, in asgi_send
raise LifespanFailureError("startup", message.get("message", ""))
hypercorn.utils.LifespanFailureError: Lifespan failure in startup. 'Timed out waiting for Azure Developer CLI'
Failed to start backend

[cforce]

related Azure/azure-dev#4410

[pamelafox]

I've asked azd team to take a look at that azure-dev issue.

[weikanglim]

Hey all! The linked azd issue was closed awhile back, I wouldn't expect it to be at play here.

From a gander at #2339, it sounds like there is a possibility that the timeout is happening somewhere in the python process, I'm not sure if it's also the caus here.

@cforce Is this happening consistently? Do the tests in #2339 (comment) pass while this is happening?

[cforce]

@weikanglim
yes, this happens consistently and before and after the test executes with no errors
It might be python/cpython#130141 but i am unable to fix or workaround

[cforce]

I have downgraded to python 3.11.3 an executed processdocs.sh with below issue
Same issue as with python 3.13 when running the server locally for development

uccessfully installed all dependencies
/mnt/c/git/azure-search-demo/app/backend
INFO:root:APP_LOG_LEVEL is set to: DEBUG
INFO:root:Current log level: 10
INFO:root:This is an info message before ALLOWED_ORIGIN check
WARNING:root:This is a warning message
INFO:root:Current log level: 10
DEBUG:asyncio:Using selector: EpollSelector
 * Serving Quart app 'app'
 * Debug mode: False
 * Please use an ASGI server (e.g. Hypercorn) directly in production
 * Running on http://localhost:50505 (CTRL + C to quit)
INFO:app:Setting up Azure credential using AzureDeveloperCliCredential with tenant_id XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
INFO:app:AZURE_USE_AUTHENTICATION is true, setting up search index client
DEBUG:azure.identity.aio._credentials.azd_cli:Executing subprocess with the following arguments ['/home/linuxbrew/.linuxbrew/bin/azd', 'auth', 'token', '--output', 'json', '--scope', 'https://search.azure.com/.default', '--tenant-id', 'XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX']
WARNING:azure.identity.aio._internal.decorators:AzureDeveloperCliCredential.get_token_info failed: Timed out waiting for Azure Developer CLI
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
    return fut.result()
           ^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 200, in communicate
    stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 180, in _read_stream
    output = await stream.read()
             ^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 704, in read
    block = await self.read(self._limit)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 711, in read
    await self._wait_for_data('read')
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 543, in _wait_for_data
    await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
    stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
    raise exceptions.TimeoutError() from exc
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
    token = await fn(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
    return await self._get_token_base(*scopes, options=options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
    output = await _run_command(command_args, self._process_timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
    raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI
ERROR:app:Exception
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
    return fut.result()
           ^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 200, in communicate
    stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 180, in _read_stream
    output = await stream.read()
             ^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 704, in read
    block = await self.read(self._limit)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 711, in read
    await self._wait_for_data('read')
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 543, in _wait_for_data
    await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
    stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
    raise exceptions.TimeoutError() from exc
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/app.py", line 1768, in startup
    await self.ensure_async(func)()
  File "/mnt/c/git/azure-search-demo/app/backend/app.py", line 560, in setup_clients
    search_index = await search_index_client.get_index(AZURE_SEARCH_INDEX)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/aio/_search_index_client.py", line 157, in get_index
    result = await self._client.indexes.get(name, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/_generated/aio/operations/_indexes_operations.py", line 624, in get
    pipeline_response: PipelineResponse = await self._client._pipeline.run(  # pylint: disable=protected-access
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 229, in run
    return await first_node.send(pipeline_request)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  [Previous line repeated 2 more times]
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_redirect_async.py", line 76, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_retry_async.py", line 178, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 101, in send
    await await_result(self.on_request, request)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 72, in on_request
    await self._request_token(*self._scopes)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 218, in _request_token
    self._token = await self._get_token(*scopes, **kwargs)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 200, in _get_token
    return await await_result(
           ^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
    token = await fn(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
    return await self._get_token_base(*scopes, options=options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
    output = await _run_command(command_args, self._process_timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
    raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
    return fut.result()
           ^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/locks.py", line 213, in wait
    await fut
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/lifespan.py", line 94, in wait_for_startup
    await asyncio.wait_for(self.startup.wait(), timeout=self.config.startup_timeout)
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
    raise exceptions.TimeoutError() from exc
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<frozen runpy>", line 198, in _run_module_as_main
  File "<frozen runpy>", line 88, in _run_code
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/__main__.py", line 6, in <module>
    main()
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/cli.py", line 776, in main
    cli.main()
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/click/core.py", line 1082, in main
    rv = self.invoke(ctx)
         ^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/click/core.py", line 1697, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
    return ctx.invoke(self.callback, **ctx.params)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/click/decorators.py", line 92, in new_func
    return ctx.invoke(f, obj, *args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/click/core.py", line 788, in invoke
    return __callback(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/cli.py", line 656, in run_command
    app.run(
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/app.py", line 878, in run
    loop.run_until_complete(asyncio.gather(*tasks))
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/__init__.py", line 44, in serve
    await worker_serve(
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/run.py", line 84, in worker_serve
    await lifespan.wait_for_startup()
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/lifespan.py", line 96, in wait_for_startup
    raise LifespanTimeoutError("startup") from error
hypercorn.utils.LifespanTimeoutError: Timeout whilst awaiting startup. Your application may not support the ASGI Lifespan protocol correctly, alternatively the startup_timeout configuration is incorrect.
ERROR:asyncio:Task exception was never retrieved
future: <Task finished name='Task-3' coro=<Lifespan.handle_lifespan() done, defined at /mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/lifespan.py:42> exception=LifespanFailureError("Lifespan failure in startup. 'Timed out waiting for Azure Developer CLI'")>
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
    return fut.result()
           ^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 200, in communicate
    stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 180, in _read_stream
    output = await stream.read()
             ^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 704, in read
    block = await self.read(self._limit)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 711, in read
    await self._wait_for_data('read')
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 543, in _wait_for_data
    await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
    stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
    raise exceptions.TimeoutError() from exc
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/asgi.py", line 365, in __call__
    await self.app.startup()
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/app.py", line 1768, in startup
    await self.ensure_async(func)()
  File "/mnt/c/git/azure-search-demo/app/backend/app.py", line 560, in setup_clients
    search_index = await search_index_client.get_index(AZURE_SEARCH_INDEX)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/aio/_search_index_client.py", line 157, in get_index
    result = await self._client.indexes.get(name, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/_generated/aio/operations/_indexes_operations.py", line 624, in get
    pipeline_response: PipelineResponse = await self._client._pipeline.run(  # pylint: disable=protected-access
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 229, in run
    return await first_node.send(pipeline_request)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  [Previous line repeated 2 more times]
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_redirect_async.py", line 76, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_retry_async.py", line 178, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 101, in send
    await await_result(self.on_request, request)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 72, in on_request
    await self._request_token(*self._scopes)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 218, in _request_token
    self._token = await self._get_token(*scopes, **kwargs)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 200, in _get_token
    return await await_result(
           ^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
    token = await fn(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
    return await self._get_token_base(*scopes, options=options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
    output = await _run_command(command_args, self._process_timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
    raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/lifespan.py", line 55, in handle_lifespan
    await self.app(
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/app_wrappers.py", line 34, in __call__
    await self.app(scope, receive, send)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/app.py", line 1735, in __call__
    await self.asgi_app(scope, receive, send)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/app.py", line 1761, in asgi_app
    await asgi_handler(receive, send)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/quart/asgi.py", line 367, in __call__
    await send(
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/hypercorn/asyncio/lifespan.py", line 119, in asgi_send
    raise LifespanFailureError("startup", message.get("message", ""))
hypercorn.utils.LifespanFailureError: Lifespan failure in startup. 'Timed out waiting for Azure Developer CLI'
Exception ignored in: <function BaseSubprocessTransport.__del__ at 0x774b5e878900>
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_subprocess.py", line 126, in __del__
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_subprocess.py", line 104, in close
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/unix_events.py", line 566, in close
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/unix_events.py", line 590, in _close
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_events.py", line 762, in call_soon
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_events.py", line 520, in _check_closed
RuntimeError: Event loop is closed

---

Running processors on python 3.11 shows another issue . maybe corelated,

uirement already satisfied: wsproto==1.2.0 in ./.venv311/lib/python3.11/site-packages (from -r app/backend/requirements.txt (line 436)) (1.2.0)
Requirement already satisfied: yarl==1.19.0 in ./.venv311/lib/python3.11/site-packages (from -r app/backend/requirements.txt (line 438)) (1.19.0)
Requirement already satisfied: zipp==3.21.0 in ./.venv311/lib/python3.11/site-packages (from -r app/backend/requirements.txt (line 440)) (3.21.0)
Requirement already satisfied: zope.interface in ./.venv311/lib/python3.11/site-packages (from datetime==5.5->-r app/backend/requirements.txt (line 94)) (7.2)
Requirement already satisfied: typing-inspection>=0.4.0 in ./.venv311/lib/python3.11/site-packages (from pydantic==2.11.3->-r app/backend/requirements.txt (line 337)) (0.4.1)
Requirement already satisfied: setuptools in ./.venv311/lib/python3.11/site-packages (from zope.interface->datetime==5.5->-r app/backend/requirements.txt (line 94)) (80.9.0)
Successfully installed all dependencies
Running "prepdocs.py"
           INFO     Connecting to Azure services using the azd credential for tenant XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX                                                               prepdocs.py:369
           DEBUG    datalake_storage_account:                                                                                                                                           prepdocs.py:112
           DEBUG    datalake_filesystem: gptkbcontainer                                                                                                                                 prepdocs.py:113
           DEBUG    datalake_path: None                                                                                                                                                 prepdocs.py:114
           INFO     Using local files: ./data/createindex_dumy/*                                                                                                                        prepdocs.py:129
           INFO     Checking whether search index gptkbindex exists...                                                                                                              searchmanager.py:83
[00:14:00] WARNING  AzureDeveloperCliCredential.get_token_info failed: Timed out waiting for Azure Developer CLI                                                                       decorators.py:50
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
    return fut.result()
           ^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 200, in communicate
    stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 180, in _read_stream
    output = await stream.read()
             ^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 704, in read
    block = await self.read(self._limit)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 711, in read
    await self._wait_for_data('read')
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 543, in _wait_for_data
    await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
    stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
    raise exceptions.TimeoutError() from exc
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/./app/backend/prepdocs.py", line 503, in <module>
    loop.run_until_complete(main(ingestion_strategy, setup_index=not args.remove and not args.removeall))
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/./app/backend/prepdocs.py", line 277, in main
    await strategy.setup()
  File "/mnt/c/git/azure-search-demo/app/backend/prepdocslib/filestrategy.py", line 93, in setup
    await self.search_manager.create_index()
  File "/mnt/c/git/azure-search-demo/app/backend/prepdocslib/searchmanager.py", line 173, in create_index
    if self.search_info.index_name not in [name async for name in search_index_client.list_index_names()]:
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/app/backend/prepdocslib/searchmanager.py", line 173, in <listcomp>
    if self.search_info.index_name not in [name async for name in search_index_client.list_index_names()]:
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/async_paging.py", line 142, in __anext__
    return await self.__anext__()
           ^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/async_paging.py", line 145, in __anext__
    self._page = await self._page_iterator.__anext__()
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/async_paging.py", line 94, in __anext__
    self._response = await self._get_next(self.continuation_token)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/_generated/aio/operations/_indexes_operations.py", line 282, in get_next
    pipeline_response: PipelineResponse = await self._client._pipeline.run(  # pylint: disable=protected-access
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 229, in run
    return await first_node.send(pipeline_request)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  [Previous line repeated 2 more times]
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_redirect_async.py", line 76, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_retry_async.py", line 178, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 101, in send
    await await_result(self.on_request, request)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 72, in on_request
    await self._request_token(*self._scopes)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 218, in _request_token
    self._token = await self._get_token(*scopes, **kwargs)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 200, in _get_token
    return await await_result(
           ^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
    token = await fn(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
    return await self._get_token_base(*scopes, options=options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
    output = await _run_command(command_args, self._process_timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
    raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI

ERROR: invalid key=value format: AZURE_ADLS_GEN2_STORAGE_ACCOUNT
AzureDeveloperCliCredential.get_token_info failed: Timed out waiting for Azure Developer CLI
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 500, in wait_for
    return fut.result()
           ^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 200, in communicate
    stdin, stdout, stderr = await tasks.gather(stdin, stdout, stderr)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/subprocess.py", line 180, in _read_stream
    output = await stream.read()
             ^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 704, in read
    block = await self.read(self._limit)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 711, in read
    await self._wait_for_data('read')
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/streams.py", line 543, in _wait_for_data
    await self._waiter
asyncio.exceptions.CancelledError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 211, in _run_command
Loop <_UnixSelectorEventLoop running=False closed=True debug=False> that handles pid 474170 is closed
    stdout_b, stderr_b = await asyncio.wait_for(proc.communicate(), timeout)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/tasks.py", line 502, in wait_for
    raise exceptions.TimeoutError() from exc
TimeoutError

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/mnt/c/git/azure-search-demo/./scripts/manageacl.py", line 265, in <module>
    asyncio.run(main(args))
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/runners.py", line 190, in run
    return runner.run(main)
           ^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/runners.py", line 118, in run
    return self._loop.run_until_complete(task)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_events.py", line 654, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/./scripts/manageacl.py", line 228, in main
    await command.run()
  File "/mnt/c/git/azure-search-demo/./scripts/manageacl.py", line 70, in run
    await self.enable_acls(endpoint)
  File "/mnt/c/git/azure-search-demo/./scripts/manageacl.py", line 153, in enable_acls
    index_definition = await search_index_client.get_index(self.index_name)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/aio/_search_index_client.py", line 157, in get_index
    result = await self._client.indexes.get(name, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/tracing/decorator_async.py", line 119, in wrapper_use_tracer
    return await func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/search/documents/indexes/_generated/aio/operations/_indexes_operations.py", line 624, in get
    pipeline_response: PipelineResponse = await self._client._pipeline.run(  # pylint: disable=protected-access
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 229, in run
    return await first_node.send(pipeline_request)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_base_async.py", line 77, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  [Previous line repeated 2 more times]
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_redirect_async.py", line 76, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_retry_async.py", line 178, in send
    response = await self.next.send(request)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 101, in send
    await await_result(self.on_request, request)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 72, in on_request
    await self._request_token(*self._scopes)
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 218, in _request_token
    self._token = await self._get_token(*scopes, **kwargs)
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/policies/_authentication_async.py", line 200, in _get_token
    return await await_result(
           ^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/core/pipeline/_tools_async.py", line 56, in await_result
    return await result
           ^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_internal/decorators.py", line 22, in wrapper
    token = await fn(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 146, in get_token_info
    return await self._get_token_base(*scopes, options=options)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 172, in _get_token_base
    output = await _run_command(command_args, self._process_timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/c/git/azure-search-demo/.venv311/lib/python3.11/site-packages/azure/identity/aio/_credentials/azd_cli.py", line 216, in _run_command
    raise CredentialUnavailableError(message="Timed out waiting for Azure Developer CLI") from ex
azure.identity._exceptions.CredentialUnavailableError: Timed out waiting for Azure Developer CLI
Exception ignored in: <function BaseSubprocessTransport.__del__ at 0x73bf55398a40>
Traceback (most recent call last):
  File "/home/linuxbrew/.linuxbrew/opt/python@3.11/lib/python3.11/asyncio/base_subprocess.py", line 126, in __del__
 

So i think its more related with Azure/azure-cli#28915

[cforce]

Could this be related?
#2606 (comment)

Anyway i am not using any http proxies afaik

[pvaneck]

Not sure if this is some low-level bug with the interaction between asyncio subprocesses and hypercorn, but one thing to try is to switch out the async version of AzureDeveloperCliCredential with the sync version.

-from azure.identity.aio import AzureDeveloperCliCredential
+from azure.identity import AzureDeveloperCliCredential

Sync credentials should still work with async clients.

[cforce]

Root cause found.

When AZD_DEBUG=0 is set, the Python SDK’s subprocess call runs the azd CLI, which then prompts the user in the subprocess to start a debugger.
"Debugger Ready? (pid: 248271) (y/N)"
Interactive actions should never be required within a subprocess call. From my perspective, this is a bug and should be prevented — for example, by always including the --noprompt argument in the azd CLI calls used by the SDK to retrieve tokens.