Skip to content

[WORKFLOW SDK BUG] Inflight workflows fail to resume #857

@sicoyle

Description

@sicoyle

Expected Behavior

Resuming my app should resume the workflow.

Actual Behavior

I start my app and let a few activities run. I kill the app. I then resume the app, and see that my workflow gets a failed status.

Steps to Reproduce the Problem

I am testing dapr-agents 03-durable-agent-multitool-dapr quickstart.

See cmds in logs, but you can just start an app and get an inflight workflow, then kill the app, and resume the app, and hit this consistently.

 dapr run --log-level debug --app-id sam --resources-path $temp_resources_folder -- python multi_tool_agent_dapr.py

ℹ️  Starting Dapr with id sam. HTTP Port: 50896. gRPC Port: 50897
ℹ️  Checking if Dapr sidecar is listening on HTTP port 50896
INFO[0000] Starting Dapr Runtime -- version 1.16.1 -- commit 133e3847acd3bba2f0a22f9e82af25ef6a63f5a3  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Log level set to: debug                       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
WARN[0000] mTLS is disabled. Skipping certificate request and tls validation  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.security type=log ver=1.16.1
DEBU[0000] Loading config from file(s): /Users/samcoyle/.dapr/config.yaml  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Enabled features: SchedulerReminders          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Creating a new meter for metrics              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] metric spec: {"enabled":true}                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.diagnostics type=log ver=1.16.1
INFO[0000] Using default latency distribution buckets: [1 2 3 4 5 6 8 10 13 16 20 25 30 40 50 65 80 100 130 160 200 250 300 400 500 650 800 1000 2000 5000 10000 20000 50000 100000]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.diagnostics type=log ver=1.16.1
WARN[0000] The default value for 'spec.metric.http.increasedCardinality' will change to 'false' in Dapr 1.15 or later  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.diagnostics type=log ver=1.16.1
DEBU[0000] Found 0 resiliency configurations in resources path  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Attempting to connect to scheduler to WatchHosts: localhost:50006  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.watchhosts type=log ver=1.16.1
INFO[0000] standalone mode configured                    app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] app id: sam                                   app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Hot reloading disabled                        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.hotreload type=log ver=1.16.1
INFO[0000] Dapr trace sampler initialized: ParentBased{root:AlwaysOnSampler,remoteParentSampled:AlwaysOnSampler,remoteParentNotSampled:AlwaysOffSampler,localParentSampled:AlwaysOnSampler,localParentNotSampled:AlwaysOffSampler}  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] metrics server started on 0.0.0.0:50898/      app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] local service entry announced: sam -> 10.48.23.84:50899  app_id=sam component="nr (mdns/v1)" instance=Samanthas-MacBook-Pro-2.local scope=dapr.contrib type=log ver=1.16.1
INFO[0000] Initialized name resolution to mdns           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Loading components…                           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Found component: openai (conversation.openai/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Found component: messagepubsub (pubsub.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Loading component: openai (conversation.openai/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
INFO[0000] Component loaded: openai (conversation.openai/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
DEBU[0000] Loading component: messagepubsub (pubsub.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
DEBU[0000] Found component: statestore (state.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Component loaded: messagepubsub (pubsub.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
DEBU[0000] Loading component: statestore (state.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
INFO[0000] Waiting for all outstanding components to be processed…  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Connected and received scheduler hosts addresses: [localhost:50006]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.watchhosts type=log ver=1.16.1
DEBU[0000] Attempting to connect to Scheduler at address: localhost:50006  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.clients type=log ver=1.16.1
INFO[0000] Scheduler client initialized for address: localhost:50006  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.clients type=log ver=1.16.1
INFO[0000] Scheduler clients initialized                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.clients type=log ver=1.16.1
INFO[0000] Using 'statestore' as actor state store       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor.state type=log ver=1.16.1
INFO[0000] Component loaded: statestore (state.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
INFO[0000] All outstanding components processed          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Loading endpoints…                            app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Waiting for all outstanding http endpoints to be processed…  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] All outstanding http endpoints processed      app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Loading Declarative Subscriptions…            app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Refreshing channels                           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.channels type=log ver=1.16.1
WARN[0000] App channel is not initialized. Did you configure an app-port?  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.channels type=log ver=1.16.1
INFO[0000] gRPC server listening on TCP address: :50897  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] Enabled gRPC tracing middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] Enabled gRPC metrics middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] Registering workflow engine for gRPC endpoint: [::]:50897  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] API gRPC server is running on port 50897      app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
WARN[0000] The default value for 'spec.metric.http.increasedCardinality' will change to 'false' in Dapr 1.15 or later  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] Enabled max body size HTTP middleware with size 4194304 bytes  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] Enabled tracing HTTP middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] Enabled metrics HTTP middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] HTTP server listening on TCP address: :50896  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] HTTP server is running on port 50896          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] The request body size parameter is: 4194304 bytes  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] gRPC server listening on TCP address: :50899  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.internal type=log ver=1.16.1
INFO[0000] Enabled gRPC tracing middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.internal type=log ver=1.16.1
INFO[0000] Enabled gRPC metrics middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.internal type=log ver=1.16.1
INFO[0000] Internal gRPC server is running on :50899     app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Using Scheduler service for reminders.        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor.reminders.scheduler type=log ver=1.16.1
INFO[0000] dapr initialized. Status: Running. Init Elapsed 49ms  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Actor runtime started                         app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor type=log ver=1.16.1
WARN[0000] Graceful shutdown timeout is infinite, will wait indefinitely to shutdown  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor type=log ver=1.16.1
INFO[0000] worker started with backend dapr.actors/v1    app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0000] Workflow engine started                       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.wfengine type=log ver=1.16.1
DEBU[0000] Actor backend is waiting for an activity actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
INFO[0000] Reporting actor types: []                     app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0000] Actor backend is waiting for a workflow actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
INFO[0000] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0000] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0000] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
DEBU[0000] Attempting to connect to placement localhost:50005  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement.client.connector.static type=log ver=1.16.1
INFO[0000] Connected to placement localhost:50005        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement.client.connector.static type=log ver=1.16.1
INFO[0000] Connected to placement localhost:50005        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement.client type=log ver=1.16.1
DEBU[0000] Placement order received: lock                app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0000] Placement order received: update              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0000] Placement tables updated, version: 0          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0000] Placement order received: unlock              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0000] Running actor reminder migration from state store to scheduler  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0000] Skipping migration, no missing scheduler reminders found  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0000] Found 0 missing scheduler reminders from state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0000] Migrated 0 reminders from state store to scheduler successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
ℹ️  Checking if Dapr sidecar is listening on GRPC port 50897
ℹ️  Dapr sidecar is up and running.
ℹ️  Updating metadata for appPID: 14228
ℹ️  Updating metadata for app command: python multi_tool_agent_dapr.py
✅  You're up and running! Both Dapr and your app logs will appear here.

== APP == INFO:dapr_agents.workflow.agentic:State store 'statestore' initialized.
== APP == WARNING:dapr_agents.workflow.mixins.state:Skipping state save: Empty state.
== APP == INFO:dapr_agents.workflow.base:WorkflowApp initialized; discovering tasks and workflows.
== APP == INFO:dapr_agents.workflow.base:Starting workflow runtime.
== APP == 2025-10-24 17:52:44.003 durabletask-worker INFO: Starting gRPC worker that connects to dns:127.0.0.1:50897
== APP == INFO:dapr_agents.workflow.base:Sleeping for 5 seconds to ensure runtime is started.
== APP == 2025-10-24 17:52:44.006 durabletask-worker INFO: Created fresh connection to dns:127.0.0.1:50897
== APP == 2025-10-24 17:52:44.006 durabletask-worker INFO: Successfully connected to dns:127.0.0.1:50897. Waiting for work items...
INFO[0004] work item stream established by user-agent: [grpc-python/1.76.0 grpc-c/51.0.0 (osx; chttp2)]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.wfengine type=log ver=1.16.1
DEBU[0004] Registering workflow actors                   app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.wfengine type=log ver=1.16.1
INFO[0004] Updating actor types: [dapr.internal.default.sam.workflow dapr.internal.default.sam.activity]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0004] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
DEBU[0007] Placement order received: lock                app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0007] Placement order received: update              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0007] Placement tables updated, version: 1          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0007] Placement order received: unlock              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0007] Running actor reminder migration from state store to scheduler  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
DEBU[0007] Listing state reminders for actor type dapr.internal.default.sam.workflow  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0007] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0007] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0007] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0007] Scheduler stream connected for [JOB_TARGET_TYPE_JOB JOB_TARGET_TYPE_ACTOR_REMINDER]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
ERRO[0007] Error attempting to migrate reminders to scheduler: statestore reminders is not ready  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor.reminders.scheduler type=log ver=1.16.1
INFO[0007] Scheduler stream connected for [JOB_TARGET_TYPE_JOB JOB_TARGET_TYPE_ACTOR_REMINDER]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0007] Scheduler stream connected for [JOB_TARGET_TYPE_JOB JOB_TARGET_TYPE_ACTOR_REMINDER]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
== APP == 2025-10-24 17:52:49.026 WorkflowRuntime INFO: Registering activity 'broadcast_message_to_agents' with runtime
== APP == INFO:WorkflowRuntime:Registering activity 'broadcast_message_to_agents' with runtime
== APP == 2025-10-24 17:52:49.027 WorkflowRuntime INFO: Registering activity 'call_llm' with runtime
== APP == INFO:WorkflowRuntime:Registering activity 'call_llm' with runtime
== APP == 2025-10-24 17:52:49.027 WorkflowRuntime INFO: Registering activity 'finalize_workflow' with runtime
== APP == INFO:WorkflowRuntime:Registering activity 'finalize_workflow' with runtime
== APP == 2025-10-24 17:52:49.027 WorkflowRuntime INFO: Registering activity 'record_initial_entry' with runtime
== APP == INFO:WorkflowRuntime:Registering activity 'record_initial_entry' with runtime
== APP == 2025-10-24 17:52:49.028 WorkflowRuntime INFO: Registering activity 'run_tool' with runtime
== APP == INFO:WorkflowRuntime:Registering activity 'run_tool' with runtime
== APP == 2025-10-24 17:52:49.028 WorkflowRuntime INFO: Registering activity 'send_response_back' with runtime
== APP == INFO:WorkflowRuntime:Registering activity 'send_response_back' with runtime
== APP == INFO:dapr_agents.workflow.base:Discovered workflows: ['AgenticWorkflow']
== APP == 2025-10-24 17:52:49.028 WorkflowRuntime INFO: Registering workflow 'tool_calling_workflow' with runtime
== APP == INFO:WorkflowRuntime:Registering workflow 'tool_calling_workflow' with runtime
== APP == INFO:dapr_agents.tool.executor:Tool registered: GetWeather
== APP == INFO:dapr_agents.tool.executor:Tool registered: Calculate
== APP == INFO:dapr_agents.tool.executor:Tool registered: WebSearch
== APP == INFO:dapr_agents.tool.executor:Tool Executor initialized with 3 tool(s).
== APP == ERROR:dapr_agents.workflow.agentic:Error on transaction attempt: 1: No etag found for key: agent_registry
== APP == INFO:dapr_agents.workflow.agentic:Sleeping for 1.80 seconds before retrying transaction...
WARN[0011] Redis does not support transaction rollbacks and should not be used in production as an actor state store.  app_id=sam component="statestore (state.redis/v1)" instance=Samanthas-MacBook-Pro-2.local scope=dapr.contrib type=log ver=1.16.1
== APP == 2025-10-24 17:52:50.887 durabletask-client INFO: Starting new 'AgenticWorkflow' instance with ID = '05ee6bb562584ae78c92f0f78d56de83'.
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking method 'CreateWorkflowInstance'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': creating workflow 'AgenticWorkflow' with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': loading workflow state  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': saving 2 keys to actor state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor 'dapr.internal.default.sam.workflow||05ee6bb562584ae78c92f0f78d56de83': creating 'start-5an16kD5' reminder with DueTime = '0s'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Actor backend streaming OrchestrationRuntimeStatus 05ee6bb562584ae78c92f0f78d56de83  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking reminder 'start-5an16kD5'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': scheduling workflow execution with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: scheduling workflow execution with durabletask engine  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Actor backend received a workflow task for workflow '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Actor backend is waiting for a workflow actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] orchestration-processor: processing work item: 05ee6bb562584ae78c92f0f78d56de83 (1 event(s))  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: received work item with 1 new event(s): [ExecutionStarted]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: got orchestration runtime state: name=AgenticWorkflow, status=PENDING, events=0, age=(new)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0011] 05ee6bb562584ae78c92f0f78d56de83: starting new 'AgenticWorkflow' instance with ID = '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: invoking orchestrator  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
== APP == 2025-10-24 17:52:50.953 durabletask-worker INFO: 05ee6bb562584ae78c92f0f78d56de83: Orchestrator yielded with 1 task(s) and 0 event(s) outstanding.
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: orchestrator returned 1 action(s): [ScheduleTask#1]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] orchestration-processor: work item processed successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': workflow execution returned with status 'ORCHESTRATION_STATUS_RUNNING' instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking execute method on activity actor 'dapr.internal.default.sam.activity||05ee6bb562584ae78c92f0f78d56de83::1::1'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Activity actor '05ee6bb562584ae78c92f0f78d56de83::1::1': invoking method 'Execute'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0011] Activity actor 'dapr.internal.default.sam.activity||05ee6bb562584ae78c92f0f78d56de83::1::1': creating reminder 'run-activity' for immediate execution  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': saving 6 keys to actor state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
== APP == INFO:dapr_agents.workflow.base:Started workflow with instance ID 05ee6bb562584ae78c92f0f78d56de83.
DEBU[0011] Activity actor '05ee6bb562584ae78c92f0f78d56de83::1::1': invoking reminder 'run-activity'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0011] Activity actor '05ee6bb562584ae78c92f0f78d56de83::1::1': scheduling activity 'run-activity' for workflow with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: scheduling [record_initial_entry#1] activity execution with durabletask engine  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Actor backend received a [record_initial_entry#1] activity task for workflow '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Actor backend is waiting for an activity actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] activity-processor: processing work item: 05ee6bb562584ae78c92f0f78d56de83/record_initial_entry#1  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
== APP == 2025-10-24 17:52:50.961 durabletask-client INFO: Waiting up to 300s for instance '05ee6bb562584ae78c92f0f78d56de83' to complete.
DEBU[0011] Actor backend streaming OrchestrationRuntimeStatus 05ee6bb562584ae78c92f0f78d56de83  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
== APP == INFO:dapr_agents.workflow.task:Executing task 'record_initial_entry'
DEBU[0011] activity-processor: work item processed successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] Activity actor '05ee6bb562584ae78c92f0f78d56de83::1::1': activity completed for workflow with instanceId '05ee6bb562584ae78c92f0f78d56de83' activityName 'run-activity'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking method 'AddWorkflowEvent'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': adding event to the workflow inbox  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': saving 2 keys to actor state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor 'dapr.internal.default.sam.workflow||05ee6bb562584ae78c92f0f78d56de83': creating 'new-event-kqHAjbD0' reminder with DueTime = '0s'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking reminder 'new-event-kqHAjbD0'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': scheduling workflow execution with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: scheduling workflow execution with durabletask engine  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Actor backend received a workflow task for workflow '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] Actor backend is waiting for a workflow actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0011] orchestration-processor: processing work item: 05ee6bb562584ae78c92f0f78d56de83 (1 event(s))  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: received work item with 1 new event(s): [TaskCompleted#1]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: got orchestration runtime state: name=AgenticWorkflow, status=RUNNING, events=3, age=0s  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: invoking orchestrator  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
== APP == 2025-10-24 17:52:51.050 durabletask-worker INFO: 05ee6bb562584ae78c92f0f78d56de83: Orchestrator yielded with 1 task(s) and 0 event(s) outstanding.
DEBU[0011] 05ee6bb562584ae78c92f0f78d56de83: orchestrator returned 1 action(s): [ScheduleTask#2]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] orchestration-processor: work item processed successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': workflow execution returned with status 'ORCHESTRATION_STATUS_RUNNING' instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking execute method on activity actor 'dapr.internal.default.sam.activity||05ee6bb562584ae78c92f0f78d56de83::2::1'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0011] Activity actor '05ee6bb562584ae78c92f0f78d56de83::2::1': invoking method 'Execute'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0011] Activity actor 'dapr.internal.default.sam.activity||05ee6bb562584ae78c92f0f78d56de83::2::1': creating reminder 'run-activity' for immediate execution  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0012] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': saving 6 keys to actor state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0012] Activity actor '05ee6bb562584ae78c92f0f78d56de83::2::1': invoking reminder 'run-activity'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0012] Activity actor '05ee6bb562584ae78c92f0f78d56de83::2::1': scheduling activity 'run-activity' for workflow with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0012] 05ee6bb562584ae78c92f0f78d56de83: scheduling [call_llm#2] activity execution with durabletask engine  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0012] Actor backend received a [call_llm#2] activity task for workflow '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0012] Actor backend is waiting for an activity actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0012] activity-processor: processing work item: 05ee6bb562584ae78c92f0f78d56de83/call_llm#2  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
== APP == INFO:dapr_agents.workflow.task:Executing task 'call_llm'
== APP == INFO:dapr_agents.llm.utils.request:Tools are available in the request.
^Cℹ️  
terminated signal received: shutting down
INFO[0013] Received signal 'interrupt'; beginning shutdown  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.signals type=log ver=1.16.1
✅  Exited Dapr successfully
✅  Exited App successfully
(venv) ➜  03-durable-agent-multitool-dapr git:(simplify-agent-creation-part-one) ✗ dapr run --log-level debug --app-id sam --resources-path $temp_resources_folder -- python multi_tool_agent_dapr.py

ℹ️  Starting Dapr with id sam. HTTP Port: 51000. gRPC Port: 51001
ℹ️  Checking if Dapr sidecar is listening on HTTP port 51000
INFO[0000] Starting Dapr Runtime -- version 1.16.1 -- commit 133e3847acd3bba2f0a22f9e82af25ef6a63f5a3  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Log level set to: debug                       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
WARN[0000] mTLS is disabled. Skipping certificate request and tls validation  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.security type=log ver=1.16.1
DEBU[0000] Loading config from file(s): /Users/samcoyle/.dapr/config.yaml  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Enabled features: SchedulerReminders          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Creating a new meter for metrics              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] metric spec: {"enabled":true}                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.diagnostics type=log ver=1.16.1
INFO[0000] Using default latency distribution buckets: [1 2 3 4 5 6 8 10 13 16 20 25 30 40 50 65 80 100 130 160 200 250 300 400 500 650 800 1000 2000 5000 10000 20000 50000 100000]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.diagnostics type=log ver=1.16.1
WARN[0000] The default value for 'spec.metric.http.increasedCardinality' will change to 'false' in Dapr 1.15 or later  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.diagnostics type=log ver=1.16.1
DEBU[0000] Found 0 resiliency configurations in resources path  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Hot reloading disabled                        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.hotreload type=log ver=1.16.1
DEBU[0000] Attempting to connect to scheduler to WatchHosts: localhost:50006  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.watchhosts type=log ver=1.16.1
INFO[0000] standalone mode configured                    app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] app id: sam                                   app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Dapr trace sampler initialized: ParentBased{root:AlwaysOnSampler,remoteParentSampled:AlwaysOnSampler,remoteParentNotSampled:AlwaysOffSampler,localParentSampled:AlwaysOnSampler,localParentNotSampled:AlwaysOffSampler}  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] metrics server started on 0.0.0.0:51002/      app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] local service entry announced: sam -> 10.48.23.84:51003  app_id=sam component="nr (mdns/v1)" instance=Samanthas-MacBook-Pro-2.local scope=dapr.contrib type=log ver=1.16.1
INFO[0000] Initialized name resolution to mdns           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Loading components…                           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Found component: openai (conversation.openai/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Found component: messagepubsub (pubsub.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Loading component: openai (conversation.openai/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
INFO[0000] Component loaded: openai (conversation.openai/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
DEBU[0000] Loading component: messagepubsub (pubsub.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
DEBU[0000] Found component: statestore (state.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Connected and received scheduler hosts addresses: [localhost:50006]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.watchhosts type=log ver=1.16.1
DEBU[0000] Attempting to connect to Scheduler at address: localhost:50006  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.clients type=log ver=1.16.1
INFO[0000] Scheduler client initialized for address: localhost:50006  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.clients type=log ver=1.16.1
INFO[0000] Scheduler clients initialized                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.clients type=log ver=1.16.1
INFO[0000] Component loaded: messagepubsub (pubsub.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
DEBU[0000] Loading component: statestore (state.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
INFO[0000] Waiting for all outstanding components to be processed…  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Using 'statestore' as actor state store       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor.state type=log ver=1.16.1
INFO[0000] Component loaded: statestore (state.redis/v1)  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.processor type=log ver=1.16.1
INFO[0000] All outstanding components processed          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Loading endpoints…                            app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Waiting for all outstanding http endpoints to be processed…  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] All outstanding http endpoints processed      app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Loading Declarative Subscriptions…            app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
DEBU[0000] Refreshing channels                           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.channels type=log ver=1.16.1
WARN[0000] App channel is not initialized. Did you configure an app-port?  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.channels type=log ver=1.16.1
INFO[0000] gRPC server listening on TCP address: :51001  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] Enabled gRPC tracing middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] Enabled gRPC metrics middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] Registering workflow engine for gRPC endpoint: [::]:51001  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.api type=log ver=1.16.1
INFO[0000] API gRPC server is running on port 51001      app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
WARN[0000] The default value for 'spec.metric.http.increasedCardinality' will change to 'false' in Dapr 1.15 or later  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] Enabled max body size HTTP middleware with size 4194304 bytes  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] Enabled tracing HTTP middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] Enabled metrics HTTP middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] HTTP server listening on TCP address: :51000  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.http type=log ver=1.16.1
INFO[0000] HTTP server is running on port 51000          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] The request body size parameter is: 4194304 bytes  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] gRPC server listening on TCP address: :51003  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.internal type=log ver=1.16.1
INFO[0000] Enabled gRPC tracing middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.internal type=log ver=1.16.1
INFO[0000] Enabled gRPC metrics middleware               app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.grpc.internal type=log ver=1.16.1
INFO[0000] Internal gRPC server is running on :51003     app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Using Scheduler service for reminders.        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor.reminders.scheduler type=log ver=1.16.1
INFO[0000] dapr initialized. Status: Running. Init Elapsed 53ms  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime type=log ver=1.16.1
INFO[0000] Actor runtime started                         app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor type=log ver=1.16.1
WARN[0000] Graceful shutdown timeout is infinite, will wait indefinitely to shutdown  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor type=log ver=1.16.1
INFO[0000] worker started with backend dapr.actors/v1    app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0000] Reporting actor types: []                     app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0000] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0000] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0000] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
DEBU[0000] Attempting to connect to placement localhost:50005  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement.client.connector.static type=log ver=1.16.1
INFO[0000] Workflow engine started                       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.wfengine type=log ver=1.16.1
DEBU[0000] Actor backend is waiting for an activity actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
INFO[0000] Connected to placement localhost:50005        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement.client.connector.static type=log ver=1.16.1
DEBU[0000] Actor backend is waiting for a workflow actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
INFO[0000] Connected to placement localhost:50005        app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement.client type=log ver=1.16.1
DEBU[0000] Placement order received: lock                app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0000] Placement order received: update              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0000] Placement tables updated, version: 2          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0000] Placement order received: unlock              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0000] Running actor reminder migration from state store to scheduler  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0000] Skipping migration, no missing scheduler reminders found  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0000] Found 0 missing scheduler reminders from state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0000] Migrated 0 reminders from state store to scheduler successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
ℹ️  Checking if Dapr sidecar is listening on GRPC port 51001
ℹ️  Dapr sidecar is up and running.
ℹ️  Updating metadata for appPID: 14997
ℹ️  Updating metadata for app command: python multi_tool_agent_dapr.py
✅  You're up and running! Both Dapr and your app logs will appear here.

== APP == INFO:dapr_agents.workflow.agentic:State store 'statestore' initialized.
== APP == WARNING:dapr_agents.workflow.mixins.state:Skipping state save: Empty state.
== APP == INFO:dapr_agents.workflow.base:WorkflowApp initialized; discovering tasks and workflows.
== APP == INFO:dapr_agents.workflow.base:Starting workflow runtime.
== APP == 2025-10-24 17:53:22.762 durabletask-worker INFO: Starting gRPC worker that connects to dns:127.0.0.1:51001
== APP == INFO:dapr_agents.workflow.base:Sleeping for 5 seconds to ensure runtime is started.
== APP == 2025-10-24 17:53:22.771 durabletask-worker INFO: Created fresh connection to dns:127.0.0.1:51001
== APP == 2025-10-24 17:53:22.772 durabletask-worker INFO: Successfully connected to dns:127.0.0.1:51001. Waiting for work items...
INFO[0004] work item stream established by user-agent: [grpc-python/1.76.0 grpc-c/51.0.0 (osx; chttp2)]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.wfengine type=log ver=1.16.1
DEBU[0004] Registering workflow actors                   app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.wfengine type=log ver=1.16.1
INFO[0004] Updating actor types: [dapr.internal.default.sam.workflow dapr.internal.default.sam.activity]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0004] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0004] Scheduler stream connected for [JOB_TARGET_TYPE_JOB]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
DEBU[0006] Placement order received: lock                app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0006] Placement order received: update              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0006] Placement tables updated, version: 3          app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
DEBU[0006] Placement order received: unlock              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.placement type=log ver=1.16.1
INFO[0006] Running actor reminder migration from state store to scheduler  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
DEBU[0006] Listing state reminders for actor type dapr.internal.default.sam.workflow  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.reminders.migration type=log ver=1.16.1
INFO[0006] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0006] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0006] Scheduler stream disconnected                 app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
ERRO[0006] Error attempting to migrate reminders to scheduler: statestore reminders is not ready  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor.reminders.scheduler type=log ver=1.16.1
INFO[0006] Scheduler stream connected for [JOB_TARGET_TYPE_JOB JOB_TARGET_TYPE_ACTOR_REMINDER]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0006] Scheduler stream connected for [JOB_TARGET_TYPE_JOB JOB_TARGET_TYPE_ACTOR_REMINDER]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
INFO[0006] Scheduler stream connected for [JOB_TARGET_TYPE_JOB JOB_TARGET_TYPE_ACTOR_REMINDER]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.scheduler.cluster type=log ver=1.16.1
DEBU[0006] Activity actor '05ee6bb562584ae78c92f0f78d56de83::2::1': invoking reminder 'run-activity'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0006] Activity actor '05ee6bb562584ae78c92f0f78d56de83::2::1': scheduling activity 'run-activity' for workflow with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: scheduling [call_llm#2] activity execution with durabletask engine  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0006] Actor backend received a [call_llm#2] activity task for workflow '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0006] Actor backend is waiting for an activity actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0006] activity-processor: processing work item: 05ee6bb562584ae78c92f0f78d56de83/call_llm#2  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] activity-processor: work item processed successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] Activity actor '05ee6bb562584ae78c92f0f78d56de83::2::1': activity completed for workflow with instanceId '05ee6bb562584ae78c92f0f78d56de83' activityName 'run-activity'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.activity type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking method 'AddWorkflowEvent'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': loading workflow state  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: loaded 8 state records in 30.561708ms  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actor.target.workflow.state type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': adding event to the workflow inbox  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': saving 2 keys to actor state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
WARN[0006] Redis does not support transaction rollbacks and should not be used in production as an actor state store.  app_id=sam component="statestore (state.redis/v1)" instance=Samanthas-MacBook-Pro-2.local scope=dapr.contrib type=log ver=1.16.1
DEBU[0006] Workflow actor 'dapr.internal.default.sam.workflow||05ee6bb562584ae78c92f0f78d56de83': creating 'new-event-MDvj66_I' reminder with DueTime = '0s'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': invoking reminder 'new-event-MDvj66_I'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': scheduling workflow execution with instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: scheduling workflow execution with durabletask engine  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0006] Actor backend received a workflow task for workflow '05ee6bb562584ae78c92f0f78d56de83'.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0006] Actor backend is waiting for a workflow actor to schedule an invocation.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.backend.actors type=log ver=1.16.1
DEBU[0006] orchestration-processor: processing work item: 05ee6bb562584ae78c92f0f78d56de83 (1 event(s))  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: received work item with 1 new event(s): [TaskFailed#2]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: got orchestration runtime state: name=AgenticWorkflow, status=RUNNING, events=6, age=34s  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: invoking orchestrator  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
== APP == 2025-10-24 17:53:25.017 durabletask-worker INFO: 05ee6bb562584ae78c92f0f78d56de83: Orchestration completed with status: FAILED
DEBU[0006] 05ee6bb562584ae78c92f0f78d56de83: orchestrator returned 1 action(s): [CompleteOrchestration#1]  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0006] 05ee6bb562584ae78c92f0f78d56de83: 'AgenticWorkflow' completed with a FAILED status.  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] orchestration-processor: work item processed successfully  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': workflow execution returned with status 'ORCHESTRATION_STATUS_FAILED' instanceId '05ee6bb562584ae78c92f0f78d56de83'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
DEBU[0006] Workflow actor '05ee6bb562584ae78c92f0f78d56de83': saving 6 keys to actor state store  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
INFO[0006] Workflow Actor '05ee6bb562584ae78c92f0f78d56de83': workflow completed with status 'ORCHESTRATION_STATUS_FAILED' workflowName 'AgenticWorkflow'  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.runtime.actors.targets.orchestrator type=log ver=1.16.1
^CINFO[0008] Received signal 'interrupt'; beginning shutdown  app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.signals type=log ver=1.16.1
INFO[0008] backend stopping...                           app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0008] workers stopping and draining...              app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0008] activity-processor: worker stopped            app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1
INFO[0008] orchestration-processor: worker stopped       app_id=sam instance=Samanthas-MacBook-Pro-2.local scope=dapr.wfengine.durabletask.backend type=log ver=1.16.1

Release Note

RELEASE NOTE:

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions