Bug: UnserializableKeyException when deleting, creating or updating(?) entity

[RafaelKr]

Symfony\Component\Lock\Exception\UnserializableKeyException:
The key cannot be serialized.

  at vendor/symfony/lock/Key.php:95
  at Symfony\Component\Lock\Key->__sleep()
  at serialize(object(Envelope))
     (vendor/symfony/messenger/Transport/Serialization/PhpSerializer.php:61)
  at Symfony\Component\Messenger\Transport\Serialization\PhpSerializer->encode(object(Envelope))
     (vendor/symfony/doctrine-messenger/Transport/DoctrineSender.php:39)
  at Symfony\Component\Messenger\Bridge\Doctrine\Transport\DoctrineSender->send(object(Envelope))
     (vendor/symfony/doctrine-messenger/Transport/DoctrineTransport.php:70)
  at Symfony\Component\Messenger\Bridge\Doctrine\Transport\DoctrineTransport->send(object(Envelope))
     (vendor/symfony/messenger/Middleware/SendMessageMiddleware.php:62)
  at Symfony\Component\Messenger\Middleware\SendMessageMiddleware->handle(object(Envelope), object(TraceableStack))
     (vendor/symfony/messenger/Middleware/FailedMessageProcessingMiddleware.php:34)
  at Symfony\Component\Messenger\Middleware\FailedMessageProcessingMiddleware->handle(object(Envelope), object(TraceableStack))
     (vendor/symfony/messenger/Middleware/DispatchAfterCurrentBusMiddleware.php:68)
  at Symfony\Component\Messenger\Middleware\DispatchAfterCurrentBusMiddleware->handle(object(Envelope), object(TraceableStack))
     (vendor/symfony/messenger/Middleware/RejectRedeliveredMessageMiddleware.php:41)
  at Symfony\Component\Messenger\Middleware\RejectRedeliveredMessageMiddleware->handle(object(Envelope), object(TraceableStack))
     (vendor/symfony/messenger/Middleware/AddBusNameStampMiddleware.php:35)
  at Symfony\Component\Messenger\Middleware\AddBusNameStampMiddleware->handle(object(Envelope), object(TraceableStack))
     (vendor/symfony/messenger/Middleware/TraceableMiddleware.php:36)
  at Symfony\Component\Messenger\Middleware\TraceableMiddleware->handle(object(Envelope), object(TraceableStack))
     (vendor/symfony/messenger/MessageBus.php:69)
  at Symfony\Component\Messenger\MessageBus->dispatch(object(Envelope), array())
     (vendor/symfony/messenger/TraceableMessageBus.php:37)
  at Symfony\Component\Messenger\TraceableMessageBus->dispatch(object(Envelope))
     (vendor/rekalogika/analytics-bundle/src/RefreshWorker/SymfonyRefreshFrameworkAdapter.php:132)
  at Rekalogika\Analytics\Bundle\RefreshWorker\SymfonyRefreshFrameworkAdapter->scheduleWorker(object(RefreshCommand), 60)
     (vendor/rekalogika/analytics-core/src/Engine/RefreshWorker/RefreshScheduler.php:77)
  at Rekalogika\Analytics\Engine\RefreshWorker\RefreshScheduler->scheduleWorker('App\\Entity\\FormSubmission\\FinancingFormSubmissionSummary20250707', null)
     (vendor/rekalogika/analytics-core/src/Engine/EventListener/NewDirtyFlagListener.php:40)
  at Rekalogika\Analytics\Engine\EventListener\NewDirtyFlagListener->onNewDirtyFlag(object(NewDirtyFlagEvent), 'Rekalogika\\Analytics\\Engine\\SummaryManager\\Event\\NewDirtyFlagEvent', object(TraceableEventDispatcher))
     (vendor/symfony/event-dispatcher/Debug/WrappedListener.php:115)
  at Symfony\Component\EventDispatcher\Debug\WrappedListener->__invoke(object(NewDirtyFlagEvent), 'Rekalogika\\Analytics\\Engine\\SummaryManager\\Event\\NewDirtyFlagEvent', object(TraceableEventDispatcher))
     (vendor/symfony/event-dispatcher/EventDispatcher.php:206)
  at Symfony\Component\EventDispatcher\EventDispatcher->callListeners(array(object(WrappedListener)), 'Rekalogika\\Analytics\\Engine\\SummaryManager\\Event\\NewDirtyFlagEvent', object(NewDirtyFlagEvent))
     (vendor/symfony/event-dispatcher/EventDispatcher.php:56)
  at Symfony\Component\EventDispatcher\EventDispatcher->dispatch(object(NewDirtyFlagEvent), 'Rekalogika\\Analytics\\Engine\\SummaryManager\\Event\\NewDirtyFlagEvent')
     (vendor/symfony/event-dispatcher/Debug/TraceableEventDispatcher.php:122)
  at Symfony\Component\EventDispatcher\Debug\TraceableEventDispatcher->dispatch(object(NewDirtyFlagEvent))
     (vendor/rekalogika/analytics-core/src/Engine/EventListener/SourceEntityListener.php:143)
  at Rekalogika\Analytics\Engine\EventListener\SourceEntityListener->postFlush(object(PostFlushEventArgs))
     (vendor/symfony/doctrine-bridge/ContainerAwareEventManager.php:56)
  at Symfony\Bridge\Doctrine\ContainerAwareEventManager->dispatchEvent('postFlush', object(PostFlushEventArgs))
     (vendor/doctrine/orm/src/UnitOfWork.php:3821)
  at Doctrine\ORM\UnitOfWork->dispatchPostFlushEvent()
     (vendor/doctrine/orm/src/UnitOfWork.php:510)
  at Doctrine\ORM\UnitOfWork->commit(null)
     (vendor/doctrine/orm/src/EntityManager.php:414)
  at Doctrine\ORM\EntityManager->flush()

[...]

  at Symfony\Component\HttpKernel\HttpKernel->handleRaw(object(Request), 1)
     (vendor/symfony/http-kernel/HttpKernel.php:76)
  at Symfony\Component\HttpKernel\HttpKernel->handle(object(Request), 1, true)
     (vendor/symfony/http-kernel/Kernel.php:182)
  at Symfony\Component\HttpKernel\Kernel->handle(object(Request))
     (public/index.php:75)                

Breakpoint at vendor/symfony/lock/Key.php:95

Context of $envelope at vendor/symfony/doctrine-messenger/Transport/DoctrineSender:39

Can I provide you with more information, or do you have any idea where this issue comes from?

[priyadi]

what is your LOCK_DSN?

[RafaelKr]

LOCK_DSN=flock

[RafaelKr]

I also just tried with LOCK_DSN=semaphore – same result.

[RafaelKr]

Okay, I just found https://symfony.com/doc/current/components/lock.html#available-stores

If I understand it correctly I need to use a store which supports serialization, correct? Or will you change your implementation so we can keep using flock (for now)?

[priyadi]

Unfortunately, without key serialization we'll have a race condition, and risk running multiple workers at the same time.

What I need to do:

• Document the requirement of serializable locking backend
• Option to disable automatic refresh, and to use a different update strategy (like running a scheduled task once a day).

By decoupling the automatic update, we'd also make the dependency on symfony messenger and lock optional.

[RafaelKr]

Good to know, thanks. We use redis anyways, so I can just spin up another instance and use it as a lock store 👍

[RafaelKr]

It looks like this was solved by #442 and released with https://github.com/rekalogika/analytics/releases/tag/v0.22.0

[RafaelKr]

The original issue is solved, but I found a small little bug in your RefreshAgentLock caching logic. It didn't release the key when calling $refreshAgentLock->release($summaryClass) because getKey always generated a new key instead of using a cached one, see #647