Algolia problems with memory cache in load balanced setup

[nickh364]

Umbraco version: 13.9.3
Package Version: search-algolia-2.3.2

We have our sites on two servers load balanced. I will call them site1 and site2. For backoffice access site1 is used. Sometimes when content is published it does not get added to the memory cache on site2. To fix the memory cache I have to go to /umbraco#/settings?dashboard=settingsPublishedStatus on site2 and reload the memory cache. Removing this package has fixed the problem. We would like to be able to use the package but we can't have one of the sites breaking every few days.