VoronoiContainer show label only when toottip is not active

[hadassaplotnik]

I currently have a victory AreaChart using VoronoiContainer for tooltips. My labelComponent is set to a VictoryTooltip. I would like to a label on my chart that always shows as long as no tooltips are showing.
I have tried using state to control the display of my label. I leveraged onTouchStart and onTouchEnd of the container to set the state according. however, resetting the state is making my chart relaod which I do not want.
How can I set up a label on the VoronoiContainer to be active by default and when the tooltip is activated, the label gets deactivated?