After dragging map returns on its own back to the same point

I'm new to angular-google-maps and having a few challenges.  The main one is that after the map and the markers have been drawn, I can drag the map with my mouse but it keeps automatically returning back to the same position.

I have values in my $scope.map for center, zoom and bounds.

Any idea what I've done wrong?