Move all Colormap extremes setter logic into a single _set_extremes()

Move all Colormap extremes setter logic into a single _set_extremes() #977