I'm finding that if the render_fn ever raises an Exception it'll cause the entire notebook kernel to shut down (rather than printing out an exception somewhere and just shutting down the viser server). Package versions involved are here.
nerfview==0.0.2
viser==0.2.1