Fix broken pipe during test and gracefully exit the server

Fix broken pipe during test and gracefully exit the server #13608