fix: handle omit type in _remove_not_given() for litellm model

fix: handle omit type in _remove_not_given() for litellm model #2971