PyPI v2.0.7 - ClearML

New Features and Bug Fixes

• Resolve uv run missing environment variables (#257, thanks @lifefoundry-scott!)
• Add support for extra git repo credentials under the agent.git.extra_credentials setting, with support for matching git host full URL with "agent.git_host_match_prefix"
• Add support for shlex parsing of script, to pass arguments directly to python by setting execution script to sub/dir/script.py --arg1=a --arg2=b
• Add CLEARML_AGENT_DOCKER_ARGS_HIDE_ENV to doc
• Add info prints on locking cache folders for increased visibility
• Change behaviour to not ask to skip setting execution queue on open source servers (#223)
• Fix template string handling for YAML
• Fix bash tasks created via CLI
• Fix setuptools dependency since pkg_resources was removed in 82.0.0
• Ensure venv folder was actually created after venv returned success error code (sometime happens with python wrappers)
• Fix install clearml when forcing Task.init patch and using UV as package manager
• Fix CLEARML_AGENT_FORCE_TASK_INIT did not patch requirements correctly in multiple empty requirements scenario, or twice in multi requirements.txt repos
• Fix UV to keep UV_CACHE_DIR env is exists
• Fix UV sync, if failing revert to toml file
• Fix environment variables where not passed when using non os.exec
• Fix when using CLEARML_AGENT_SKIP_PIP_VENV_INSTALL and CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL=1 make sure we run CLEARML_AGENT_SKIP_PIP_VENV_INSTALL binary and not the default python
• Fix if no container image was provided, default image would zero out all container arguments and bash script
• Fix obtaining task information when running where the task and the task session refer to a different tenant
• Fix GPU reporting when NVIDIA_VISIBLE_DEVICES=void

PyPI v2.0.5 - ClearML

Bug Fixes

• Don't pass --locked to uv sync if there's no lock file
• Fix execute in standalone mode crash on python get command

PyPI v2.0.4 - ClearML

New Features and Bug Fixes

• Fix Python 3.6 compatibility
• Update psutil requirement

PyPI v2.0.3 - ClearML

New Features and Bug Fixes

• Fix null ptr ref when skip python env enabled (#240, thanks @benled1!)
• Add support for Azure DevOps Git repositories authentication with Azure PAT and MS Entra Token using the agent.git_use_azure_pat and agent.git_use_ms_entra_token configuration options (and environment variables CLEARML_AGENT_GIT_USE_AZURE_PAT and CLEARML_AGENT_GIT_USE_MS_ENTRA_TOKEN)

PyPI v2.0.2 - ClearML

Bug Fixes

• Fix YAML dump failure causes agent to abort task execution (error log includes expected SCALAR, SEQUENCE-START, MAPPING-START, or ALIAS)

PyPI v2.0.1 - ClearML

Bug Fixes

• Fix regression issue AttributeError: 'NoneType' object has no attribute 'pending' caused by accessing a non-existing report (#241)

PyPI v2.0.0 - ClearML

New Features

• Add command line arguments for k8s_glue_example.py (#196, thanks @IlyaMescheryakov1402!)
• Add initial support for --break-system-packages version detection, also make sure to use rm /usr/lib/python3.*/EXTERNALLY-MANAGED
• Integrate docker port mapping to control non network=host port mapping, including port reassigning for multiple agents running on the same machine
• Add support for container rulebook overrides (force_container_rules: true) and container rulebook task update (update_back_task: true). This allows users to override container arguments forcefully based on the tasks properties (repository, tags, project, user etc.), as well as offer additional defaults based on python required packages or python versions
• Add the CLEARML_AGENT_ABORT_CALLBACK_CMD and CLEARML_AGENT_ABORT_CALLBACK_TIMEOUT
  (default 180 seconds) environment variables to define callback command to be called on abort status change
• Add support for ${CLEARML_TASK.yyy} as docker arguments parsed based on Task values
• Add support for the CLEARML_AGENT_QUEUE_POLL_FREQ_SEC and CLEARML_AGENT_STATUS_REPORT_FREQ_SEC environment variables to customize agent behavior
• Add support for the agent.translate_ssl_replacement_scheme configuration option and CLEARML_AGENT_SSH_URL_REPLACEMENT_SCHEME environment variable to support translating SSH URLs to HTTP instead of HTTPS
• Set urllib3 log level when connecting to server to WARNING by default to provide visibility on certificate issues (use the CLEARML_AGENT_URLLIB3_CONNECT_LEVEL environment variable to customize this behavior)
• Optimize dynamic GPU to query only relevant workers (requires ClearML Server v2.0.0 or higher)
• Bump urllib3 to "<3" to support new urllib3 v2
• Add note to --use-owner-token help (#235)
• Update GPU Fractions information for more GPU types
• Add CLEARML_AGENT_CONFIG_VERBOSE for verbose configuration file loading
• Add default support for dns i.e. rocky/centos/fedora containers
• Support NVIDIA_VISIBLE_DEVICES containing volume mounts
• Add better debug logging when task session creation fails
• Add is_daemon indication in status report
• Reduce required packages
• Add SECURITY.md

Bug Fixes

• Fix uv_replace_pip feature
• Fix UV cache based on sync/pip-replacement
• Fix if UV fails but lock file is missing, revert to UV as pip drop in replacement
• Fix use UV bin instead of UV python package to avoid nested VIRTUAL_ENV issues
• Fix UV pip freeze fails
• Fix UV as pip drop-in replacement print
• Fix cached venv tries to reinstall priority packages even through they are preinstalled
• Fix pip freeze dump to comply with YAML fancy print
• Fix pip requirements print dump should be sorted
• Fix force the stop command to avoid a potential race
• Fix make sure that if we fail to kill a child processes we continue to try the rest
• Fix untitled file based on binary is now py/sh based on requested binary
• Fix session should retry on Any error if send fails
• Fix potential issue with agent not sending queues in status report
• Fix do not set task to Aborted if it is already set to Failed
• Fix installing venv from the agent's python binary when the selected python failed - this could be the cause of missing pip or venv in the selected python
• Fix fallback to system path python3 if we fail to have pip used with the selected python - this could happen if preinstalled python is in path and it does not contain pip package (e.g. NIM containers)
• Fix fallback to system python should not change the python bin inside the new venv

PyPI v1.9.3 - ClearML

New Features

• Add support for uv as package manager (#218, thanks @mads-oestergaard!)
• Add agent.docker_args_filters to configuration docs, to enforce filter whitelist on docker arguments allowing only those matching these filters to be used when running containers
• Add support for Python 3.13
• Remove Python 3.5 support
• Add win32file on windows (pywin32 dependency)
• Scan more Python 3 versions
• Support ignoring kubectl errors
• Support creating queue with tags

Bug Fixes

• Fix managed python environment inside container (PEP 668)
• Fix default value handling in merge_dicts() utility function
• Fix python 3.6 compatibility (no := operator)

PyPI v1.9.2 - ClearML

New Features and Bug Fixes

• Handle OSError when checking for is_file (#215, thanks @materight!)
• Add support for pip legacy resolver for versions specified using the agent.package_manager.pip_legacy_resolver configuration option
• Add skip existing packages
• Fix report index not advancing in resource monitoring causes more than one GPU not to be reported
• Fix use req_token_expiration_sec and not the default value when creating a task session
• Fix reload method is found in the config object causing periodic agent error printouts

PyPI v1.9.1 - ClearML

New Features and Bug Fixes

• Add default pip version support for Python 3.12