PyPI v1.5.1 - ClearML Latest

New Features and Improvements

• Upgrade requirements for attrs, jsonschema, pyparsing, six and pyjwt (#129)
• Add default output URI selection to clearml-agent init
• Add agent.disable_task_docker_override configuration option to disable docker override specified in executing tasks
• Add CLEARML_AGENT_FORCE_SYSTEM_SITE_PACKAGES env var (default true) to allow overriding default system_site_packages: true behavior when running tasks in containers (docker mode and k8s-glue)

Bug Fixes

• Fix using deprecated types validator argument raises an error (deprecated even before jsonschema 3.0.0 and unsupported since 4.0.0)
• Fix pip support allowing multiple pip version constraints (by default, one for < Python 3.10 and one for >= Python 3.10)

PyPI v1.5.0 - ClearML

New Features and Improvements

• Add option to crash agent on exception using agent.crash_on_exception configuration setting (#123, thanks @nielstenboom!)
• Improve venv cache disabled message
• Upgrade packages for better Python 3.10 support
• Remove future package dependency (Python 2 is not supported for clearml-agent)
• Change default pip version used to pip<21 for better Python 3.10 support
• Add support for operator != in package version (mostly for better pytorch resolving)
• Add support for PyTorch new extra_index_url repo (find the correct index url based on the cuda version, and let pip do the rest)
• Make venv caching the default behavior
• Add support for CLEARML_AGENT_DOCKER_ARGS_HIDE_ENV environment variable (see agent.hide_docker_command_env_vars config option)
• Ping executing tasks to make sure the server does not consider them stale (set using the agent.task_ping_interval_sec configuration option, defaults to every 120 seconds)

Bug Fixes

• Fix docker extra arguments showing up in configuration printout
• Fix an issue with running on Python 3.10 / 3.11
• Fix cached git token prevents cloning repository (using agent.enable_git_ask_pass forcing the agent to use GIT_ASKPASS for user/password when cloning/fetching repositories)
• Fix setting CLEARML_API_DEFAULT_REQ_METHOD raises an error
• Fix get_task_session() may cause an old copy of the APIClient to be used containing a reference to the previous session
• K8s Glue
  • Fix agent.system_site_packages is not turned on by default in k8s glue
  • Make sure we git_user/pass is passed to the task pod
  • Remove support for kubectl run

PyPI v1.4.1 - ClearML

Improvements

• Add warning if venv cache is disabled
• Add agent.disable_ssh_mount configuration option (same as the CLEARML_AGENT_DISABLE_SSH_MOUNT environment variable)

Bug Fixes

• Fix docker command for monitoring child agents
• Fix --gpus all not reporting GPU stats on worker machine

PyPI v1.4.0 - ClearML

New Features and Improvements

• Add support for MIG devices (use 0:1 for GPU 0 slice 1, or use 0.1)
• Add agent.enable_git_ask_pass to improve passing user/pass to git commands
• Add docker ssh_ro_folder (default /.ssh) and changed docker ssh_folder (default: ~/.ssh)
• Allow overriding pytorch lookup page (See torch_page, torch_nightly_page and torch_url_template_prefix under the agent.package_manager configuration settings)
• Add support for abort callback registration
• K8s glue
  • Add CLEARML_K8S_GLUE_START_AGENT_SCRIPT_PATH environment variable to allow customizing the agent startup script location
  • Add debug environment variable CLEARML_AGENT_DEBUG_INFO
  • Add CLEARML_AGENT_CHILD_AGENTS_COUNT_CMD environment variable to allow overriding child agent count command in k8s
  • Refactor template handling

Bug Fixes

• Fix Python 3.10+ support
• Fix use_credentials_chain is missing in config file example
• Fix Git PAT messages
• Fix home folder in clearml.conf to ~ (instead of /root)
• Fix docker mode uses ~/.clearml/venvs-builds as default for easier user-mode containers
• Fix package @ file:// with quoted (URL style) links should not be ignored
• Fix name not escaped as regex (all services "get_all" use regex for name)
• Fix second .ssh temp mount fails if container changes the files inside
• Fix GCP load balancer does not forward GET request body (allow changing default request action to PUT/POST/GET. See api.http.default_method or CLEARML_API_DEFAULT_REQ_METHOD)
• K8s glue
  • Fix resolving k8s pending queue may cause a queue with a UUID name to be created
  • Fix template namespace should override default namespace
  • Fix extra_bash_init_cmd location in initial bash script
  • Fix debug mode
• Fixed documentation (#117)

PyPI v1.3.0 - ClearML

New Features and Improvements

• Support private repos from requirements.txt file (#107, thanks @nielstenboom!)
• Bump PyJWT version due to "Key confusion through non-blocklisted public key formats" vulnerability
• Add support for additional command line arguments in k8s glue example
• Add Python 3.10 support

Bug Fixes

• Fix git unsafe directory issue (disable check on cached vcs folder)
• Fix dynamic GPUs with "all" GPUs on the same worker
• Fix broken pytorch setuptools incompatibility (force setuptools < 59 if torch is below 1.11)
• Fix setuptools requirement issue by making sure that if we have "setuptools" in the original required packages, we preserve the line in the pip freeze list
• Fix optional priority packaged always compare lower case package name
• Fix potential requirements installation failure by making pygobject an optional package (i.e. if installation fails continue the Task package environment setup)
• Fix repository URL contains credentials even when agent.force_git_ssh_protocol: true

PyPI v1.2.3 - ClearML

Bug Fixes

• Fix PYTHONPATH is overwritten when executing a task (append to it instead)
• Fix pytorch package is reinstalled when the same version is already installed
• Fix copying configuration sets an empty worker name
• Protect dynamic GPUs from failing to parse worker GPU index

PyPI v1.2.2 - ClearML

Bug Fixes

• Fix CLEARML_AGENT_SKIP_PIP_VENV_INSTALL fails to find python executable
• Fix apt-get update failure causes apt-get install not to be executed

PyPI v1.2.1 - ClearML

New Features and Improvements

• Update S3 bucket verify option for minio #83 (thanks @pshowbs!)
• Add environment variable for request method #91 (thanks @mmiller-max!)
• Add additional k8s-glue dockerfiles #94 (thanks @xadcoh!)
• Update default docker image to nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
• Add support for custom docker image resolving using the agent.default_docker.match_rules configuration setting (see here)
• Add agent.force_git_root_python_path configuration setting to force adding the git repository root folder to the PYTHONPATH (if set working directory is not added to the PYHTONPATH)
• Add build --force-docker command line argument to the to allow ignoring task container data
• Add agent.poetry_version configuration setting to specify poetry version (and force installation of poetry if missing, see here)
• Add custom build script support
• Add extra configurations when starting daemon
• Add agent.package_manager.force_original_requirements configuration option, allowing to only use original requirements produced by local execution (note that using this configuration option prevents editing installed packages using the UI)
• Add support for the CLEARML_AGENT_PROPAGATE_EXITCODE environment variabe. Set this variable to 1 to allow ClearML Agent to return a nonzero exit code on failure
• Update clearml-agent init (use app.clear.ml as default server, add git token references)

Bug Fixes

• Fix virtualenv python interpreter used #98 (thanks @idantene!)
• Fix typing package incorrectly required for Python>3.5 #103 (thanks @Honzys!)
• Fix symbolic links not copied from cached VCS into working copy (windows platform will result with default copy content instead of original symbolic link) #89
• Fix agent fails to check out code from main branch when branch/commit is not explicitly specified clearml/clearml#551
• Fix git+git:// requirements
• Fix default_python calculation (and verbosity)
• Fix using deprecated abc support (Python 3.10 compatibility)
• Fix no default value for CLEARML_API_DEFAULT_REQ_METHOD causes ValueError if not specified
• Fix agent.hide_docker_command_env_vars mode to include URL passwords and handle environment vars containing docker commands
• Fix conda package manager listed packages with local links (@ file://) should ignore the local package if it does not exist
• Fix cuda patch version support in conda
• Fix agent attempts to check out code when in standalone mode
• Fix FORCE_LOCAL_CLEARML_AGENT_WHEEL environment variable handling when running from a Windows host
• Fix user-provided " is unnecessarily replaced to \\"
• Fix token is not propagated to docker in case credentials are not available
• Fix PyTorch aarch64 and windows support
• Fix VCS packages are reinstalled when the same commit version is already installed
• Fix git packages are installed even if commit is given and is preinstalled when using cached virtual environment

PyPI v1.1.2 - ClearML Agent

Bug Fixes

• This release fixes the six conflict with the new pathlib2 version 2.3.7 and up.

PyPI v1.1.1 - ClearML Agent

Features and Bug Fixes

• Add support for truncating task log file after reporting to server using agent.truncate_task_output_files configuration setting
• Fix PyJWT resiliency support
• Fix --stop checking default queue tag (#80)
• Fix queue tag default does not exist and --queue not specified (try queue named "default")
• Fix Python 3.5 compatibility
• Fix Python 2.7 support for PyTorch