Skip to content

run-task hangs when cloning a github repository with LFS files and git-lfs installed #775

@bhearsum

Description

@bhearsum

We had an odd issue in some translations tasks last week: they suddenly started requiring credentials to clone the repository. It's unclear why this happened (the repository is still public...), but nevertheless it highlighted the fact that run-task simply hangs in this scenario, and wastes resources until the task times out:

[vcs 2025-09-09T18:43:02.107+00:00] executing ['git', 'clone', 'https://github.com/mozilla/translations', '/builds/worker/checkouts/vcs']
[vcs 2025-09-09T18:43:02.109+00:00] Cloning into '/builds/worker/checkouts/vcs'...
Username for 'https://github.com': [taskcluster 2025-09-09T18:59:21.223Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/Mir70a0hRim0qvIfTjAcRw/0/on/us-west1-b/3099223815166478912/until/1757445561.163
[taskcluster 2025-09-09T19:16:21.206Z] [taskcluster-proxy] Successfully refreshed taskcluster-proxy credentials: task-client/Mir70a0hRim0qvIfTjAcRw/0/on/us-west1-b/3099223815166478912/until/1757446581.188
...
...
...
[taskcluster 2025-09-15T10:08:41.854Z] Command ABORTED after 135h25m43.489856784s: process aborted
[taskcluster 2025-09-15T10:08:41.854Z]  Average Available System Memory: 49.86 GiB
[taskcluster 2025-09-15T10:08:41.854Z]       Average System Memory Used: 568.96 MiB
[taskcluster 2025-09-15T10:08:41.854Z]          Peak System Memory Used: 886.15 MiB
[taskcluster 2025-09-15T10:08:41.854Z]              Total System Memory: 50.98 GiB
[taskcluster 2025-09-15T10:08:41.854Z] 
[taskcluster 2025-09-15T10:08:41.866Z] === Task Finished ===

We should find a way to detect this and abort.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions