Skip to content

WIP: experiment generating kinds in parallel (multiprocess)

410f32b
Select commit
Loading
Failed to load commit list.
Closed

WIP: experiment generating kinds in parallel (multiprocess) #717

WIP: experiment generating kinds in parallel (multiprocess)
410f32b
Select commit
Loading
Failed to load commit list.
firefoxci-taskcluster / doc-generate succeeded Jul 4, 2025 in 2m 42s

FirefoxCI (pull_request)

Generate documentation and fail on warnings (Treeherder push)

Details

View task in Taskcluster | View logs in Taskcluster | View task group in Taskcluster

Task Status

Started: 2025-07-04T14:11:24.756Z
Resolved: 2025-07-04T14:12:13.427Z
Task Execution Time: 48 seconds, 671 milliseconds
Task Status: completed
Reason Resolved: completed
RunId: 0

Artifacts

- public/logs/live_backing.log
- public/logs/live.log


[taskcluster 2025-07-04 14:11:25.021Z] Task ID: YARD7IMJRAqqu2rpAURoeQ
[taskcluster 2025-07-04 14:11:25.021Z] Worker ID: 2826093869723704907
[taskcluster 2025-07-04 14:11:25.021Z] Worker Group: us-central1-c
[taskcluster 2025-07-04 14:11:25.021Z] Worker Node Type: projects/887720501152/machineTypes/c2-standard-4
[taskcluster 2025-07-04 14:11:25.021Z] Worker Pool: taskgraph-t/linux-gcp
[taskcluster 2025-07-04 14:11:25.021Z] Worker Version: 38.0.5
[taskcluster 2025-07-04 14:11:25.021Z] Public IP: 34.42.85.137
[taskcluster 2025-07-04 14:11:25.021Z] Hostname: taskgraph-t-linux-gcp-ggvjc1k5saiolflveim1eg
[taskcluster 2025-07-04 14:11:25.021Z] using cache "taskgraph-level-1-uv-v3-f59e202b9f4c189775df-LUZHGlaCTaeKGo37LLFKnw" -> /builds/worker/.task-cache/uv
[taskcluster 2025-07-04 14:11:25.021Z] using cache "taskgraph-level-1-checkouts-v3-f59e202b9f4c189775df-LUZHGlaCTaeKGo37LLFKnw" -> /builds/worker/checkouts

[taskcluster 2025-07-04 14:11:27.717Z] Downloading artifact "public/image.tar.zst" from task ID: LUZHGlaCTaeKGo37LLFKnw.
[taskcluster 2025-07-04 14:11:31.055Z] Downloaded artifact successfully.
[taskcluster 2025-07-04 14:11:31.056Z] Downloaded 255.333 mb
[taskcluster 2025-07-04 14:11:31.057Z] Decompressing downloaded image
[taskcluster 2025-07-04 14:11:33.351Z] Loading docker image from downloaded archive.
[taskcluster 2025-07-04 14:11:54.649Z] Image 'public/image.tar.zst' from task 'LUZHGlaCTaeKGo37LLFKnw' loaded.  Using image ID sha256:d155ada461c10aa23879a984fb5ba8741435bd7d5423017d32fcd49c26d1efe8.
[taskcluster 2025-07-04 14:11:54.825Z] === Task Starting ===
[setup 2025-07-04T14:11:57.223+00:00] run-task started in /
[setup 2025-07-04T14:11:57.223+00:00] Invoked by command: --ci-checkout=/builds/worker/checkouts/vcs/ --task-cwd /builds/worker/checkouts/vcs -- bash -cx uv run make html
[setup 2025-07-04T14:11:57.223+00:00] Python version: 3.11.2
[cache 2025-07-04T14:11:57.224+00:00] cache /builds/worker/.task-cache/uv is empty; writing requirements: gid=1000 uid=1000 version=1
[cache 2025-07-04T14:11:57.225+00:00] cache /builds/worker/checkouts is empty; writing requirements: gid=1000 uid=1000 version=1
[volume 2025-07-04T14:11:57.225+00:00] volume /builds/worker/.task-cache/uv is a cache
[volume 2025-07-04T14:11:57.225+00:00] volume /builds/worker/checkouts is a cache
[setup 2025-07-04T14:11:57.225+00:00] running as worker:worker
[vcs 2025-07-04T14:11:57.225+00:00] executing ['git', 'config', '--global', '--add', 'safe.directory', '/builds/worker/checkouts/vcs']
[vcs 2025-07-04T14:11:57.228+00:00] executing ['git', 'clone', 'https://github.com/taskcluster/taskgraph', '/builds/worker/checkouts/vcs']
[vcs 2025-07-04T14:11:57.229+00:00] Cloning into '/builds/worker/checkouts/vcs'...
[vcs 2025-07-04T14:11:58.058+00:00] executing ['git', 'fetch', '--no-tags', 'https://github.com/ahal/taskgraph', 'parallel']
[vcs 2025-07-04T14:11:58.316+00:00] From https://github.com/ahal/taskgraph
[vcs 2025-07-04T14:11:58.316+00:00]  * branch              parallel   -> FETCH_HEAD
[vcs 2025-07-04T14:11:58.318+00:00] executing ['git', 'checkout', '-f', '-B', 'parallel', '410f32bbbab5eb748ffee6616a219f9a1ec67675']
[vcs 2025-07-04T14:11:58.335+00:00] Switched to a new branch 'parallel'
[vcs 2025-07-04T14:11:58.335+00:00] cleaning git checkout...
[vcs 2025-07-04T14:11:58.335+00:00] executing ['git', 'clean', '-nxdff']
[vcs 2025-07-04T14:11:58.338+00:00] removing []
[vcs 2025-07-04T14:11:58.338+00:00] successfully cleaned git checkout!
[vcs 2025-07-04T14:11:58.339+00:00] TinderboxPrint:<a href='https://github.com/ahal/taskgraph/commit/410f32bbbab5eb748ffee6616a219f9a1ec67675' title='Built from taskgraph commit 410f32bbbab5eb748ffee6616a219f9a1ec67675'>410f32bbbab5eb748ffee6616a219f9a1ec67675</a>
[task 2025-07-04T14:11:58.339+00:00] executing ['bash', '-cx', 'uv run make html']
[task 2025-07-04T14:11:58.340+00:00] + uv run make html
[task 2025-07-04T14:11:58.509+00:00] Using CPython 3.13.2
[task 2025-07-04T14:11:58.509+00:00] Creating virtual environment at: .venv
[task 2025-07-04T14:11:58.551+00:00]    Building pytest-taskgraph @ file:///builds/worker/checkouts/vcs/packages/pytest-taskgraph
[task 2025-07-04T14:11:58.551+00:00]    Building taskcluster-taskgraph @ file:///builds/worker/checkouts/vcs
[task 2025-07-04T14:11:58.551+00:00]    Building sphinx-taskgraph @ file:///builds/worker/checkouts/vcs/packages/sphinx-taskgraph
[task 2025-07-04T14:11:58.604+00:00] Downloading babel (9.7MiB)
[task 2025-07-04T14:11:58.604+00:00] Downloading virtualenv (5.8MiB)
[task 2025-07-04T14:11:58.604+00:00] Downloading zstandard (5.2MiB)
[task 2025-07-04T14:11:58.605+00:00] Downloading pygments (1.2MiB)
[task 2025-07-04T14:11:58.605+00:00] Downloading pyright (5.4MiB)
[task 2025-07-04T14:11:58.605+00:00] Downloading accessible-pygments (1.3MiB)
[task 2025-07-04T14:11:58.605+00:00] Downloading pydata-sphinx-theme (4.4MiB)
[task 2025-07-04T14:11:58.605+00:00] Downloading sphinx (3.4MiB)
[task 2025-07-04T14:11:59.105+00:00]  Downloaded accessible-pygments
[task 2025-07-04T14:11:59.270+00:00]  Downloaded pygments
[task 2025-07-04T14:11:59.323+00:00]  Downloaded pydata-sphinx-theme
[task 2025-07-04T14:11:59.395+00:00]  Downloaded zstandard
[task 2025-07-04T14:11:59.415+00:00]  Downloaded virtualenv
[task 2025-07-04T14:11:59.504+00:00]  Downloaded sphinx
[task 2025-07-04T14:11:59.646+00:00]  Downloaded babel
[task 2025-07-04T14:12:00.034+00:00]  Downloaded pyright
[task 2025-07-04T14:12:00.229+00:00]       Built pytest-taskgraph @ file:///builds/worker/checkouts/vcs/packages/pytest-taskgraph
[task 2025-07-04T14:12:00.253+00:00]       Built sphinx-taskgraph @ file:///builds/worker/checkouts/vcs/packages/sphinx-taskgraph
[task 2025-07-04T14:12:00.307+00:00]       Built taskcluster-taskgraph @ file:///builds/worker/checkouts/vcs
[task 2025-07-04T14:12:00.309+00:00] warning: Failed to hardlink files; falling back to full copy. This may lead to degraded performance.
[task 2025-07-04T14:12:00.309+00:00]          If the cache and target directories are on different filesystems, hardlinking may not be supported.
[task 2025-07-04T14:12:00.309+00:00]          If this is intentional, set `export UV_LINK_MODE=copy` or use `--link-mode=copy` to suppress this warning.
[task 2025-07-04T14:12:00.555+00:00] Installed 81 packages in 246ms
[task 2025-07-04T14:12:01.482+00:00] Running Sphinx v8.2.3
[task 2025-07-04T14:12:01.483+00:00] loading translations [en]... done
[task 2025-07-04T14:12:02.792+00:00] making output directory... done
[task 2025-07-04T14:12:02.994+00:00] building [mo]: targets for 0 po files that are out of date
[task 2025-07-04T14:12:02.994+00:00] writing output... 
[task 2025-07-04T14:12:02.998+00:00] building [html]: targets for 43 source files that are out of date
[task 2025-07-04T14:12:03.002+00:00] updating environment: [new config] 43 added, 0 changed, 0 removed
[task 2025-07-04T14:12:03.002+00:00] reading sources... [  2%] concepts/index
[task 2025-07-04T14:12:03.021+00:00] reading sources... [  5%] concepts/kind
[task 2025-07-04T14:12:03.027+00:00] reading sources... [  7%] concepts/loading
[task 2025-07-04T14:12:03.033+00:00] reading sources... [  9%] concepts/optimization
[task 2025-07-04T14:12:03.044+00:00] reading sources... [ 12%] concepts/scopes
[task 2025-07-04T14:12:03.068+00:00] reading sources... [ 14%] concepts/task-graphs
[task 2025-07-04T14:12:03.087+00:00] reading sources... [ 16%] concepts/taskcluster
[task 2025-07-04T14:12:03.092+00:00] reading sources... [ 19%] concepts/transforms
[task 2025-07-04T14:12:03.108+00:00] reading sources... [ 21%] contributing
[task 2025-07-04T14:12:03.132+00:00] reading sources... [ 23%] glossary
[task 2025-07-04T14:12:03.160+00:00] reading sources... [ 26%] howto/bootstrap-taskgraph
[task 2025-07-04T14:12:03.183+00:00] reading sources... [ 28%] howto/create-actions
[task 2025-07-04T14:12:03.212+00:00] reading sources... [ 30%] howto/create-tasks
[task 2025-07-04T14:12:03.224+00:00] reading sources... [ 33%] howto/debugging
[task 2025-07-04T14:12:03.231+00:00] reading sources... [ 35%] howto/docker
[task 2025-07-04T14:12:03.257+00:00] reading sources... [ 37%] howto/index
[task 2025-07-04T14:12:03.260+00:00] reading sources... [ 40%] howto/resolve-keyed-by
[task 2025-07-04T14:12:03.274+00:00] reading sources... [ 42%] howto/run-locally
[task 2025-07-04T14:12:03.299+00:00] reading sources... [ 44%] howto/send-notifications
[task 2025-07-04T14:12:03.320+00:00] reading sources... [ 47%] howto/use-fetches
[task 2025-07-04T14:12:03.331+00:00] reading sources... [ 49%] index
[task 2025-07-04T14:12:03.351+00:00] reading sources... [ 51%] reference/cli
[task 2025-07-04T14:12:03.580+00:00] reading sources... [ 53%] reference/index
[task 2025-07-04T14:12:03.584+00:00] reading sources... [ 56%] reference/migrations
[task 2025-07-04T14:12:03.614+00:00] reading sources... [ 58%] reference/optimization-strategies
[task 2025-07-04T14:12:03.623+00:00] reading sources... [ 60%] reference/parameters
[task 2025-07-04T14:12:03.642+00:00] reading sources... [ 63%] reference/source/modules
[task 2025-07-04T14:12:03.645+00:00] reading sources... [ 65%] reference/source/taskgraph
[task 2025-07-04T14:12:04.472+00:00] reading sources... [ 67%] reference/source/taskgraph.actions
[task 2025-07-04T14:12:04.653+00:00] reading sources... [ 70%] reference/source/taskgraph.loader
[task 2025-07-04T14:12:04.670+00:00] reading sources... [ 72%] reference/source/taskgraph.optimize
[task 2025-07-04T14:12:04.796+00:00] reading sources... [ 74%] reference/source/taskgraph.transforms
[task 2025-07-04T14:12:05.350+00:00] reading sources... [ 77%] reference/source/taskgraph.transforms.run
[task 2025-07-04T14:12:05.534+00:00] reading sources... [ 79%] reference/source/taskgraph.util
[task 2025-07-04T14:12:06.614+00:00] reading sources... [ 81%] reference/transforms/chunking
[task 2025-07-04T14:12:06.621+00:00] reading sources... [ 84%] reference/transforms/from_deps
[task 2025-07-04T14:12:06.644+00:00] reading sources... [ 86%] reference/transforms/index
[task 2025-07-04T14:12:06.647+00:00] reading sources... [ 88%] reference/transforms/matrix
[task 2025-07-04T14:12:06.663+00:00] reading sources... [ 91%] reference/transforms/task_context
[task 2025-07-04T14:12:06.675+00:00] reading sources... [ 93%] tutorials/connecting-taskcluster
[task 2025-07-04T14:12:06.706+00:00] reading sources... [ 95%] tutorials/creating-a-task-graph
[task 2025-07-04T14:12:06.722+00:00] reading sources... [ 98%] tutorials/getting-started
[task 2025-07-04T14:12:06.737+00:00] reading sources... [100%] tutorials/index
[task 2025-07-04T14:12:06.740+00:00] 
[task 2025-07-04T14:12:06.740+00:00] looking for now-outdated files... none found
[task 2025-07-04T14:12:06.756+00:00] pickling environment... done
[task 2025-07-04T14:12:06.757+00:00] checking consistency... done
[task 2025-07-04T14:12:06.759+00:00] preparing documents... done
[task 2025-07-04T14:12:06.759+00:00] copying assets... 
[task 2025-07-04T14:12:06.759+00:00] copying downloadable files... [100%] tutorials/example-taskcluster.yml
[task 2025-07-04T14:12:06.760+00:00] 
[task 2025-07-04T14:12:06.760+00:00] copying static files... 
[task 2025-07-04T14:12:06.764+00:00] Writing evaluated template result to /builds/worker/checkouts/vcs/docs/_build/html/_static/language_data.js
[task 2025-07-04T14:12:06.768+00:00] Writing evaluated template result to /builds/worker/checkouts/vcs/docs/_build/html/_static/basic.css
[task 2025-07-04T14:12:06.771+00:00] Writing evaluated template result to /builds/worker/checkouts/vcs/docs/_build/html/_static/documentation_options.js
[task 2025-07-04T14:12:06.800+00:00] copying static files: done
[task 2025-07-04T14:12:06.800+00:00] copying extra files... 
[task 2025-07-04T14:12:06.801+00:00] copying extra files: done
[task 2025-07-04T14:12:06.801+00:00] copying assets: done
[task 2025-07-04T14:12:06.801+00:00] writing output... [  2%] concepts/index
[task 2025-07-04T14:12:06.965+00:00] writing output... [  5%] concepts/kind
[task 2025-07-04T14:12:07.017+00:00] writing output... [  7%] concepts/loading
[task 2025-07-04T14:12:07.096+00:00] writing output... [  9%] concepts/optimization
[task 2025-07-04T14:12:07.149+00:00] writing output... [ 12%] concepts/scopes
[task 2025-07-04T14:12:07.213+00:00] writing output... [ 14%] concepts/task-graphs
[task 2025-07-04T14:12:07.404+00:00] writing output... [ 16%] concepts/taskcluster
[task 2025-07-04T14:12:07.449+00:00] writing output... [ 19%] concepts/transforms
[task 2025-07-04T14:12:07.514+00:00] writing output... [ 21%] contributing
[task 2025-07-04T14:12:07.581+00:00] writing output... [ 23%] glossary
[task 2025-07-04T14:12:07.630+00:00] writing output... [ 26%] howto/bootstrap-taskgraph
[task 2025-07-04T14:12:07.697+00:00] writing output... [ 28%] howto/create-actions
[task 2025-07-04T14:12:07.773+00:00] writing output... [ 30%] howto/create-tasks
[task 2025-07-04T14:12:07.829+00:00] writing output... [ 33%] howto/debugging
[task 2025-07-04T14:12:07.882+00:00] writing output... [ 35%] howto/docker
[task 2025-07-04T14:12:07.956+00:00] writing output... [ 37%] howto/index
[task 2025-07-04T14:12:08.140+00:00] writing output... [ 40%] howto/resolve-keyed-by
[task 2025-07-04T14:12:08.204+00:00] writing output... [ 42%] howto/run-locally
[task 2025-07-04T14:12:08.272+00:00] writing output... [ 44%] howto/send-notifications
[task 2025-07-04T14:12:08.336+00:00] writing output... [ 47%] howto/use-fetches
[task 2025-07-04T14:12:08.388+00:00] writing output... [ 49%] index
[task 2025-07-04T14:12:08.472+00:00] writing output... [ 51%] reference/cli
[task 2025-07-04T14:12:08.580+00:00] writing output... [ 53%] reference/index
[task 2025-07-04T14:12:08.790+00:00] writing output... [ 56%] reference/migrations
[task 2025-07-04T14:12:08.860+00:00] writing output... [ 58%] reference/optimization-strategies
[task 2025-07-04T14:12:08.910+00:00] writing output... [ 60%] reference/parameters
[task 2025-07-04T14:12:08.978+00:00] writing output... [ 63%] reference/source/modules
[task 2025-07-04T14:12:09.058+00:00] writing output... [ 65%] reference/source/taskgraph
[task 2025-07-04T14:12:09.466+00:00] writing output... [ 67%] reference/source/taskgraph.actions
[task 2025-07-04T14:12:09.563+00:00] writing output... [ 70%] reference/source/taskgraph.loader
[task 2025-07-04T14:12:09.609+00:00] writing output... [ 72%] reference/source/taskgraph.optimize
[task 2025-07-04T14:12:09.693+00:00] writing output... [ 74%] reference/source/taskgraph.transforms
[task 2025-07-04T14:12:09.854+00:00] writing output... [ 77%] reference/source/taskgraph.transforms.run
[task 2025-07-04T14:12:09.949+00:00] writing output... [ 79%] reference/source/taskgraph.util
[task 2025-07-04T14:12:10.272+00:00] writing output... [ 81%] reference/transforms/chunking
[task 2025-07-04T14:12:10.327+00:00] writing output... [ 84%] reference/transforms/from_deps
[task 2025-07-04T14:12:10.558+00:00] writing output... [ 86%] reference/transforms/index
[task 2025-07-04T14:12:10.604+00:00] writing output... [ 88%] reference/transforms/matrix
[task 2025-07-04T14:12:10.670+00:00] writing output... [ 91%] reference/transforms/task_context
[task 2025-07-04T14:12:10.727+00:00] writing output... [ 93%] tutorials/connecting-taskcluster
[task 2025-07-04T14:12:10.802+00:00] writing output... [ 95%] tutorials/creating-a-task-graph
[task 2025-07-04T14:12:10.870+00:00] writing output... [ 98%] tutorials/getting-started
[task 2025-07-04T14:12:10.924+00:00] writing output... [100%] tutorials/index
[task 2025-07-04T14:12:10.973+00:00] 
[task 2025-07-04T14:12:11.218+00:00] generating indices... genindex py-modindex done
[task 2025-07-04T14:12:11.263+00:00] writing additional pages... search done
[task 2025-07-04T14:12:11.276+00:00] dumping search index in English (code: en)... done
[task 2025-07-04T14:12:11.282+00:00] dumping object inventory... done
[task 2025-07-04T14:12:11.317+00:00] build succeeded.
[task 2025-07-04T14:12:11.317+00:00] 
[task 2025-07-04T14:12:11.317+00:00] The HTML pages are in docs/_build/html.
[taskcluster 2025-07-04 14:12:12.923Z] === Task Finished ===
[taskcluster 2025-07-04 14:12:12.924Z] Successful task run with exit code: 0 completed in 47.904 seconds