Skip to content

Commit 1d853b4

Browse files
achave11-ucscachave11-ucsc
committed
[r a R] Promotion 2026-01-06 prod (#7678, PR #7681)
2 parents eab0f07 + 00b8d24 commit 1d853b4

File tree

73 files changed

+1451
-1285
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

73 files changed

+1451
-1285
lines changed

‎.github/PULL_REQUEST_TEMPLATE/anvilprod-hotfix.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -70,6 +70,9 @@ Linked issue: #0000
7070
- [ ] Pushed PR branch to GitLab `anvilprod` <sub>or PR is labeled `no sandbox`</sub>
7171
- [ ] Build passes in `hammerbox` deployment <sub>or PR is labeled `no sandbox`</sub>
7272
- [ ] Reviewed build logs for anomalies in `hammerbox` deployment <sub>or PR is labeled `no sandbox`</sub>
73+
- [ ] Deleted unreferenced indices in `hammerbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `hammerbox`</sub>
74+
- [ ] Started reindex in `hammerbox` <sub>or this PR is not labeled `reindex:anvilprod`</sub>
75+
- [ ] Checked for failures in `hammerbox` <sub>or this PR is not labeled `reindex:anvilprod`</sub>
7376

7477

7578
### Operator (merge the branch)

‎.github/PULL_REQUEST_TEMPLATE/anvilprod-promotion.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -85,6 +85,9 @@ Linked issue: #0000
8585
- [ ] Pushed PR branch to GitLab `anvilprod` <sub>or PR is labeled `no sandbox`</sub>
8686
- [ ] Build passes in `hammerbox` deployment <sub>or PR is labeled `no sandbox`</sub>
8787
- [ ] Reviewed build logs for anomalies in `hammerbox` deployment <sub>or PR is labeled `no sandbox`</sub>
88+
- [ ] Deleted unreferenced indices in `hammerbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `hammerbox`</sub>
89+
- [ ] Started reindex in `hammerbox` <sub>or this PR is not labeled `reindex:anvilprod`</sub>
90+
- [ ] Checked for failures in `hammerbox` <sub>or this PR is not labeled `reindex:anvilprod`</sub>
8891

8992

9093
### Operator (merge the branch)

‎.github/PULL_REQUEST_TEMPLATE/backport.md‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -61,6 +61,12 @@ This is the PR template for backport PRs against `develop`.
6161
- [ ] Build passes in `anvilbox` deployment <sub>or PR is labeled `no sandbox`</sub>
6262
- [ ] Reviewed build logs for anomalies in `sandbox` deployment <sub>or PR is labeled `no sandbox`</sub>
6363
- [ ] Reviewed build logs for anomalies in `anvilbox` deployment <sub>or PR is labeled `no sandbox`</sub>
64+
- [ ] Deleted unreferenced indices in `sandbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `sandbox`</sub>
65+
- [ ] Deleted unreferenced indices in `anvilbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `anvilbox`</sub>
66+
- [ ] Started reindex in `sandbox` <sub>or this PR is not labeled `reindex:dev`</sub>
67+
- [ ] Started reindex in `anvilbox` <sub>or this PR is not labeled `reindex:anvildev`</sub>
68+
- [ ] Checked for failures in `sandbox` <sub>or this PR is not labeled `reindex:dev`</sub>
69+
- [ ] Checked for failures in `anvilbox` <sub>or this PR is not labeled `reindex:anvildev`</sub>
6470

6571

6672
### Operator (merge the branch)

‎.github/pull_request_template.md‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -148,8 +148,8 @@ Note that after requesting changes, the PR must be assigned to only the author.
148148
- [ ] Build passes in `anvilbox` deployment <sub>or PR is labeled `no sandbox`</sub>
149149
- [ ] Reviewed build logs for anomalies in `sandbox` deployment <sub>or PR is labeled `no sandbox`</sub>
150150
- [ ] Reviewed build logs for anomalies in `anvilbox` deployment <sub>or PR is labeled `no sandbox`</sub>
151-
- [ ] Deleted unreferenced indices in `sandbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `dev`</sub>
152-
- [ ] Deleted unreferenced indices in `anvilbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `anvildev`</sub>
151+
- [ ] Deleted unreferenced indices in `sandbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `sandbox`</sub>
152+
- [ ] Deleted unreferenced indices in `anvilbox` <sub>or this PR does not remove catalogs or otherwise causes unreferenced indices in `anvilbox`</sub>
153153
- [ ] Started reindex in `sandbox` <sub>or this PR is not labeled `reindex:dev`</sub>
154154
- [ ] Started reindex in `anvilbox` <sub>or this PR is not labeled `reindex:anvildev`</sub>
155155
- [ ] Checked for failures in `sandbox` <sub>or this PR is not labeled `reindex:dev`</sub>

‎.github/pull_request_template.md.template.py‎

Lines changed: 14 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -27,6 +27,7 @@
2727
from more_itertools import (
2828
flatten,
2929
stagger,
30+
unzip,
3031
)
3132

3233
from azul import (
@@ -823,10 +824,10 @@ def emit(t: T, target_branch: str):
823824
'alt': iif(t is T.upgrade, None, 'or PR is labeled `no sandbox`')
824825
}
825826
]),
826-
# zip() is used to interleave the steps for each deployment so
827+
# unzip() is used to interleave the steps for each deployment so
827828
# that first, step 1 is done for all deployments, then step 2
828829
# for all of them, and so on.
829-
*flatten(zip(*(
830+
*flatten(unzip(
830831
[
831832
{
832833
'type': 'cli',
@@ -843,12 +844,12 @@ def emit(t: T, target_branch: str):
843844
'content': f'Reviewed build logs for anomalies in `{s}` deployment',
844845
'alt': iif(t is T.upgrade, None, 'or PR is labeled `no sandbox`')
845846
},
846-
*iif(t is T.default, [
847+
*iif(t is not T.upgrade, [
847848
{
848849
'type': 'cli',
849850
'content': f'Deleted unreferenced indices in `{s}`',
850851
'alt': f'or this PR does not remove catalogs '
851-
f'or otherwise causes unreferenced indices in `{d}`'
852+
f'or otherwise causes unreferenced indices in `{s}`'
852853
},
853854
{
854855
'type': 'cli',
@@ -864,7 +865,7 @@ def emit(t: T, target_branch: str):
864865
]
865866
for i, (d, s) in enumerate(t.target_deployments(target_branch).items())
866867
if s is not None
867-
))),
868+
)),
868869
{
869870
'type': 'h2',
870871
'content': 'Operator (merge the branch)'
@@ -1003,10 +1004,10 @@ def emit(t: T, target_branch: str):
10031004
'type': 'h2',
10041005
'content': 'Operator (reindex)'
10051006
},
1006-
# zip() is used to interleave the steps for each deployment so
1007+
# unzip() is used to interleave the steps for each deployment so
10071008
# that first, step 1 is done for all deployments, then step 2
10081009
# for all of them, and so on.
1009-
*flatten(zip(*(
1010+
*flatten(unzip(
10101011
[
10111012
*[
10121013
{
@@ -1037,7 +1038,7 @@ def emit(t: T, target_branch: str):
10371038
]
10381039
]
10391040
for d, s in t.target_deployments(target_branch).items()
1040-
))),
1041+
)),
10411042
*[
10421043
{
10431044
'type': 'cli',
@@ -1076,7 +1077,10 @@ def emit(t: T, target_branch: str):
10761077
'type': 'h2',
10771078
'content': 'Operator (mirroring)'
10781079
},
1079-
*flatten(zip(*(
1080+
# unzip() is used to interleave the steps for each deployment so
1081+
# that first, step 1 is done for all deployments, then step 2
1082+
# for all of them, and so on.
1083+
*flatten(unzip(
10801084
[
10811085
*[
10821086
{
@@ -1096,7 +1100,7 @@ def emit(t: T, target_branch: str):
10961100
]
10971101
]
10981102
for d, s in t.target_deployments(target_branch).items()
1099-
)))
1103+
))
11001104
]),
11011105
{
11021106
'type': 'h2',

‎.mypy.ini‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,6 @@ modules =
5353
azul.indexer.action_controller,
5454
azul.indexer.mirror_controller,
5555
azul.service.app_controller,
56-
azul.indexer.mirror_file_service,
5756
azul.digests,
5857
lambdas.indexer.app,
5958
azul.schemas,
@@ -89,6 +88,7 @@ modules =
8988
azul.indexer.transform,
9089
azul.indexer.mirror_service,
9190
azul.functions,
91+
azul.service.storage_service
9292

9393
packages =
9494
azul.openapi

‎UPGRADING.rst‎

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,6 +20,31 @@ reverted. This is all fairly informal and loosely defined. Hopefully we won't
2020
have too many entries in this file.
2121

2222

23+
#7617 Index one snapshot from upcoming lm10 release in `dev`
24+
============================================================
25+
26+
In your personal HCA deployments:
27+
28+
- Remove the ``lungmap`` catalog
29+
- Add the snapshot for project ``fdadee7e…`` to the ``lm2`` catalog
30+
31+
As always, use the sandbox deployment's ``environment.py`` as a model when
32+
upgrading personal deployments.
33+
34+
35+
#7214 Enable mirroring in anvildev and anvilbox
36+
===============================================
37+
38+
In your AnVIL personal deployments' ``environment.py`` files:
39+
40+
1. Set ``AZUL_ENABLE_MIRRORING`` to ``'1'``
41+
2. Set the ``anvil`` catalog's ``mirror_limit`` property to ``int(1.5 * 1024 ** 3)``
42+
3. Add the ``no_mirror`` flag to source ``1000G_2019_Dev_20230609_ANV5_202306121732``
43+
44+
As always, use the sandbox deployment's ``environment.py`` as a model when
45+
upgrading personal deployments.
46+
47+
2348
#7543 No mirror-able sources in anvildev/anvilbox
2449
=================================================
2550

bin/wheels/runtime/boto3-1.41.5-py3-none-any.whl renamed to bin/wheels/runtime/boto3-1.42.5-py3-none-any.whl

136 KB
Binary file not shown.

bin/wheels/runtime/botocore-1.41.5-py3-none-any.whl renamed to bin/wheels/runtime/botocore-1.42.5-py3-none-any.whl

13.7 MB
Binary file not shown.

‎bin/wheels/runtime/cachetools-6.2.2-py3-none-any.whl‎

-11.2 KB
Binary file not shown.

0 commit comments

Comments
 (0)