Skip to content

Commit 3f88f22

Browse files
Yi (AIML) Qinchanglan
authored andcommitted
remove unused flag that causing gke runner fail
GitOrigin-RevId: e6fcc69
1 parent 39f69bc commit 3f88f22

File tree

191 files changed

+415
-405
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

191 files changed

+415
-405
lines changed

.circleci/config.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ jobs:
1515
- setup_remote_docker:
1616
docker_layer_caching: false
1717
- run: pip install --upgrade pip
18-
# TODO(markblee): Remove gcp,vertexai_tensorboard from CI. (needed by pytype)
18+
# TODO: Remove gcp,vertexai_tensorboard from CI. (needed by pytype)
1919
- run: pip install '.[core,dev,grain,gcp,vertexai_tensorboard,open_api]'
2020
# pylint uses approx 12GB of memory during this run, look into split to decrease?
2121
- run: pre-commit run --all-files
@@ -33,7 +33,7 @@ jobs:
3333
command: |
3434
circleci tests glob "axlearn/**/*_test.py" > pytest_files.txt
3535
36-
# TODO(ya5ut,markblee): assess --split-by=timing
36+
# TODO: assess --split-by=timing
3737
cat pytest_files.txt | circleci tests split --split-by=name > pytest_files_split.txt
3838
3939
set -o xtrace

.github/workflows/pre-commit.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,7 @@ jobs:
1313
python-version: '3.10'
1414
cache: 'pip'
1515
- run: pip install --upgrade pip
16-
# TODO(markblee): Remove gcp,vertexai_tensorboard from CI. (needed by pytype)
16+
# TODO: Remove gcp,vertexai_tensorboard from CI. (needed by pytype)
1717
- run: pip install '.[core,dev,grain,gcp,vertexai_tensorboard,open_api]'
1818
# pylint uses approx 12GB of memory during this run, look into split to decrease?
1919
- run: |

.pylintrc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ persistent=no
2424
# but the quotes also seem to have disabled the plugin because it flags a lot of
2525
# noncompliant docstrings when the quotes are removed.
2626
# So we disable it for now.
27-
# TODO (markblee or apghml) Fix the docstrings and reenable pylint.
27+
# TODO Fix the docstrings and reenable pylint.
2828
# load-plugins=pylint.extensions.docparams
2929

3030
# Use multiple processes to speed up Pylint.
@@ -283,7 +283,7 @@ generated-members="googleapiclient.*,numpy.*,torch.*,sentencepiece.*,jaxlib.xla_
283283
# Maximum number of characters on a single line.
284284
max-line-length=100
285285

286-
# TODO(https://github.com/PyCQA/pylint/issues/3352): Direct pylint to exempt
286+
# TODO: Direct pylint to exempt
287287
# lines made too long by directives to pytype.
288288

289289
# Regexp for a line that is allowed to be longer than the limit.

CONTRIBUTING.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -70,7 +70,7 @@ Additionally, include the copyright notice of the original source in the [header
7070
## Leaving TODOs
7171

7272
In some cases it's useful to track future work ("TODOs").
73-
TODOs should have the format `TODO(username1,username2)` indicating the contributor(s) responsible for addressing the TODO.
73+
TODOs should have the format `TODO` indicating the contributor(s) responsible for addressing the TODO.
7474
Please use your actual Github username as opposed to an alias to avoid ambiguity.
7575

7676
For larger work items, consider creating a Github issue to track progress.

Dockerfile

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ RUN pip install --upgrade pip && pip install uv flit && pip cache purge
3838
# Leverage multi-stage build for unit tests.
3939
FROM base AS ci
4040

41-
# TODO(markblee): Remove gcp,vertexai_tensorboard from CI.
41+
# TODO: Remove gcp,vertexai_tensorboard from CI.
4242
RUN uv pip install .[core,dev,grain,gcp,vertexai_tensorboard,open_api] && uv cache clean
4343
COPY . .
4444

@@ -55,8 +55,8 @@ RUN ./run_tests.sh $SKIP_PRECOMMIT "${PYTEST_FILES}"
5555

5656
FROM base AS bastion
5757

58-
# TODO(markblee): Consider copying large directories separately, to cache more aggressively.
59-
# TODO(markblee): Is there a way to skip the "production" deps?
58+
# TODO: Consider copying large directories separately, to cache more aggressively.
59+
# TODO: Is there a way to skip the "production" deps?
6060
COPY . /root/
6161
RUN uv pip install .[core,gcp,vertexai_tensorboard] && uv cache clean
6262

@@ -98,7 +98,7 @@ COPY . .
9898

9999
FROM base AS gpu
100100

101-
# TODO(markblee): Support extras.
101+
# TODO: Support extras.
102102
ENV UV_FIND_LINKS=https://storage.googleapis.com/jax-releases/jax_cuda_releases.html
103103
# Enable the CUDA repository and install the required libraries (libnvrtc.so)
104104
RUN curl -o cuda-keyring_1.1-1_all.deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/cuda-keyring_1.1-1_all.deb && \

axlearn/audio/decoder_asr.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -63,7 +63,7 @@ def _is_valid_ctc_seq(
6363
whether a label is a padding. Note that at the moment, `target_paddings`
6464
must be left-justified, i.e., it must starts with 0 and followed by 1, and
6565
not transition back to 0.
66-
TODO(yqw): support generic target_paddings.
66+
TODO: support generic target_paddings.
6767
6868
Returns:
6969
A float tensor of [batch_size, ] indicating if each (input, label) pair is valid,

axlearn/audio/decoder_asr_test.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -526,7 +526,7 @@ def _check_summary(
526526
msg = f"mismatch in {name}: {summary_collection[name]} vs {value}"
527527
self.assertEqual(summary_collection[name], value, msg)
528528

529-
@set_threefry_partitionable(False) # TODO(yongqiang): update for threefry_partitionable True
529+
@set_threefry_partitionable(False) # TODO: update for threefry_partitionable True
530530
def test_forward_summary(self):
531531
input_dim, vocab_size = 16, 20
532532
cfg: CTCDecoderModel.Config = CTCDecoderModel.default_config().set(
@@ -786,7 +786,7 @@ def jit_method(inputs, prng_key, method, logits_modifier=None, num_decodes=None)
786786
)
787787
self.assertNestedAllClose(greedy_outputs.scores[:, 0], beam_search_outputs.scores[:, 0])
788788

789-
@set_threefry_partitionable(False) # TODO(markblee): update for threefry_partitionable True
789+
@set_threefry_partitionable(False) # TODO: update for threefry_partitionable True
790790
def test_prefix_merger(self):
791791
# Use a small vocab_size to encourage similar prefixes.
792792
input_dim, vocab_size, num_decodes = 6, 3, 4
@@ -1159,7 +1159,7 @@ def _set_up_transducer(
11591159
),
11601160
(jnp.array([[9, 11, 8, 5, 2, -1, -1, -1]]), True),
11611161
)
1162-
@set_threefry_partitionable(False) # TODO(Luzy): update for threefry_partitionable True
1162+
@set_threefry_partitionable(False) # TODO: update for threefry_partitionable True
11631163
def test_forward(self, target_labels, tile_input):
11641164
"""Tests that loss computation excludes empty sequence, and respects paddings."""
11651165
am_dim, bos_id = 4, 1

axlearn/audio/evaler_asr.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -222,7 +222,7 @@ def _compute_word_error_rate(
222222
denom = max(1.0, num_words)
223223
metrics = self._scorer(hyp_words, ref_words)
224224
# NOTE: we drop utterance of empty references in WER metrics.
225-
# TODO(zhiyunlu): investigate whether we should keep empty references.
225+
# TODO: investigate whether we should keep empty references.
226226
self._metric_accumulator.update(
227227
{
228228
"word_errors/wer": WeightedScalar(metrics.num_total / denom, num_words),

axlearn/audio/frontend.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -163,7 +163,7 @@ class Config(BaseFrontend.Config):
163163
output_transformation: Optional[InstantiableConfig[StageFn]] = None
164164
# Floor of melfilter bank energy to prevent log(0).
165165
# Recommend to set to 1e-6 or smaller to capture low-energy signals.
166-
# TODO(markblee): Deprecate this in favor of setting `mel_floor` on `spectrogram`.
166+
# TODO: Deprecate this in favor of setting `mel_floor` on `spectrogram`.
167167
mel_floor: Required[float] = REQUIRED
168168
# Pre-emphasis filter. If None, skips pre-emphasis.
169169
pre_emphasis: Optional[InstantiableConfig[StageFn]] = config_for_function(
@@ -221,9 +221,9 @@ def forward(self, inputs: Tensor, *, paddings: Tensor) -> dict[str, Tensor]:
221221
- outputs: A Tensor of shape [batch, num_frames, num_filters, 1].
222222
- paddings: A 0/1 Tensor of shape [batch, num_frames].
223223
"""
224-
# TODO(markblee): Make these configurable as needed.
224+
# TODO: Make these configurable as needed.
225225
frames = frame(inputs, frame_size=self._frame_size, hop_size=self._hop_size)
226-
# TODO(dhwang2): Currently, a partial frame is padded. Explore it later.
226+
# TODO: Currently, a partial frame is padded. Explore it later.
227227
out_paddings = frame_paddings(
228228
paddings,
229229
frame_size=self._frame_size,

axlearn/audio/frontend_test.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -239,7 +239,7 @@ def test_small_input(self, input_dtype):
239239
rtol=6e-4,
240240
)
241241

242-
@set_threefry_partitionable(False) # TODO(Luzy): update for threefry_partitionable True
242+
@set_threefry_partitionable(False) # TODO: update for threefry_partitionable True
243243
def test_fft(self):
244244
sample_rate, batch_size, max_seconds = 16_000, 8, 13
245245
num_filters, frame_size_ms, hop_size_ms = 80, 25, 10

0 commit comments

Comments
 (0)