Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
173 commits
Select commit Hold shift + click to select a range
e211eed
[ci] Nightly for building+uploading manylinux baseimage (#59204)
andrew-anyscale Dec 16, 2025
f55c9c7
[core] internal doc for ray event exporter (#59272)
can-anyscale Dec 16, 2025
bd412da
[Data] Fix DataContext deserialization issue with StatsActor (#59471)
dragongu Dec 16, 2025
0820e69
[train] TrainController reraises AsyncioActorExit (#59461)
TimothySeah Dec 16, 2025
d6b690f
Fix: Preserve Pydantic details when serialization fails (#59401)
mgchoi239 Dec 16, 2025
a23fb12
[Core] Avoid GCS query for is_head in dashboard agent startup (#59378)
Yicheng-Lu-llll Dec 16, 2025
9c6d6ed
[Core] Lift node ip resolution before init_temp to allow temp_dir to …
Kunchd Dec 16, 2025
17f24ec
[serve] Added validation for `lookback_period_s` > metrics interval a…
vaishdho1 Dec 16, 2025
c05742d
[Serve][LLM] Add Control Plane API for Sleep/Wakeup in Ray Serve LLM …
kouroshHakha Dec 16, 2025
439d5c1
[Data][LLM] Bump max latency threshold to 140s for single_node_baseli…
nrghosh Dec 16, 2025
cde6f9e
Fix Template llm_finetuning (#59481)
as-jding Dec 16, 2025
ee57dea
[Serve] log deployment config in controller logs (#59222)
KeeProMise Dec 16, 2025
f297c98
[Serve][2/N] Add deployment-level autoscaling snapshot and event summ…
nadongjun Dec 17, 2025
4e1bae9
feat: Added RunLLM chat widget for Ray docs; disabled regular AI chat…
cszhu Dec 17, 2025
b172714
[ci][deps] removing py3.9 depsets (#59484)
elliot-barn Dec 17, 2025
a02b695
[serve][llm] add cpu support to ray serve llm (#58334)
srinarayan-srikanthan Dec 17, 2025
428f191
[ci] remove python 3.9 in version array (#59497)
aslonnie Dec 17, 2025
ff3df39
[Core] align format of ray_deps_setup.bzl (#59377)
wxwmd Dec 17, 2025
9c62043
[image] add missing cuda 12.9 for ray-extra (#59494)
aslonnie Dec 17, 2025
261beeb
[RLlib] Fix rollout fragment length calculation in AlgorithmConfig (#…
ArturNiederfahrenhorst Dec 17, 2025
cd17b02
[core] Make RPC Chaos Configurations More Readable as JSON (#58886)
dancingactor Dec 17, 2025
c20020a
[core][doc] Add token authentication internals documentation (#59299)
sampan-s-nayak Dec 17, 2025
88c8b9d
[Serve] Bug fix: controller logs are too verbose (#59501)
abrarsheikh Dec 17, 2025
fdc9e1d
[Data] Enable Concurrency cap backpressure with tuning (#59392)
srinathk10 Dec 17, 2025
b56deca
[Data] Compute Expressions-Expr Rounding (#59295)
myandpr Dec 17, 2025
65d735e
[Data] Allow specifying partitioning style or flavor in write_parquet…
wingkitlee0 Dec 17, 2025
17bbf59
[Docs] [Serve] Improve serve autoscaling docs (#59475)
marwan116 Dec 17, 2025
2fa4348
[data] fix resource allocator not respecting max resource requirement…
raulchen Dec 17, 2025
2015205
[Data] Fix `TensorArray` to Arrow tensor conversion (#59449)
alexeykudinkin Dec 17, 2025
05e7efd
[Core] Optimize open telemetry metric recording calls (#59337)
sampan-s-nayak Dec 17, 2025
10fe5f2
[llm][docs] Restore literalinclude to code example (#59520)
eicherseiji Dec 17, 2025
0affa7f
[llm][docs] Fix relative path in literalinclude (#59521)
eicherseiji Dec 17, 2025
e7ac0ee
[Serve][7/n] Add long poll metrics (#59246)
abrarsheikh Dec 18, 2025
b5e758c
[Serve][LLM] Refactor Control Plane Endpoints into Mixins (#59502)
kouroshHakha Dec 18, 2025
6117ad6
[ci]: use manylinux2014 nightly image (#59463)
andrew-anyscale Dec 18, 2025
d5f5b06
[Serve][4/n] Add replica lifecycle metrics (#59235)
abrarsheikh Dec 18, 2025
7198193
[core] Support publishing events from aggregator to gcs (#55781)
sampan-s-nayak Dec 18, 2025
673e83b
[Serve][6/n] Add app/deployment status metrics (#59244)
abrarsheikh Dec 18, 2025
e4758d3
[rllib] upgrade to gymnasium v1.2.2 (#59530)
aslonnie Dec 18, 2025
09e99ff
[ci] fix manylinux dependency breaks (#59533)
aslonnie Dec 18, 2025
b65503e
[ci][macos] Fix FileNotFoundError in cpp tests by adding missing baze…
Yicheng-Lu-llll Dec 18, 2025
7bb0fe7
[ci] removes non-multipy ml base (#59546)
aslonnie Dec 18, 2025
fbe1528
[ci] fixes manylinux related arm64 builds (#59545)
aslonnie Dec 18, 2025
224838f
[Serve][5/n] Add proxy health and request routing delay metrics (#59238)
abrarsheikh Dec 18, 2025
4aa3a5b
[Train] [Data] Add inter-execution file shuffling to enable determini…
xinyuangui2 Dec 18, 2025
311eae2
[Serve][LLM] Add Pause/Resume Control Plane API for Ray Serve LLM (#5…
kouroshHakha Dec 18, 2025
5334493
[Serve][8/n] add event loop metrics (#59535)
abrarsheikh Dec 18, 2025
1599fb7
[Serve] Make batching work with multiplexing (#59334)
abrarsheikh Dec 18, 2025
d3a9d8c
[Data][LLM] Add support for classification and scoring models in Ray …
kouroshHakha Dec 18, 2025
6e86b65
[train] Rename DatasetsSetupCallback to DatasetsCallback (#59423)
JasonLi1909 Dec 18, 2025
b5e6beb
[Feat] cancel sync actor by checking is_canceled() (#58914)
machichima Dec 18, 2025
196c678
[Core] Remove unused NODE_DEFAULT_IP constant (#59491)
Yicheng-Lu-llll Dec 18, 2025
e7ef57f
[data] Update streaming_repartition and map_batches_fusion (#59476)
xinyuangui2 Dec 19, 2025
20aa3f6
[data] Set default actor pool scale up threshold to 1.75 (#59512)
iamjustinhsu Dec 19, 2025
c2a7f92
[data/docs] Add more education around transformations (#59415)
richardliaw Dec 19, 2025
63ad404
[RLlib] remove MLAgents dependency (#59524)
kamil-kaczmarek Dec 19, 2025
7c3a6ee
Add perf metrics for 2.53.0 (#59553)
khluu Dec 19, 2025
b7c6e97
[ci] add python >= 3.10 for gymnasium to make windows CI happy (#59572)
aslonnie Dec 19, 2025
e19d4d1
[ci] upgrade twine and packaging (#59568)
aslonnie Dec 19, 2025
388d4b7
[Core] Fix incorrect task reference in test_cancel_recursive_tree ver…
Yicheng-Lu-llll Dec 19, 2025
122a994
[1/n] catalog ray serve env vars (#59470)
harshit-anyscale Dec 19, 2025
04d5455
add template for async inference (#58393)
harshit-anyscale Dec 19, 2025
b4937d1
[ci] remove requirements_buildkite.* (#59570)
aslonnie Dec 19, 2025
cc822b1
[Data] - Iceberg Datasink - Avoid deserialization from arrow array (#…
goutamvenkat-anyscale Dec 19, 2025
f3642a5
[Data] Minor clean up Read concurrency (#59422)
wingkitlee0 Dec 19, 2025
416c94a
[deps] upgrading msgpack (#59531)
elliot-barn Dec 19, 2025
94df917
[serve][llm] An example for Integrating SGLang with Ray Serve LLM (#5…
kangwangamd Dec 19, 2025
1801699
[Serve] fix bug in monitoring docs (#59571)
abrarsheikh Dec 19, 2025
7b1a711
[train] Add usage telemetry for checkpointing and validation (#59490)
TimothySeah Dec 19, 2025
b036ba2
Rename methods from _finalize to finalize (#59464)
AchimGaedkeLynker Dec 19, 2025
bfc2efb
[Serve][LLM] Add /collective_rpc endpoint for RLHF weight synchroniz…
kouroshHakha Dec 19, 2025
0dfe3ce
[Core] Add get_session_name() to RuntimeContext (#59469)
marwan116 Dec 20, 2025
6d91f46
[data][llm] Add pooling parameter (#59534)
jeffreywang-anyscale Dec 20, 2025
157692a
[docker] Update latest Docker dependencies for 2.53.0 release (#59605)
khluu Dec 20, 2025
cc64c43
[RLlib] Adds LR scheduling ability to BC and MARWIL (#59067)
ArturNiederfahrenhorst Dec 20, 2025
ccdd724
[core] Pass specific tensor transport through core code instead of en…
dayshah Dec 20, 2025
3b41c97
[RLlib] When retrying EnvRunner._sample, replace recursive with itera…
ArturNiederfahrenhorst Dec 21, 2025
efb34a6
fix: fix multiple deployment same name resolve (#59577)
manhld0206 Dec 21, 2025
6967c3a
[core] Fix GCS crash from race condition in MetricsAgentClient export…
codope Dec 22, 2025
468d76d
[core][autoscaler] fix: Invalid status transition from QUEUED to RAY_…
win5923 Dec 22, 2025
0d21f57
fix nil actor id error when calling job id (#59539)
popojk Dec 22, 2025
f906c39
[Data] Fix bug where `AutoscalingCoordinator` crashes if you request …
bveeramani Dec 23, 2025
35a3643
[Core] Optimize token auth: use shared_ptr caching and avoid per-RPC …
sampan-s-nayak Dec 23, 2025
b93cf6f
[data][llm] Add video/audio examples for vLLMEngineProcessor (#59446)
jeffreyjeffreywang Dec 23, 2025
3cb1b7c
[Data] Progress Reporting Refactor 1 (#59350)
kyuds Dec 23, 2025
8ca063f
[Data] Move extension types to `ray.data` (#59420)
zzchun Dec 23, 2025
7ae70c5
[RLlib] - APPO improvements part 1: learner pipeline performance impr…
simonsays1980 Dec 23, 2025
375e17b
Improve typehinting for `ray._common.retry` (#59575)
jonded94 Dec 23, 2025
2709187
Support http redirection download (#59384)
myandpr Dec 23, 2025
bbcecc6
[Core] Introduce local port service discovery (#59613)
Yicheng-Lu-llll Dec 23, 2025
d047601
[2/n]catalog ray serve env vars (#59619)
harshit-anyscale Dec 23, 2025
982b6b4
[Data] Compute Expressions-Expr Logarithmic (#59549)
myandpr Dec 23, 2025
10869d5
[Data] Compute Expression-str Padding (#59552)
myandpr Dec 23, 2025
6dc66d4
[Core] Fix psutil internal API usage in dashboard disk usage reportin…
Yicheng-Lu-llll Dec 26, 2025
f6140ce
[Data] Progress Reporting Refactor 2 (#59629)
kyuds Dec 26, 2025
51d55f6
[Data] Make `ReservationOpResourceAllocator. _get_ineligible_ops_with…
bveeramani Dec 26, 2025
02ce2e1
[Data] Lazily evaluate `ResourceManager` annotations in `ranker.py` (…
bveeramani Dec 26, 2025
83a9842
[Data] Remove unnecessary `PhysicalOperator.implements_accurate_memor…
bveeramani Dec 26, 2025
dc5ff02
[Data] Remove dead code (#59627)
zzchun Dec 27, 2025
ac42d1b
[Data] Update `read_lance` doc (#59673)
owenowenisme Dec 28, 2025
639451f
[data] Remove dead FastFileMetadataProvider code (#59027)
rushikeshadhav Dec 28, 2025
555f06b
[Data] Remove constructor from ClusterAutoscaler base class (#59733)
machichima Dec 28, 2025
643ce8a
[core] add missing grpc dependency (#59731)
aslonnie Dec 29, 2025
d1b36f7
bump gymnasium to 1.2.2 (#59607)
kamil-kaczmarek Dec 29, 2025
b2028df
[Data] - Fix GPU autoscaling if max_actors is set (#59632)
goutamvenkat-anyscale Dec 29, 2025
5a4322d
[tune] use generated dataset for ResourceExhaustedTest (#59742)
aslonnie Dec 29, 2025
63d2dea
[ci] removes python 3.9 runtime (#59739)
aslonnie Dec 29, 2025
24c08d5
[deps] remove scikit-image (#59743)
aslonnie Dec 29, 2025
9576361
[Core] Update TPU utils for multi-slice compatibility (#59136)
ryanaoleary Dec 29, 2025
f277581
[Data] Split `ReservationOpResourceAllocator` tests into separate fil…
bveeramani Dec 29, 2025
3bdc57c
[Data] Add BackpressurePolicy to streaming executor progress bar (#59…
srinathk10 Dec 29, 2025
bff63a8
[Data] Add `create_resource_allocator` (#59670)
bveeramani Dec 30, 2025
e252a91
[Data] Remove dead parameters from `max_task_output_bytes_to_read` (#…
bveeramani Dec 30, 2025
81e0544
[Data] Return 'inf' for max object store memory usage (#59751)
bveeramani Dec 30, 2025
4d9938e
[release test] remove unused FileManager abstract class (#59746)
aslonnie Dec 30, 2025
2fab8e8
[Data] - Add support for callable classes for UDFExpr (#56725)
goutamvenkat-anyscale Dec 30, 2025
5a1dd4e
[Data] Move `get_ineligible_op_usage` to `ResourceManager` for better…
bveeramani Dec 30, 2025
c5b2a28
[Serve] Remove shutdown() method from TaskProcessorAdapter (#59713)
krisselberg Dec 30, 2025
e45c49a
[rllib] add ormsgpack in python/requirements.txt (#59730)
aslonnie Dec 30, 2025
fe2d282
[release][ci] Enhance release test metadata with build and team infor…
rajeshg007 Dec 30, 2025
c381d05
[release test] remove unused --no-terminate flag (#59758)
aslonnie Dec 30, 2025
22a21e8
[Data] Split test_sort.py into smaller test modules to improve CI par…
Rob12312368 Dec 30, 2025
3128023
[Data] Remove extra "the" from resource request comment (#59676)
zzchun Dec 30, 2025
875132e
[Data] Remove obsolete `_DatasetWrapper` (#59310)
Priya-753 Dec 30, 2025
f85c525
[Data] Change `PhysicalOperator.completed()` to `has_completed()` (#5…
simeetnayan81 Dec 30, 2025
bc99f28
[release test] remove unused old JobManager (#59761)
aslonnie Dec 30, 2025
34e68ad
[release test] remove FullClusterManager (#59759)
aslonnie Dec 30, 2025
84d219d
[release test] refactor release test step generation (#59755)
aslonnie Dec 30, 2025
f5440d9
[release test] move testing of test result struct into test_result.py…
aslonnie Dec 30, 2025
f2c6825
[release test] remove `--cluster-id` and `--cluster-env-id` flags (#5…
aslonnie Dec 30, 2025
a0442b9
[Data] Enable and Tune DownstreamCapacityBackpressurePolicy (#59753)
srinathk10 Dec 30, 2025
48961b8
[Data] Compute Expressions - Expr Arithmetic (#59678)
zzchun Dec 30, 2025
594ca0f
[Data] minor clean-up about Write concurrency (#59483)
wingkitlee0 Dec 30, 2025
5acd1ea
[ci] removing python 3.9 buildkite jobs & wanda files (#59769)
elliot-barn Dec 30, 2025
4aa061c
[serve] deflake windows test (#59771)
abrarsheikh Dec 31, 2025
b774927
[deps] update anyscale CLI/SDK (#59770)
aslonnie Dec 31, 2025
c4d50df
[release test] migrate lookup functions to new anyscale sdk (#59772)
aslonnie Dec 31, 2025
2792bc8
[docs] Update contribution guide with some common labels (#59473)
codope Dec 31, 2025
3eb6150
[release test] remove `artifact_path` argument in `fetch_artifact` (#…
aslonnie Dec 31, 2025
f4d50de
[release test] removes cluster_url and cluster_id (#59776)
aslonnie Dec 31, 2025
6fe3e76
[Docs] Update KubeRay & Volcano integration document (#59636)
seanlaii Dec 31, 2025
97ade65
[Data][RLlib] Fix miscellaneous typos across codebase (#59718)
yurekami Dec 31, 2025
394cd2d
[Data] `AutoscalingCoordinator` prevent double-allocates resources if…
machichima Dec 31, 2025
6252a9d
[Rllib] Reduce flakyness of `test_replay_buffer.py` (#59785)
pseudo-rnd-thoughts Jan 2, 2026
47bb5a1
[core] Update seq no skip error message (#59779)
dayshah Jan 2, 2026
5dea0af
[Core] Make MAX_APPLICATION_ERROR_LEN configurable via env var (#59543)
preneond Jan 2, 2026
a419f8c
[Core] Replace startup token with worker id (#59737)
jjyao Jan 2, 2026
74e2dc2
[Core] Fix symmetric_run using wrong condition to check GCS readiness…
cr7258 Jan 2, 2026
bd306a0
[core] `jemalloc_conf` arg is a string in `propagate_jemalloc_env_var…
aslonnie Jan 2, 2026
566a5fa
[Data] Add Checkpointing to Ray Data (#59409)
owenowenisme Jan 2, 2026
1b50670
[Data] Compute Expressions - Expr Trigonometric (#59712)
zzchun Jan 2, 2026
e94a52c
[data] Support Arrow-based transformations for preprocessors (#59810)
cem-anyscale Jan 2, 2026
9a8c235
[release test] move default env vars to docker file (#59791)
aslonnie Jan 2, 2026
863848c
[release test] remove unused ray image configs and methods (#59812)
aslonnie Jan 2, 2026
b46b7fd
[Data] Restoring `ray.air.util.tensor_extensions.arrow` class aliases…
alexeykudinkin Jan 2, 2026
868e54c
[wheel] use latest manylinux build image (#59819)
andrew-anyscale Jan 2, 2026
5ae200a
[ci] bump prebuilt manylinux 251216.3835fc5 -> 260103.868e54c (#59821)
andrew-anyscale Jan 3, 2026
3c73404
[release test] remove unusd cluster_env_id arg (#59822)
aslonnie Jan 3, 2026
4c2c16d
[ci] windows: run tests on python 3.10 (#58920)
aslonnie Jan 3, 2026
3d1e84b
[Data] Restoring `ray.air.util.object_extensions.arrow` class aliases…
alexeykudinkin Jan 4, 2026
6006ec1
[ci] remove unused min install scripts (#59827)
aslonnie Jan 4, 2026
4f2bb62
[macos] stop building python 3.9 wheels (#59825)
aslonnie Jan 4, 2026
6f4121d
[Core] Adding the node id to the base event (#59242)
machichima Jan 4, 2026
9be6588
[Core] Throttle infeasible resource warning (#59790)
win5923 Jan 4, 2026
0db6dec
[ci] change default python version args in ci base (#59834)
aslonnie Jan 4, 2026
ed23f3e
[wheel] declare wheel python version as python 3.10+ (#59835)
aslonnie Jan 4, 2026
2d2c796
[Data][LLM] Support vLLM structured outputs + backward-compat for gui…
Sathyanarayanaa-T Jan 5, 2026
b940c9d
[data][llm] Avoid passing enums through fn_constructor_kwargs (#59806)
jeffreywang-anyscale Jan 5, 2026
7cf58ef
Move gcs_callback_types.h to rpc_callback_types.h (#58596)
sunsetxh Jan 5, 2026
188d087
[RLlib] Fixed and improved stateful model training on offline data. (…
simonsays1980 Jan 5, 2026
79567db
[Data] Remove Anyscale stuff from ray data checkpoint (#59823)
owenowenisme Jan 5, 2026
815bf7f
[Data] - Tabular form for Streaming Executor Op Metrics (#59774)
goutamvenkat-anyscale Jan 5, 2026
0b2cfa0
[data][optimizer][bug] fix operator fusion bug to preserve udf modify…
iamjustinhsu Jan 5, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
5 changes: 4 additions & 1 deletion .buildkite/_forge.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,5 +4,8 @@ steps:
- name: forge
wanda: ci/docker/forge.wanda.yaml

- name: manylinux
- name: manylinux-x86_64
wanda: ci/docker/manylinux.wanda.yaml
env:
HOSTTYPE: "x86_64"
MANYLINUX_VERSION: "260103.868e54c"
12 changes: 0 additions & 12 deletions .buildkite/base.rayci.yml
Original file line number Diff line number Diff line change
@@ -1,8 +1,5 @@
group: base
steps:
- name: oss-ci-base_test
wanda: ci/docker/base.test.py39.wanda.yaml

- name: oss-ci-base_test-multipy
label: "wanda: oss-ci-base_test-py{{matrix}}"
wanda: ci/docker/base.test.wanda.yaml
Expand Down Expand Up @@ -37,11 +34,6 @@ steps:
PYTHON: "3.10"
instance_type: builder-arm64

- name: oss-ci-base_ml
wanda: ci/docker/base.ml.py39.wanda.yaml
depends_on: oss-ci-base_test
tags: cibase

- name: oss-ci-base_ml-multipy
label: "wanda: oss-ci-base_ml-py{{matrix}}"
wanda: ci/docker/base.ml.wanda.yaml
Expand All @@ -53,10 +45,6 @@ steps:
PYTHON: "{{matrix}}"
depends_on: oss-ci-base_test-multipy

- name: oss-ci-base_gpu
wanda: ci/docker/base.gpu.py39.wanda.yaml
tags: cibase

- name: oss-ci-base_gpu-multipy
label: "wanda: oss-ci-base_gpu-py{{matrix}}"
wanda: ci/docker/base.gpu.wanda.yaml
Expand Down
25 changes: 15 additions & 10 deletions .buildkite/build.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,14 +11,17 @@ steps:
env:
PYTHON_VERSION: "{{matrix}}"
ARCH_SUFFIX: ""
HOSTTYPE: "x86_64"
MANYLINUX_VERSION: "260103.868e54c"
tags: release_wheels
depends_on: manylinux

- name: ray-dashboard-build
label: "wanda: dashboard"
wanda: ci/docker/ray-dashboard.wanda.yaml
env:
HOSTTYPE: "x86_64"
MANYLINUX_VERSION: "260103.868e54c"
tags: release_wheels
depends_on: manylinux

- name: ray-java-build
label: "wanda: java build (x86_64)"
Expand All @@ -29,7 +32,8 @@ steps:
- oss
env:
ARCH_SUFFIX: ""
depends_on: manylinux
HOSTTYPE: "x86_64"
MANYLINUX_VERSION: "260103.868e54c"

- label: ":tapioca: build: wheel {{matrix}} (x86_64)"
key: linux_wheels
Expand All @@ -46,7 +50,7 @@ steps:
- "3.12"
- "3.13"
depends_on:
- manylinux
- manylinux-x86_64
- forge

- label: ":tapioca: build: jar"
Expand All @@ -59,8 +63,8 @@ steps:
- ./ci/build/build-manylinux-ray.sh
- ./ci/build/build-manylinux-jar.sh
- ./ci/build/copy_build_artifacts.sh jar
depends_on: manylinux
job_env: manylinux
depends_on: manylinux-x86_64
job_env: manylinux-x86_64

- label: ":tapioca: build: ray py{{matrix}} docker (x86_64)"
key: ray_images
Expand All @@ -79,7 +83,7 @@ steps:
--platform cpu
--image-type ray --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycudabase
- raycpubase
Expand All @@ -101,10 +105,11 @@ steps:
--platform cu12.1.1-cudnn8 --platform cu12.3.2-cudnn9
--platform cu12.4.1-cudnn --platform cu12.5.1-cudnn
--platform cu12.6.3-cudnn --platform cu12.8.1-cudnn
--platform cu12.9.1-cudnn
--platform cpu
--image-type ray-extra --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycpubaseextra
- raycudabaseextra
Expand All @@ -123,7 +128,7 @@ steps:
- bazel run //ci/ray_ci:build_in_docker -- docker --python-version {{matrix}}
--platform cu12.8.1-cudnn --image-type ray-llm --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- ray-llmbase
matrix:
Expand All @@ -139,7 +144,7 @@ steps:
- bazel run //ci/ray_ci:build_in_docker -- docker --python-version {{matrix}}
--platform cu12.8.1-cudnn --image-type ray-llm-extra --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- ray-llmbaseextra
matrix:
Expand Down
6 changes: 6 additions & 0 deletions .buildkite/cicd-cron/_forge.rayci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
group: forge
sort_key: "_forge"
steps:
- name: forge
instance_type: builder-x86_64
wanda: ci/docker/forge.wanda.yaml
70 changes: 70 additions & 0 deletions .buildkite/cicd-cron/cicd-cron.rayci.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,70 @@
group: cicd-cron
steps:
# NOTE(andrew-anyscale): 'name' is used for both naming the wanda image, as
# well as for generating step names. Step name cannot contain a {{}} placeholder,
# so we cannot use a matrix here.
# See: https://github.com/ray-project/rayci/blob/74cdca5848d8ff0c9dcad464d74fc2e5cd61fa13/raycicmd/wanda.go#L53
- name: manylinux-cibase-x86_64
label: ":magic_wand: wanda: manylinux-cibase-x86_64"
wanda: ci/docker/manylinux-cibase.wanda.yaml
instance_type: builder-x86_64
env:
RAYCI_DISABLE_JAVA: "true"
RAYCI_WANDA_ALWAYS_REBUILD: "true"
JDK_SUFFIX: ""
HOSTTYPE: "x86_64"

- name: manylinux-cibase-aarch64
label: ":magic_wand: wanda: manylinux-cibase-aarch64"
wanda: ci/docker/manylinux-cibase.wanda.yaml
instance_type: builder-aarch64
env:
RAYCI_DISABLE_JAVA: "true"
RAYCI_WANDA_ALWAYS_REBUILD: "true"
JDK_SUFFIX: ""
HOSTTYPE: "aarch64"

- name: manylinux-cibase-jdk-x86_64
label: ":magic_wand: wanda: manylinux-cibase-jdk-x86_64"
wanda: ci/docker/manylinux-cibase.wanda.yaml
instance_type: builder-x86_64
env:
RAYCI_DISABLE_JAVA: "false"
RAYCI_WANDA_ALWAYS_REBUILD: "true"
JDK_SUFFIX: "-jdk"
HOSTTYPE: "x86_64"

- name: manylinux-cibase-jdk-aarch64
label: ":magic_wand: wanda: manylinux-cibase-jdk-aarch64"
wanda: ci/docker/manylinux-cibase.wanda.yaml
instance_type: builder-aarch64
env:
RAYCI_DISABLE_JAVA: "false"
RAYCI_WANDA_ALWAYS_REBUILD: "true"
JDK_SUFFIX: "-jdk"
ARCH_SUFFIX: "aarch64"
HOSTTYPE: "aarch64"

- label: ":docker: push: Push manylinux-cibase{{matrix.jdk_suffix}}{{matrix.host_suffix}} to Docker Hub"
depends_on:
- manylinux-cibase-x86_64
- manylinux-cibase-aarch64
- manylinux-cibase-jdk-x86_64
- manylinux-cibase-jdk-aarch64
- forge
job_env: forge
matrix:
setup:
host_suffix:
- "-x86_64"
- "-aarch64"
jdk_suffix:
- ""
- "-jdk"
commands:
- bazel run //.buildkite:copy_files -- --destination docker_login
- bazel run //ci/ray_ci/automation:copy_wanda_image --
--wanda-image-name manylinux-cibase{{matrix.jdk_suffix}}{{matrix.host_suffix}}
--destination-repository rayproject/manylinux2014
--tag-suffix {{matrix.jdk_suffix}}{{matrix.host_suffix}}
--upload
18 changes: 18 additions & 0 deletions .buildkite/cicd-cron/config.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
name: ray-cicd-cron
artifacts_bucket: ray-ci-artifact-branch-public
ci_temp: s3://ray-ci-artifact-branch-public/ci-temp/
ci_work_repo: 029272617770.dkr.ecr.us-west-2.amazonaws.com/rayproject/citemp
forge_prefix: cr.ray.io/rayproject/
builder_queues:
builder-x86_64: builder_queue_branch
builder-aarch64: builder_queue_arm64_branch
runner_queues:
default: runner_queue_small_branch
buildkite_dirs:
- .buildkite/cicd-cron
env:
BUILDKITE_BAZEL_CACHE_URL: https://bazel-cache-dev.s3.us-west-2.amazonaws.com
hook_env_keys:
- RAYCI_CHECKOUT_DIR
docker_plugin:
allow_mount_buildkite_agent: true
6 changes: 3 additions & 3 deletions .buildkite/core.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -252,7 +252,7 @@ steps:
--only-tags post_wheel_build
--test-env=RAY_CI_POST_WHEEL_TESTS=True
depends_on:
- manylinux
- manylinux-x86_64
- corebuild-multipy
- forge

Expand Down Expand Up @@ -452,7 +452,7 @@ steps:
- bazel run //ci/ray_ci:test_in_docker -- //python/ray/tests/... core --only-tags ha_integration
--python-version 3.10 --build-name corebuild-py3.10
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycpubase
- corebuild-multipy
Expand All @@ -474,7 +474,7 @@ steps:
--install-mask all-ray-libraries
--only-tags runtime_env_container
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycpubase
- corebuild-multipy
Expand Down
4 changes: 2 additions & 2 deletions .buildkite/dependencies.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -25,5 +25,5 @@ steps:
instance_type: small
commands:
- bazel run //ci/raydepsets:raydepsets -- build --all-configs --check
job_env: manylinux
depends_on: manylinux
job_env: manylinux-x86_64
depends_on: manylinux-x86_64
4 changes: 2 additions & 2 deletions .buildkite/kuberay.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ steps:
docker_network: "host"
depends_on:
- k8sbuild
- manylinux
- manylinux-x86_64
- forge
- raycpubase
- ray-core-build
Expand Down Expand Up @@ -44,7 +44,7 @@ steps:
- "test_streaming_llm"
- "test_many_job_submissions"
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycpubase
- ray-core-build
Expand Down
11 changes: 8 additions & 3 deletions .buildkite/linux_aarch64.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,10 @@ steps:
instance_type: builder-arm64

- name: manylinux-aarch64
wanda: ci/docker/manylinux.aarch64.wanda.yaml
wanda: ci/docker/manylinux.wanda.yaml
env:
HOSTTYPE: "aarch64"
MANYLINUX_VERSION: "260103.868e54c"
instance_type: builder-arm64

- name: ray-java-build-aarch64
Expand All @@ -22,8 +25,9 @@ steps:
- oss
env:
ARCH_SUFFIX: "-aarch64"
HOSTTYPE: "aarch64"
MANYLINUX_VERSION: "260103.868e54c"
instance_type: builder-arm64
depends_on: manylinux-aarch64

- name: raycpubase-aarch64
label: "wanda: ray.py{{matrix}}.cpu.base (aarch64)"
Expand Down Expand Up @@ -124,9 +128,10 @@ steps:
env:
PYTHON_VERSION: "{{matrix}}"
ARCH_SUFFIX: "-aarch64"
HOSTTYPE: "aarch64"
MANYLINUX_VERSION: "260103.868e54c"
tags: release_wheels
instance_type: builder-arm64
depends_on: manylinux-aarch64

- label: ":tapioca: build: wheel {{matrix}} (aarch64)"
tags:
Expand Down
6 changes: 3 additions & 3 deletions .buildkite/release/build.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ steps:
--python-version {{matrix.python}} --platform {{matrix.platform}}
--image-type ray --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycpubaseextra-testdeps
- raycudabaseextra-testdeps
Expand All @@ -104,7 +104,7 @@ steps:
- bazel run //ci/ray_ci:build_in_docker -- anyscale --python-version {{matrix}}
--platform cu12.8.1-cudnn --image-type ray-llm --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- ray-llmbaseextra-testdeps
matrix:
Expand All @@ -120,7 +120,7 @@ steps:
- bazel run //ci/ray_ci:build_in_docker -- anyscale --python-version {{matrix}}
--platform cu12.1.1-cudnn8 --image-type ray-ml --upload
depends_on:
- manylinux
- manylinux-x86_64
- forge
- ray-mlcudabaseextra-testdeps
matrix:
Expand Down
4 changes: 2 additions & 2 deletions .buildkite/serve.rayci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -126,7 +126,7 @@ steps:
--build-name servebuild-py3.10
--python-version 3.10
depends_on:
- manylinux
- manylinux-x86_64
- servebuild-multipy
- forge

Expand Down Expand Up @@ -201,7 +201,7 @@ steps:
- bazel run //ci/ray_ci:test_in_docker -- //python/ray/serve/tests/... serve
--only-tags ha_integration --python-version 3.10 --build-name servebuild-py3.10
depends_on:
- manylinux
- manylinux-x86_64
- forge
- raycpubase
- servebuild-multipy
Expand Down
1 change: 0 additions & 1 deletion .vale/styles/config/vocabularies/RLlib/accept.txt
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,6 @@ LSTMs?
[Hh]yperparameters?
MARLModule
(MARWIL|marwil)
MLAgents
MLPs?
multiagent
[Pp]erceptrons?
Expand Down
1 change: 1 addition & 0 deletions BUILD.bazel
Original file line number Diff line number Diff line change
Expand Up @@ -194,6 +194,7 @@ pyx_library(
"//src/ray/raylet_rpc_client:raylet_client_with_io_context_lib",
"//src/ray/thirdparty/setproctitle",
"//src/ray/util:memory",
"//src/ray/util:port_persistence",
"//src/ray/util:raii",
"//src/ray/util:stream_redirection",
"//src/ray/util:stream_redirection_options",
Expand Down
6 changes: 6 additions & 0 deletions CONTRIBUTING.rst
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,11 @@ You can post questions or issues or feedback through the following channels:
2. `GitHub Issues`_: For bug reports and feature requests.
3. `StackOverflow`_

Finding issues to work on
-------------------------

We use GitHub labels to categorize issues and help contributors find work that matches their interests. See `What can I work on?`_ for a list of labels by component and type.

To contribute a patch:
----------------------

Expand All @@ -22,6 +27,7 @@ the `Setting up your development environment`_ section.
.. _`StackOverflow`: https://stackoverflow.com/questions/tagged/ray
.. _`Getting Involved`: https://docs.ray.io/en/latest/ray-contribute/getting-involved.html
.. _`Setting up your development environment`: https://docs.ray.io/en/latest/ray-contribute/getting-involved.html#setting-up-your-development-environment
.. _`What can I work on?`: https://docs.ray.io/en/latest/ray-contribute/getting-involved.html#what-can-i-work-on

PR Review Process
-----------------
Expand Down
Loading