Skip to content

Commit e1f1a2a

Browse files
committed
update EC2 features
Signed-off-by: Raghavendra Dani <[email protected]>
1 parent 2237ee5 commit e1f1a2a

File tree

1 file changed

+6
-2
lines changed

1 file changed

+6
-2
lines changed

reps/2023-01-09-aws-fleet-support.md

Lines changed: 6 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,11 @@ Today, AWS autoscaler requires developers to choose their EC2 instance types upf
77
#### Key requirements
88

99
- Autoscaler must offer existing functionalities and hence changes must be backward compatible.
10-
- Developers must be able to make use of most of the critical features AWS EC2 Fleet offers.
10+
- Developers must be able to make use of the features including but not limited to following:
11+
- save costs by combining on-demand capacity with spot capacity
12+
- make use of different spot and on-demand allocation strategies like `price-capacity-optimized`, `diversified`, `lowest-price` etc. to scale up
13+
- specify maximum spot prices for each instance to optimize their costs
14+
- choose optimal instance pools based on availability depending on vCPU and memory requirements instead of having to choose instance type upfront
1115
- [Ray autoscaling monitor](https://github.com/ray-project/ray/blob/a03a141c296da065f333ea81445a1b9ad49c3d00/python/ray/autoscaler/_private/monitor.py), [CLI](https://github.com/ray-project/ray/blob/7b4b88b4082297d3790b9e542090228970708270/python/ray/autoscaler/_private/commands.py#L692), [standard autoscaler](https://github.com/ray-project/ray/blob/a03a141c296da065f333ea81445a1b9ad49c3d00/python/ray/autoscaler/_private/autoscaler.py), and placement groups must be able to provision nodes via EC2 fleet.
1216
- EC2 Fleet must not interfere with the autoscaler activities.
1317
- EC2 Fleet must be supported for both head and worker node types.
@@ -30,7 +34,7 @@ Yes. Specifically within AWS autoscaler.
3034

3135
### Proposed Architecture
3236

33-
![Flex Fleet REP](https://user-images.githubusercontent.com/8843998/211219167-eb18a917-c17b-46df-94ad-83aedd8c878b.png)
37+
![Fleet REP](https://user-images.githubusercontent.com/8843998/211219167-eb18a917-c17b-46df-94ad-83aedd8c878b.png)
3438

3539
As described above, we will be adapting **node provider** to support instance creation via [create_fleet](https://boto3.amazonaws.com/v1/documentation/api/latest/reference/services/ec2.html#EC2.Client.create_fleet) API of EC2. The existing components that invoke **node provider** are only shown for clarity.
3640

0 commit comments

Comments
 (0)