Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] does ray support affinity scheduling for tasks or actions? #47740

Closed
kadisi opened this issue Sep 19, 2024 · 1 comment
Closed

[Core] does ray support affinity scheduling for tasks or actions? #47740

kadisi opened this issue Sep 19, 2024 · 1 comment
Labels
core Issues that should be addressed in Ray Core P1 Issue that should be fixed within a few weeks question Just a question :)

Comments

@kadisi
Copy link

kadisi commented Sep 19, 2024

Description

Does Ray support affinity scheduling for tasks or actors, like pod affinity for k8s?

Allows a group of different tasks to run on the same node and share Object storage memory, reducing grpc transfers.

Use case

In the ray data scenario, if there are multiple Physical operators of the ActorPoolMapOperator type, By using task affinity, objects generated by the parent Operator task can be directly consumed by tasks of the current Operator, reducing Object transfer across nodes.

@kadisi kadisi added enhancement Request for new feature and/or capability triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Sep 19, 2024
@anyscalesam anyscalesam added question Just a question :) core Issues that should be addressed in Ray Core labels Sep 24, 2024
@jjyao
Copy link
Collaborator

jjyao commented Oct 7, 2024

@kadisi You can use placement group to schedule a group of tasks on the same node.

@jjyao jjyao added P1 Issue that should be fixed within a few weeks and removed enhancement Request for new feature and/or capability triage Needs triage (eg: priority, bug/not-bug, and owning component) labels Oct 7, 2024
@kadisi kadisi closed this as completed Oct 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Issues that should be addressed in Ray Core P1 Issue that should be fixed within a few weeks question Just a question :)
Projects
None yet
Development

No branches or pull requests

3 participants