Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] Add virtual cluster #49717

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

wumuzi520
Copy link
Contributor

Why are these changes needed?

Related issue number

Checks

  • I've signed off every commit(by using the -s flag, i.e., git commit -s) in this PR.
  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
    • I've added any new APIs to the API Reference. For example, if I added a
      method in Tune, I've added it in doc/source/tune/api/ under the
      corresponding .rst file.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch 2 times, most recently from 55fbd08 to be1ee6b Compare January 8, 2025 13:43
@jjyao
Copy link
Collaborator

jjyao commented Jan 8, 2025

Hi @wumuzi520 is this the same virtual cluster as ray-project/enhancements#49 ?

@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch from b3e3150 to 8ea4728 Compare January 9, 2025 01:05
@wumuzi520
Copy link
Contributor Author

Hi @wumuzi520 is this the same virtual cluster as ray-project/enhancements#49 ?

Hi, @jjyao This PR is the implementation of an internal virtual cluster at Ant, and I have recently been working on the design document for this PR. Below is the expected appearance of the Virtual Cluster for this PR:

image

@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch from 8ea4728 to cf42af8 Compare January 9, 2025 04:26
@jjyao
Copy link
Collaborator

jjyao commented Jan 9, 2025

@wumuzi520 are you going to create a REP for it?

@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch 2 times, most recently from 5dec6f5 to a4ed432 Compare January 9, 2025 15:56
@wumuzi520 wumuzi520 requested review from a team and thomasdesr as code owners January 9, 2025 15:56
@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch 2 times, most recently from 9d67503 to 005d348 Compare January 9, 2025 16:08
@jcotant1 jcotant1 added the core Issues that should be addressed in Ray Core label Jan 9, 2025
@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch from 005d348 to 56dd417 Compare January 10, 2025 08:16
@wumuzi520
Copy link
Contributor Author

@wumuzi520 are you going to create a REP for it?

Yes, we will submit a formal REP. Currently, there are still some minor bugs being fixed in the PR, and it is nearing completion. We are also in the process of writing detailed design documents.

@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch from 56dd417 to 59fc10b Compare January 13, 2025 02:34
@wumuzi520 wumuzi520 changed the title Add virtual cluster [Core] Add virtual cluster Jan 13, 2025
@aslonnie aslonnie removed their request for review January 13, 2025 19:10
Signed-off-by: 黑驰 <[email protected]>
@wumuzi520 wumuzi520 force-pushed the add_virtual_cluster branch from 59fc10b to 03a7f06 Compare January 21, 2025 04:22
@wumuzi520 wumuzi520 requested a review from a team as a code owner January 21, 2025 04:22
@wumuzi520
Copy link
Contributor Author

Please refer to Ray Virtual Clusters for more details.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
core Issues that should be addressed in Ray Core
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants