Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add integration or manual tests for pyspark, spark-shell, and spark-submit #9497

Closed
tgravescs opened this issue Oct 20, 2023 · 1 comment
Closed

Add integration or manual tests for pyspark, spark-shell, and spark-submit #9497

tgravescs opened this issue Oct 20, 2023 · 1 comment
Labels
test Only impacts tests

Comments

@tgravescs
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
We need to make sure we are testing pyspark, spark-shell and spark-submit (both client and cluster mode) because each one could have different classloaders. Some of these are interactive so not sure if we can have automated tests but at some point before release we need to make sure we are testing.

We just found an issue that only surfaces on spark-shell, the issue looks like its classloader related.
@tgravescs tgravescs added ? - Needs Triage Need team to review and classify test Only impacts tests labels Oct 20, 2023
@abellina abellina mentioned this issue Oct 20, 2023
Closed
@gerashegalov
Copy link
Collaborator

duplicates #5704

@mattahrens mattahrens closed this as not planned Won't fix, can't repro, duplicate, stale Oct 24, 2023
@mattahrens mattahrens removed the ? - Needs Triage Need team to review and classify label Oct 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
test Only impacts tests
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@gerashegalov @tgravescs @mattahrens