Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bigtable] bigtable.sh references deprecated Hortonworks Nexus resources #1198

Open
cjac opened this issue Jul 19, 2024 · 2 comments
Open

[bigtable] bigtable.sh references deprecated Hortonworks Nexus resources #1198

cjac opened this issue Jul 19, 2024 · 2 comments
Assignees

Comments

@cjac
Copy link
Contributor

cjac commented Jul 19, 2024

To resolve this dependency on deprecated infrastructure, we need to make copies of all jars we depend on and store them in GCS, then we need to update bigtable.sh to fetch from the GCS location instead of hortonworks nexus server.

@prince-cs
Copy link
Collaborator

Will be using the gs://dataproc-initialization-actions bucket to store the jars. It has the basic repo structure of our init repo. Inside of bigtable folder, I will make the same structure for storing the jars so as to ensure that minimal code changes are required in the bigtable init script.

@cjac
Copy link
Contributor Author

cjac commented Aug 6, 2024

Might as well copy the tar.gz packages from archive.apache.org as well. They're flakey to download.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants