-
Notifications
You must be signed in to change notification settings - Fork 237
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Back-off pulling image "public.ecr.aws/opsterio/opensearch-operator:2.3.1"[BUG] #709
Comments
Looks like its ECR is down https://gallery.ecr.aws/opsterio/opensearch-operator |
Seeing the same issues as well. it seems like this is Opster repository, do we know if OpenSearch has it's own repo with this image? |
Looks like no, it is still not there https://hub.docker.com/u/opensearchproject |
Seeing the same issues as well. Is there any solution for this issue? anyone know? |
If you can use version 2.4.0 (older images were not mirrored) you can get the image from the compatible MaibornWolff fork of the operator (https://github.com/MaibornWolff/opensearch-operator, ghcr.io/maibornwolff/opensearch-operator:2.4.0). Note that you will have to override image.tag and image.repository in the helm chart values as these still point to the ecr repo. The fork also already has a version 2.5.0 release. |
Here is also a working fork https://github.com/eliatra/opensearch-k8s-operator from Eliatra |
That is incompatible because Eliatra renamed all CRD apigroups. |
I found |
Hey I dint expect the opster ECR repo to go down, I will be doing a quick release |
Consider also pushing/back-filling images to ghcr.io. Here's a manually triggered workflow I'm using: name: Backfill Container Image
run-name: ${{ inputs.tag }}
concurrency: ${{ inputs.tag }}
on:
workflow_dispatch:
inputs:
tag:
description: "Tag to checkout and build"
required: true
env:
REGISTRY: ghcr.io
IMAGE_NAME: ${{ github.repository }}
permissions:
contents: read
packages: write
jobs:
build:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
with:
ref: refs/tags/${{ inputs.tag }}
fetch-tags: true
- uses: docker/setup-qemu-action@v3
- uses: docker/setup-buildx-action@v3
- uses: docker/login-action@v3
with:
registry: ${{ env.REGISTRY }}
username: ${{ github.actor }}
password: ${{ secrets.GITHUB_TOKEN }}
- uses: docker/metadata-action@v5
id: meta
with:
context: git
images: ${{ env.REGISTRY }}/${{ env.IMAGE_NAME }}
- name: Build and push
uses: docker/build-push-action@v5
with:
context: opensearch-operator
push: true
platforms: linux/amd64,linux/arm,linux/arm64
tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }} |
Operator is uninstallable See issue opensearch-project/opensearch-k8s-operator#709
Any updates on this? I depended on the |
+1 Also facing same problem : public.ecr.aws/opsterio/opensearch-operator:2.4.0 |
Tried with :latest which was uploaded 2 hours back (along with 2.3.2) .. but the controller manager seems to be failing health check (might be unrelated) or my environment issue |
Hey Everyone, a quick update, at this point we are still working with opensearch-project opensource team to get some approvals to publish the images to opensearch-project dockerHub and ECR registries. |
@prudhvigodithi This may be a known issue but I'm observing that multi-arch builds don't seem to be in place. E.g. I can pull a version the operator image but only docker pull --platform linux/arm64 public.ecr.aws/opsterio/opensearch-operator:2.4.0
2.4.0: Pulling from opsterio/opensearch-operator
Digest: sha256:e650adab28ebf1c96ea2b350727beb53de3520b55de37720b8e4fdbd6ed8e4f1
Status: Image is up to date for public.ecr.aws/opsterio/opensearch-operator:2.4.0
image with reference public.ecr.aws/opsterio/opensearch-operator:2.4.0 was found but does not match the specified platform: wanted linux/arm64, actual: linux/amd64 Inspecting the downloaded image and I can see that |
Hey @agershman, the operator project is recently migrated to opensearch-project org, so we are working on publishing the images to following registries: ECR: https://gallery.ecr.aws/opensearchproject/ Once I got the approval I will go ahead and pushing the images and notify here. |
Why not just push images to Github's registry? I don't think you need additional permissions/token setup. Github Actions are able to push to it just fine. |
Hey @jashandeep-sohi thanks, this is more than additional permissions/token setup etc, since now this project is part of the opensearch-project org, working with the opensource legal team to make sure the package licenses and images published are with open source licenses and are compliant. |
### Description Update `developing.md` and add `THIRD_PARTY_NOTICES` for repo compliance coming from OpenSearch open source team. ### Issues Resolved Part of #709 and #674 By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/OpenSearch/blob/main/CONTRIBUTING.md#developer-certificate-of-origin). Signed-off-by: Prudhvi Godithi <[email protected]>
### Description Update Jenkinsfile to add ECR staging registry ### Issues Resolved Part of #709 and #674 By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/OpenSearch/blob/main/CONTRIBUTING.md#developer-certificate-of-origin). Signed-off-by: Prudhvi Godithi <[email protected]>
I didn't see a comment on this thread yet but it appears that opster put 2 images back up on the ECR which resolved our issue (temporarily at least). If you are using 2.4.0 or 2.3.2, the images should pull successfully from https://gallery.ecr.aws/opsterio/opensearch-operator It is fair to say this is only a short-term work-around and they likely put it back up due to all the issues taking it down caused. |
### Description Jenkinsfile bug and prepare for 2.5.0 release ### Issues Resolved Part of #709 and #674 By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/OpenSearch/blob/main/CONTRIBUTING.md#developer-certificate-of-origin). Signed-off-by: Prudhvi Godithi <[email protected]>
Released Release build link: https://build.ci.opensearch.org/job/opensearch-operator-release/ Please test with Thanks |
There is a small bug with helm charts for
Thanks you |
### Description Prepare Release 2.5.1 ### Issues Resolved Part of #709 and #674 By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/OpenSearch/blob/main/CONTRIBUTING.md#developer-certificate-of-origin). Signed-off-by: Prudhvi Godithi <[email protected]>
### Description Readme update ### Issues Resolved Part of #709 and #674 By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license. For more information on following Developer Certificate of Origin and signing off your commits, please check [here](https://github.com/opensearch-project/OpenSearch/blob/main/CONTRIBUTING.md#developer-certificate-of-origin). Signed-off-by: Prudhvi Godithi <[email protected]>
Hey Everyone
Thank you @mrvdcsg @jashandeep-sohi @rybnico @vkumar85 @sunsrin @welkson @vipinjn24 @pomyslowynick @Rockawear @evheniyt @mustafaonure @swoehrl-mw @bbarani |
@prudhvigodithi 2.5.1 version change API version?
manifest file:
Operator details:
Reverting to 2.5.0:
|
@prudhvigodithi I wanted to circle back on my earlier comment. I'm seeing that the reestablished helm chart and referenced image at version |
Hey @welkson, there is no change in API's, I was able to see the crd
I have also tested the following and was able to start the cluster
|
Hey @agershman, is it something stopping for the operator upgrade to 2.5.1? After the repo was migrated to the opensearch-project org it was unexpected the old images are removed from ECR, so at this point might need to get approvals for all the backfill versions (for all versions <2.5.0). |
Nothing stopping us given the changes in |
Just to add @welkson, the following are steps I have tried and looks green, can you please check ?
|
Thanks @agershman, I will keep you posted here once I have enough information about the backfill. |
Hi @prudhvigodithi ! It worked properly. Thank you ;-) |
What is the bug?
A clear and concise description of the bug.
Did anything change with the location of this image reccently?
How can one reproduce the bug?
Steps to reproduce the behavior.
I am just trying to redeploy the helm chart.
What is the expected behavior?
A clear and concise description of what you expected to happen.
Image pull should be successful.
What is your host/environment?
Operating system, version.
Do you have any screenshots?
If applicable, add screenshots to help explain your problem.
Do you have any additional context?
Add any other context about the problem.
The text was updated successfully, but these errors were encountered: