Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

opensearch create-vpc-endpoint no longer returns VpcEndpoint .Endpoint #8898

Open
petererererer opened this issue Sep 5, 2024 · 6 comments
Labels
bug This issue is a bug. opensearch p2 This is a standard priority issue service-api This issue is due to a problem in a service API, not the SDK implementation.

Comments

@petererererer
Copy link

Describe the bug

The struct returned by create-vpc-endpoint no longer includes Endpoint (see docs) which is blocking resource creation for my team because we use a CDK AwsCustomResource to wrap this call.

Expected Behavior

The Endpoint field should exist in the response

{
    "VpcEndpoint": {
        "VpcEndpointId": "...",
        "VpcEndpointOwner": "...",
        "DomainArn": "...",
        "VpcOptions": {
            "VPCId": "...",
            "SubnetIds": [
                "...",
            ],
            "AvailabilityZones": [
                "us-east-1b",
                "us-east-1a",
                "us-east-1c"
            ],
            "SecurityGroupIds": [
                "..."
            ]
        },
        "Status": "CREATING",
        "Endpoint": "....."
    }
}

Current Behavior

The Endpoint field does not exist in the response

{
    "VpcEndpoint": {
        "VpcEndpointId": "...",
        "VpcEndpointOwner": "...",
        "DomainArn": "...",
        "VpcOptions": {
            "VPCId": "...",
            "SubnetIds": [
                "...",
            ],
            "AvailabilityZones": [
                "us-east-1b",
                "us-east-1a",
                "us-east-1c"
            ],
            "SecurityGroupIds": [
                "..."
            ]
        },
        "Status": "CREATING",
    }
}

Example from attempting to deploy the CDK custom resource:

CustomResource attribute error: Vendor response doesn't contain VpcEndpoint.Endpoint attribute in object 

Reproduction Steps

aws opensearch create-vpc-endpoint --domain-arn <arn> --vpc-options SubnetIds=subnet-1,subnet-2,subnet-,SecurityGroupIds=sg-1

Possible Solution

No response

Additional Information/Context

This behavior changed sometime since 2024-07-30 because the command worked as expected at that time.

CLI version used

2.17.10

Environment details (OS name and version, etc.)

Linux/5.10

@petererererer petererererer added bug This issue is a bug. needs-triage This issue or PR still needs to be triaged. labels Sep 5, 2024
@tim-finnigan tim-finnigan self-assigned this Sep 5, 2024
@tim-finnigan tim-finnigan added the investigating This issue is being investigated and/or work is in progress to resolve the issue. label Sep 5, 2024
@tim-finnigan
Copy link
Contributor

Thank for reaching out. Can you provide debug logs (with any sensitive info redacted) by adding --debug to your command? The latest version is 2.17.45 per the CHANGELOG — can you try testing on that or a more recent version? Or did the issue start occurring once you upgraded to specific version?

@tim-finnigan tim-finnigan added response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. p2 This is a standard priority issue opensearch and removed investigating This issue is being investigated and/or work is in progress to resolve the issue. needs-triage This issue or PR still needs to be triaged. labels Sep 5, 2024
@petererererer
Copy link
Author

petererererer commented Sep 5, 2024

2024-09-05 21:09:14,266 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/2.17.10 Python/3.11.8 Linux/5.10.223-190.873.amzn2int.x86_64 exe/x86_64.amzn.2
2024-09-05 21:09:14,266 - MainThread - awscli.clidriver - DEBUG - Arguments entered to CLI: ['opensearch', 'create-vpc-endpoint', '--domain-arn', 'arn:aws:es:us-east-1:<redacted>:domain/<redacted>', '--vpc-options', 'SubnetIds=<redacted>,<redacted>,<redacted>,SecurityGroupIds=<redacted>', '--debug']
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_s3 at 0x7f997dee8ae0>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_ddb at 0x7f997e10c4a0>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method BasicCommand.add_command of <class 'awscli.customizations.configure.configure.ConfigureCommand'>>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function change_name at 0x7f997e482200>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function change_name at 0x7f997e483880>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function alias_opsworks_cm at 0x7f997deeb4c0>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_history_commands at 0x7f997e152d40>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method BasicCommand.add_command of <class 'awscli.customizations.devcommands.CLIDevCommand'>>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <function add_waiters at 0x7f997deeb380>
2024-09-05 21:09:14,278 - MainThread - botocore.hooks - DEBUG - Event building-command-table.main: calling handler <bound method AliasSubCommandInjector.on_building_command_table of <awscli.alias.AliasSubCommandInjector object at 0x7f997ddd4cd0>>
2024-09-05 21:09:14,278 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/v2/2.17.10/dist/awscli/data/cli.json
2024-09-05 21:09:14,280 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_types at 0x7f997e024860>
2024-09-05 21:09:14,280 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function no_sign_request at 0x7f997e024b80>
2024-09-05 21:09:14,280 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_verify_ssl at 0x7f997e024ae0>
2024-09-05 21:09:14,280 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_cli_read_timeout at 0x7f997e024cc0>
2024-09-05 21:09:14,280 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <function resolve_cli_connect_timeout at 0x7f997e024c20>
2024-09-05 21:09:14,280 - MainThread - botocore.hooks - DEBUG - Event top-level-args-parsed: calling handler <built-in method update of dict object at 0x7f997ddc9e40>
2024-09-05 21:09:14,280 - MainThread - awscli.clidriver - DEBUG - CLI version: aws-cli/2.17.10 Python/3.11.8 Linux/5.10.223-190.873.amzn2int.x86_64 exe/x86_64.amzn.2
2024-09-05 21:09:14,280 - MainThread - awscli.clidriver - DEBUG - Arguments entered to CLI: ['opensearch', 'create-vpc-endpoint', '--domain-arn', 'arn:aws:es:us-east-1:<redacted>:domain/c-asin-gamma-c1-us-east-1', '--vpc-options', 'SubnetIds=<redacted>,<redacted>,<redacted>,SecurityGroupIds=<redacted>', '--debug']
2024-09-05 21:09:14,281 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function add_timestamp_parser at 0x7f997dee93a0>
2024-09-05 21:09:14,281 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function register_uri_param_handler at 0x7f997e4e3880>
2024-09-05 21:09:14,281 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function add_binary_formatter at 0x7f997df77f60>
2024-09-05 21:09:14,281 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function no_pager_handler at 0x7f997e5e63e0>
2024-09-05 21:09:14,281 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function inject_assume_role_provider_cache at 0x7f997e4ff1a0>
2024-09-05 21:09:14,282 - MainThread - botocore.utils - DEBUG - IMDS ENDPOINT: http://169.254.169.254/
2024-09-05 21:09:14,283 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function attach_history_handler at 0x7f997e143560>
2024-09-05 21:09:14,283 - MainThread - botocore.hooks - DEBUG - Event session-initialized: calling handler <function inject_json_file_cache at 0x7f997e104720>
2024-09-05 21:09:14,294 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/v2/2.17.10/dist/awscli/botocore/data/opensearch/2021-01-01/service-2.json
2024-09-05 21:09:14,300 - MainThread - botocore.hooks - DEBUG - Event building-command-table.opensearch: calling handler <function add_waiters at 0x7f997deeb380>
2024-09-05 21:09:14,311 - MainThread - botocore.hooks - DEBUG - Event building-command-table.opensearch: calling handler <bound method AliasSubCommandInjector.on_building_command_table of <awscli.alias.AliasSubCommandInjector object at 0x7f997ddd4cd0>>
2024-09-05 21:09:14,311 - MainThread - awscli.clidriver - DEBUG - OrderedDict([('domain-arn', <awscli.arguments.CLIArgument object at 0x7f997d157190>), ('vpc-options', <awscli.arguments.CLIArgument object at 0x7f997d157390>), ('client-token', <awscli.arguments.CLIArgument object at 0x7f997d1574d0>)])
2024-09-05 21:09:14,311 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.opensearch.create-vpc-endpoint: calling handler <function add_streaming_output_arg at 0x7f997dee98a0>
2024-09-05 21:09:14,311 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.opensearch.create-vpc-endpoint: calling handler <function add_cli_input_json at 0x7f997e4ffb00>
2024-09-05 21:09:14,311 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.opensearch.create-vpc-endpoint: calling handler <function add_cli_input_yaml at 0x7f997e4ffba0>
2024-09-05 21:09:14,312 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.opensearch.create-vpc-endpoint: calling handler <function unify_paging_params at 0x7f997e10cae0>
2024-09-05 21:09:14,322 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/v2/2.17.10/dist/awscli/botocore/data/opensearch/2021-01-01/paginators-1.json
2024-09-05 21:09:14,323 - MainThread - botocore.hooks - DEBUG - Event building-argument-table.opensearch.create-vpc-endpoint: calling handler <function add_generate_skeleton at 0x7f997dffb060>
2024-09-05 21:09:14,323 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.opensearch.create-vpc-endpoint: calling handler <bound method OverrideRequiredArgsArgument.override_required_args of <awscli.customizations.cliinput.CliInputJSONArgument object at 0x7f997d157990>>
2024-09-05 21:09:14,323 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.opensearch.create-vpc-endpoint: calling handler <bound method OverrideRequiredArgsArgument.override_required_args of <awscli.customizations.cliinput.CliInputYAMLArgument object at 0x7f997d2cd190>>
2024-09-05 21:09:14,323 - MainThread - botocore.hooks - DEBUG - Event before-building-argument-table-parser.opensearch.create-vpc-endpoint: calling handler <bound method GenerateCliSkeletonArgument.override_required_args of <awscli.customizations.generatecliskeleton.GenerateCliSkeletonArgument object at 0x7f997d165b50>>
2024-09-05 21:09:14,323 - MainThread - botocore.hooks - DEBUG - Event building-command-table.opensearch_create-vpc-endpoint: calling handler <function add_waiters at 0x7f997deeb380>
2024-09-05 21:09:14,323 - MainThread - botocore.hooks - DEBUG - Event building-command-table.opensearch_create-vpc-endpoint: calling handler <bound method AliasSubCommandInjector.on_building_command_table of <awscli.alias.AliasSubCommandInjector object at 0x7f997ddd4cd0>>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.es.create-vpc-endpoint.domain-arn: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f997de06610>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event process-cli-arg.opensearch.create-vpc-endpoint: calling handler <awscli.argprocess.ParamShorthandParser object at 0x7f997e625c90>
2024-09-05 21:09:14,324 - MainThread - awscli.arguments - DEBUG - Unpacked value of 'arn:aws:es:us-east-1:<redacted>:domain/<redacted>' for parameter "domain_arn": 'arn:aws:es:us-east-1:<redacted>:domain/<redacted>'
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.es.create-vpc-endpoint.vpc-options: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f997de06610>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event process-cli-arg.opensearch.create-vpc-endpoint: calling handler <awscli.argprocess.ParamShorthandParser object at 0x7f997e625c90>
2024-09-05 21:09:14,324 - MainThread - awscli.argprocess - DEBUG - Parsing param --vpc-options as shorthand
2024-09-05 21:09:14,324 - MainThread - awscli.arguments - DEBUG - Unpacked value of 'SubnetIds=<redacted>,<redacted>,<redacted>,SecurityGroupIds=<redacted>' for parameter "vpc_options": {'SubnetIds': ['<redacted>', '<redacted>', '<redacted>'], 'SecurityGroupIds': ['<redacted>']}
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.es.create-vpc-endpoint.client-token: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f997de06610>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.es.create-vpc-endpoint.cli-input-json: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f997de06610>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.es.create-vpc-endpoint.cli-input-yaml: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f997de06610>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event load-cli-arg.es.create-vpc-endpoint.generate-cli-skeleton: calling handler <awscli.paramfile.URIArgumentHandler object at 0x7f997de06610>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event calling-command.opensearch.create-vpc-endpoint: calling handler <bound method CliInputArgument.add_to_call_parameters of <awscli.customizations.cliinput.CliInputJSONArgument object at 0x7f997d157990>>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event calling-command.opensearch.create-vpc-endpoint: calling handler <bound method CliInputArgument.add_to_call_parameters of <awscli.customizations.cliinput.CliInputYAMLArgument object at 0x7f997d2cd190>>
2024-09-05 21:09:14,324 - MainThread - botocore.hooks - DEBUG - Event calling-command.opensearch.create-vpc-endpoint: calling handler <bound method GenerateCliSkeletonArgument.generate_skeleton of <awscli.customizations.generatecliskeleton.GenerateCliSkeletonArgument object at 0x7f997d165b50>>
2024-09-05 21:09:14,325 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: env
2024-09-05 21:09:14,325 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: assume-role
2024-09-05 21:09:14,325 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: assume-role-with-web-identity
2024-09-05 21:09:14,325 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: sso
2024-09-05 21:09:14,325 - MainThread - botocore.credentials - DEBUG - Looking for credentials via: shared-credentials-file
2024-09-05 21:09:14,325 - MainThread - botocore.credentials - INFO - Found credentials in shared credentials file: ~/.aws/credentials
2024-09-05 21:09:14,326 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/v2/2.17.10/dist/awscli/botocore/data/endpoints.json
2024-09-05 21:09:14,337 - MainThread - botocore.hooks - DEBUG - Event choose-service-name: calling handler <function handle_service_name_alias at 0x7f998034a160>
2024-09-05 21:09:14,348 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/v2/2.17.10/dist/awscli/botocore/data/opensearch/2021-01-01/endpoint-rule-set-1.json
2024-09-05 21:09:14,348 - MainThread - botocore.loaders - DEBUG - Loading JSON file: /usr/local/aws-cli/v2/2.17.10/dist/awscli/botocore/data/partitions.json
2024-09-05 21:09:14,350 - MainThread - botocore.hooks - DEBUG - Event creating-client-class.opensearch: calling handler <function add_generate_presigned_url at 0x7f9980d46de0>
2024-09-05 21:09:14,350 - MainThread - botocore.configprovider - DEBUG - Looking for endpoint for opensearch via: environment_service
2024-09-05 21:09:14,350 - MainThread - botocore.configprovider - DEBUG - Looking for endpoint for opensearch via: environment_global
2024-09-05 21:09:14,350 - MainThread - botocore.configprovider - DEBUG - Looking for endpoint for opensearch via: config_service
2024-09-05 21:09:14,350 - MainThread - botocore.configprovider - DEBUG - Looking for endpoint for opensearch via: config_global
2024-09-05 21:09:14,350 - MainThread - botocore.configprovider - DEBUG - No configured endpoint found.
2024-09-05 21:09:14,352 - MainThread - botocore.endpoint - DEBUG - Setting es timeout as (60, 60)
2024-09-05 21:09:14,352 - MainThread - botocore.hooks - DEBUG - Event provide-client-params.opensearch.CreateVpcEndpoint: calling handler <function base64_decode_input_blobs at 0x7f997dd94040>
2024-09-05 21:09:14,352 - MainThread - botocore.hooks - DEBUG - Event before-parameter-build.opensearch.CreateVpcEndpoint: calling handler <function generate_idempotent_uuid at 0x7f997ff684a0>
2024-09-05 21:09:14,353 - MainThread - botocore.regions - DEBUG - Calling endpoint provider with parameters: {'Region': 'us-east-1', 'UseDualStack': False, 'UseFIPS': False}
2024-09-05 21:09:14,353 - MainThread - botocore.regions - DEBUG - Endpoint provider result: https://es.us-east-1.amazonaws.com
2024-09-05 21:09:14,353 - MainThread - botocore.hooks - DEBUG - Event before-call.opensearch.CreateVpcEndpoint: calling handler <function inject_api_version_header_if_needed at 0x7f997ff69f80>
2024-09-05 21:09:14,353 - MainThread - botocore.endpoint - DEBUG - Making request for OperationModel(name=CreateVpcEndpoint) with params: {'url_path': '/2021-01-01/opensearch/vpcEndpoints', 'query_string': {}, 'method': 'POST', 'headers': {'Content-Type': 'application/json', 'User-Agent': 'aws-cli/2.17.10 md/awscrt#0.20.11 ua/2.0 os/linux#5.10.223-190.873.amzn2int.x86_64 md/arch#x86_64 lang/python#3.11.8 md/pyimpl#CPython cfg/retry-mode#standard md/installer#exe md/distrib#amzn.2 md/prompt#off md/command#opensearch.create-vpc-endpoint'}, 'body': b'{"DomainArn": "arn:aws:es:us-east-1:<redacted>:domain/<redacted>", "VpcOptions": {"SubnetIds": ["<redacted>", "<redacted>", "<redacted>"], "SecurityGroupIds": ["<redacted>"]}}', 'url': 'https://es.us-east-1.amazonaws.com/2021-01-01/opensearch/vpcEndpoints', 'context': {'client_region': 'us-east-1', 'client_config': <botocore.config.Config object at 0x7f997ca9c9d0>, 'has_streaming_input': False, 'auth_type': None}}
2024-09-05 21:09:14,353 - MainThread - botocore.hooks - DEBUG - Event request-created.opensearch.CreateVpcEndpoint: calling handler <bound method RequestSigner.handler of <botocore.signers.RequestSigner object at 0x7f997ca89a10>>
2024-09-05 21:09:14,353 - MainThread - botocore.hooks - DEBUG - Event choose-signer.opensearch.CreateVpcEndpoint: calling handler <function set_operation_specific_signer at 0x7f997ff68360>
2024-09-05 21:09:14,354 - MainThread - botocore.auth - DEBUG - Calculating signature using v4 auth.
2024-09-05 21:09:14,354 - MainThread - botocore.auth - DEBUG - CanonicalRequest:
POST
/2021-01-01/opensearch/vpcEndpoints

content-type:application/json
host:es.us-east-1.amazonaws.com
x-amz-date:20240905T210914Z
x-amz-security-token:<redacted>

content-type;host;x-amz-date;x-amz-security-token
<redacted>
2024-09-05 21:09:14,354 - MainThread - botocore.auth - DEBUG - StringToSign:
AWS4-HMAC-SHA256
20240905T210914Z
20240905/us-east-1/es/aws4_request
<redacted>
2024-09-05 21:09:14,354 - MainThread - botocore.auth - DEBUG - Signature:
<redacted>
2024-09-05 21:09:14,354 - MainThread - botocore.endpoint - DEBUG - Sending http request: <AWSPreparedRequest stream_output=False, method=POST, url=https://es.us-east-1.amazonaws.com/2021-01-01/opensearch/vpcEndpoints, headers={'Content-Type': b'application/json', 'User-Agent': b'aws-cli/2.17.10 md/awscrt#0.20.11 ua/2.0 os/linux#5.10.223-190.873.amzn2int.x86_64 md/arch#x86_64 lang/python#3.11.8 md/pyimpl#CPython cfg/retry-mode#standard md/installer#exe md/distrib#amzn.2 md/prompt#off md/command#opensearch.create-vpc-endpoint', 'X-Amz-Date': b'20240905T210914Z', 'X-Amz-Security-Token': b'<redacted>', 'Authorization': b'AWS4-HMAC-SHA256 Credential=<redacted>/20240905/us-east-1/es/aws4_request, SignedHeaders=content-type;host;x-amz-date;x-amz-security-token, Signature=<redacted>', 'Content-Length': '244'}>
2024-09-05 21:09:14,354 - MainThread - botocore.httpsession - DEBUG - Certificate path: /usr/local/aws-cli/v2/2.17.10/dist/awscli/botocore/cacert.pem
2024-09-05 21:09:14,355 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): es.us-east-1.amazonaws.com:443
2024-09-05 21:09:15,785 - MainThread - urllib3.connectionpool - DEBUG - https://es.us-east-1.amazonaws.com:443 "POST /2021-01-01/opensearch/vpcEndpoints HTTP/1.1" 200 450
2024-09-05 21:09:15,786 - MainThread - botocore.parsers - DEBUG - Response headers: {'x-amzn-RequestId': 'a3ad56be-a6d8-4d75-9ad3-8ed9f6c8a6f0', 'Content-Type': 'application/json', 'Content-Length': '450', 'Date': 'Thu, 05 Sep 2024 21:09:15 GMT'}
2024-09-05 21:09:15,786 - MainThread - botocore.parsers - DEBUG - Response body:
b'{"VpcEndpoint":{"DomainArn":"arn:aws:es:us-east-1:<redacted>:domain/<redacted>","Endpoint":null,"Status":"CREATING","VpcEndpointId":<redacted>,"VpcEndpointOwner":<redacted>,"VpcOptions":{"AvailabilityZones":["us-east-1b","us-east-1a","us-east-1c"],"SecurityGroupIds":[<redacted>],"VPCId":<redacted>}}}'
2024-09-05 21:09:15,786 - MainThread - botocore.hooks - DEBUG - Event needs-retry.opensearch.CreateVpcEndpoint: calling handler <bound method RetryHandler.needs_retry of <botocore.retries.standard.RetryHandler object at 0x7f997caf6a50>>
2024-09-05 21:09:15,786 - MainThread - botocore.retries.standard - DEBUG - Not retrying request.
2024-09-05 21:09:15,786 - MainThread - botocore.hooks - DEBUG - Event after-call.opensearch.CreateVpcEndpoint: calling handler <bound method RetryQuotaChecker.release_retry_quota of <botocore.retries.standard.RetryQuotaChecker object at 0x7f997ca9d490>>
2024-09-05 21:09:15,786 - MainThread - awscli.formatter - DEBUG - RequestId: a3ad56be-a6d8-4d75-9ad3-8ed9f6c8a6f0

@petererererer
Copy link
Author

my aws version has not changed. tried 2.17.45 and it did not fix the problem

@tim-finnigan tim-finnigan added investigating This issue is being investigated and/or work is in progress to resolve the issue. and removed response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. labels Sep 5, 2024
@tim-finnigan
Copy link
Contributor

@petererererer if you try aws opensearch describe-vpc-endpoints --vpc-endpoint-ids <vpc-endpointid> then do you see the Endpoint returned?

I could reproduce the behavior you described for create-vpc-endpoint, where Endpoint is not returned despite being in the docs. But I think that's because the Status is CREATING. Once it's created, then I can see the Endpoint using describe-vpc-endpoints.

@tim-finnigan tim-finnigan added response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. and removed investigating This issue is being investigated and/or work is in progress to resolve the issue. labels Sep 5, 2024
@petererererer
Copy link
Author

yes describe-vpc-endpoints returns the Endpoint. But create-vpc-endpoint did as well, until sometime in the last ~month. i'd prefer not to have to create another AwsCustomResource if I can avoid it. i expect you are correct about the CREATING step in the workflow - and i wouldn't be surprised if something changed where the Endpoint doesn't get provisioned until the endpoint has been successfully created

@github-actions github-actions bot removed the response-requested Waiting on additional info and feedback. Will move to "closing-soon" in 7 days. label Sep 6, 2024
@tim-finnigan
Copy link
Contributor

Ok thanks for following up — I've reached out to the OpenSearch team internally regarding this issue and will try to find out more information. Will share any updates here.

@tim-finnigan tim-finnigan added the service-api This issue is due to a problem in a service API, not the SDK implementation. label Sep 6, 2024
@tim-finnigan tim-finnigan removed their assignment Sep 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug This issue is a bug. opensearch p2 This is a standard priority issue service-api This issue is due to a problem in a service API, not the SDK implementation.
Projects
None yet
Development

No branches or pull requests

2 participants