Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for cluster validations in gRPC clients #10788

Draft
wants to merge 19 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from 5 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
0161aef
Ingester client: configure cluster validation label via common config…
duricanikolic Mar 3, 2025
7c46af2
Merge remote-tracking branch 'origin/main' into yuri/grpc-cluster-val…
duricanikolic Mar 4, 2025
75e98b6
Improving common field inheritance
duricanikolic Mar 4, 2025
4f13b8b
Allow cluster validation in query-frontend and query-scheduler client…
duricanikolic Mar 4, 2025
e61b653
Allow cluster validation in query-frontend clients of scheduled proce…
duricanikolic Mar 5, 2025
940a665
Replace -common.cluster-validation-label with -common.client-cluster-…
duricanikolic Mar 5, 2025
12faa5c
Merge remote-tracking branch 'origin/main' into yuri/grpc-cluster-val…
duricanikolic Mar 5, 2025
06ea6f7
Upgrade to latest dskit
duricanikolic Mar 5, 2025
a166e0f
Merge remote-tracking branch 'origin/main' into yuri/grpc-cluster-val…
duricanikolic Mar 6, 2025
8f0b382
Upgrade to the latest dskit
duricanikolic Mar 6, 2025
9bddb85
Configure gRPC clients for block-builder->block-builder-scheduler com…
duricanikolic Mar 6, 2025
ed4205b
Configure gRPC clients for query-frontend->query-scheduler communicat…
duricanikolic Mar 6, 2025
80900b8
Configure gRPC clients for querier->store-gateway communications
duricanikolic Mar 6, 2025
2ca25b2
Upgrade dskit
duricanikolic Mar 6, 2025
fa9d0e4
Configure gRPC clients for query-scheduler->query-frontend communicat…
duricanikolic Mar 6, 2025
7a47cd8
Merge remote-tracking branch 'origin/main' into yuri/grpc-cluster-val…
duricanikolic Mar 7, 2025
841c5e0
Configure gRPC clients for ruler->ruler communications
duricanikolic Mar 7, 2025
5eb94ef
Merge remote-tracking branch 'origin/main' into yuri/grpc-cluster-val…
duricanikolic Mar 8, 2025
1923344
Configure gRPC clients for ruler->ruler-query-frontend communications
duricanikolic Mar 8, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
361 changes: 361 additions & 0 deletions cmd/mimir/config-descriptor.json

Large diffs are not rendered by default.

62 changes: 62 additions & 0 deletions cmd/mimir/help-all.txt.tmpl
Original file line number Diff line number Diff line change
Expand Up @@ -191,6 +191,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-alertmanager.alertmanager-client.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-alertmanager.alertmanager-client.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-alertmanager.alertmanager-client.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-alertmanager.alertmanager-client.connect-backoff-max-delay duration
Expand Down Expand Up @@ -987,6 +989,52 @@ Usage of ./cmd/mimir/mimir:
Maximum number of CPUs that can simultaneously processes WAL replay. If it is set to 0, then each TSDB is replayed with a concurrency equal to the number of CPU cores available on the machine.
-blocks-storage.tsdb.wal-segment-size-bytes int
TSDB WAL segments files max size (bytes). (default 134217728)
-common.grpc-client.backoff-max-period duration
Maximum delay when backing off. (default 10s)
-common.grpc-client.backoff-min-period duration
Minimum delay when backing off. (default 100ms)
-common.grpc-client.backoff-on-ratelimits
Enable backoff and retry when we hit rate limits.
-common.grpc-client.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-common.grpc-client.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-common.grpc-client.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-common.grpc-client.connect-backoff-max-delay duration
Maximum backoff delay when establishing a connection. Only relevant if ConnectTimeout > 0. (default 5s)
-common.grpc-client.connect-timeout duration
The maximum amount of time to establish a connection. A value of 0 means default gRPC client connect timeout and backoff. (default 5s)
-common.grpc-client.grpc-client-rate-limit float
Rate limit for gRPC client; 0 means disabled.
-common.grpc-client.grpc-client-rate-limit-burst int
Rate limit burst for gRPC client.
-common.grpc-client.grpc-compression string
Use compression when sending messages. Supported values are: 'gzip', 'snappy' and '' (disable compression)
-common.grpc-client.grpc-max-recv-msg-size int
gRPC client max receive message size (bytes). (default 104857600)
-common.grpc-client.grpc-max-send-msg-size int
gRPC client max send message size (bytes). (default 104857600)
-common.grpc-client.initial-connection-window-size value
[experimental] Initial connection window size. Values less than the default are not supported and are ignored. Setting this to a value other than the default disables the BDP estimator. (default 63KiB1023B)
-common.grpc-client.initial-stream-window-size value
[experimental] Initial stream window size. Values less than the default are not supported and are ignored. Setting this to a value other than the default disables the BDP estimator. (default 63KiB1023B)
-common.grpc-client.tls-ca-path string
Path to the CA certificates to validate server certificate against. If not set, the host's root CA certificates are used.
-common.grpc-client.tls-cert-path string
Path to the client certificate, which will be used for authenticating with the server. Also requires the key path to be configured.
-common.grpc-client.tls-cipher-suites string
Override the default cipher suite list (separated by commas).
-common.grpc-client.tls-enabled
Enable TLS in the gRPC client. This flag needs to be enabled when any other TLS flag is set. If set to false, insecure connection to gRPC server will be used.
-common.grpc-client.tls-insecure-skip-verify
Skip validating server certificate.
-common.grpc-client.tls-key-path string
Path to the key for the client certificate. Also requires the client certificate to be configured.
-common.grpc-client.tls-min-version string
Override the default minimum TLS version. Allowed values: VersionTLS10, VersionTLS11, VersionTLS12, VersionTLS13
-common.grpc-client.tls-server-name string
Override the expected name on the server certificate.
-common.storage.azure.account-key string
Azure storage account key. If unset, Azure managed identities will be used for authentication instead.
-common.storage.azure.account-name string
Expand Down Expand Up @@ -1599,6 +1647,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-ingester.client.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-ingester.client.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-ingester.client.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-ingester.client.connect-backoff-max-delay duration
Expand Down Expand Up @@ -2115,6 +2165,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-querier.frontend-client.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-querier.frontend-client.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-querier.frontend-client.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-querier.frontend-client.connect-backoff-max-delay duration
Expand Down Expand Up @@ -2223,6 +2275,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-querier.scheduler-client.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-querier.scheduler-client.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-querier.scheduler-client.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-querier.scheduler-client.connect-backoff-max-delay duration
Expand Down Expand Up @@ -2305,6 +2359,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-query-frontend.grpc-client-config.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-query-frontend.grpc-client-config.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-query-frontend.grpc-client-config.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-query-frontend.grpc-client-config.connect-backoff-max-delay duration
Expand Down Expand Up @@ -2521,6 +2577,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-query-scheduler.grpc-client-config.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-query-scheduler.grpc-client-config.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-query-scheduler.grpc-client-config.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-query-scheduler.grpc-client-config.connect-backoff-max-delay duration
Expand Down Expand Up @@ -2955,6 +3013,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-ruler.client.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-ruler.client.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-ruler.client.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-ruler.client.connect-backoff-max-delay duration
Expand Down Expand Up @@ -3043,6 +3103,8 @@ Usage of ./cmd/mimir/mimir:
Enable backoff and retry when we hit rate limits.
-ruler.query-frontend.grpc-client-config.backoff-retries int
Number of times to backoff and retry before failing. (default 10)
-ruler.query-frontend.grpc-client-config.cluster-validation-label string
[experimental] Optionally define gRPC client's cluster validation label.
-ruler.query-frontend.grpc-client-config.connect-backoff-base-delay duration
Initial backoff delay after first connection failure. Only relevant if ConnectTimeout > 0. (default 1s)
-ruler.query-frontend.grpc-client-config.connect-backoff-max-delay duration
Expand Down
Loading