Support LZ4 content encoding in the OTEL receiver once supported

[irisgve]

Is your feature request related to a problem? Please describe.

This PR adds LZ4 encoding in the OTLP exporters. Once merged, it'll be great if we can support it in the distributor as well.

Describe the solution you'd like

Add LZ4 support here

Happy to submit a PR to support this.

[ying-jeanne]

It is a good idea @irisgve, PR is welcomed! (: Happy to review when it is done.

[santileira]

@irisgve / @ying-jeanne / @armandgrillet is this "issue" still opened? If so, I can get a PR ready to support LZ4 on the distributor.

[armandgrillet]

@santileira Yes the issue is still open, feel free to contribute with a PR.

[santileira]

@armandgrillet makes sense. Could you assign it to me? Thanks

[santileira]

@armandgrillet here is the PR: #9763 but for some reason the GitHub actions are not running. Do you know why?

[armandgrillet]

The CI needed to be approved by a contributor for it to run, I have 👍 it.

[aknuds1]

@irisgve could you provide any context on why one would use LZ4 over e.g. Snappy (Mimir supports Snappy for gRPC compression, as a data point)?

[santileira]

@irisgve could you review the question from @aknuds1 and provide an answer? I would like to understand if we can move forward with the PR. Thanks

[irisgve]

Hey @aknuds1 @santileira internally we've found significant (data transfer costs) savings and performance improvements on implementing LZ4 compression in our metrics pipelines. It has slightly better compression ratios than snappy i.e. some benchmarks on https://github.com/inikep/lzbench/blob/master/lzbench18_sorted.md

[aknuds1]

Thanks @irisgve.

[santileira]

Closed. We merged the PR. Thanks!

[pjastrzabek]

@irisgve We switched to gzip due to data transfer costs (especially cross AZ). Have you possibly tested gzip? If yes, How did it compare with LZ4?

[irisgve]

Hi @pjastrzabek while gzip had better compression ratios (potentially lower data transfer costs) lz4 is ~10x faster than gzip and has lower CPU usage during compression/decompression which is more ideal for us.