Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use new rsync options ? #1069

Open
kapouer opened this issue Feb 21, 2025 · 5 comments
Open

Use new rsync options ? #1069

kapouer opened this issue Feb 21, 2025 · 5 comments

Comments

@kapouer
Copy link

kapouer commented Feb 21, 2025

Hi,
things like
--compress-choice=zstd --compress-level=3 --checksum-choice=xxh3

could improve a lot the restore from backup.

Is there a way to pass those arguments to rsync ?

@martinmarques
Copy link
Contributor

This is not possible at the moment. But we will consider it as a future enhancement.

Do you have any data regarding improvements when using any of those options with rsync?

@kapouer
Copy link
Author

kapouer commented Feb 24, 2025

I tested zstd on wals and it was faster and more compressed than pigz, so I suppose it can benefit to backup too.

@kapouer
Copy link
Author

kapouer commented Feb 24, 2025

Another thing that would improve the speed of backups is the ability to use the (unencrypted) rsync protocol, because it gives 3 times the bandwidth of doing it through ssh, at the cost of being unencrypted (which is okay in some private network situations).

@martinmarques
Copy link
Contributor

I tested zstd on wals and it was faster and more compressed than pigz, so I suppose it can benefit to backup too.

This is something that you may get for free with a feature we are working on. Basically you could take compressed backups with zstd compression and on restore time tell barman to ship the backups compressed to the remote node and decompress them there.

@kapouer
Copy link
Author

kapouer commented Feb 24, 2025

That would be cool - I can spot the difference easily when dealing with that 15TB cluster backup :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants