Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add check-file SSH_FXP_EXTENDED functionality (calculating hash) #350

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

lmagyar
Copy link
Contributor

@lmagyar lmagyar commented May 30, 2024

Can be merged only after PR #349.

This is very useful for checking files during synchronization.

I gave up on rclone, osync and unison, because they are extremely slow over SSHFS, because SSHFS sends dozens of commands even for the simplest directory listing.

I started to implement a python script for fast bidirectional sync especially optimized for your sftp server (approx. 100 times faster check than the mentioned solutions above), and hashing the files on the first run speeds up operation even another approx 10 times). So this hashing is very useful.

Note: The implemented version only acceps requests for hashing the whole file.

@wolpi
Copy link
Owner

wolpi commented Jun 2, 2024

Ok, very interesting!
Can you share the python script?

@lmagyar
Copy link
Contributor Author

lmagyar commented Jun 2, 2024

Definitely will. As soon as it runs stable in my family, I will upload it. It is very near... - But even my wife doesn't beleive me on this story. :D

@lmagyar lmagyar force-pushed the pr-extended-command-for-hashing branch from f6248ee to f65cfa3 Compare June 30, 2024 10:37
@lmagyar
Copy link
Contributor Author

lmagyar commented Jun 30, 2024

(just rebased it to latest master)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants