Speed up SAF 100x

[lmagyar]

Summary:

• When there are 1000s of files in a dir, even opening a file takes several minutes!!!
• The root cause is that creating even 1 SafFile involves a call to DocumentFile.findFile() and it calls listFiles(), and that is extremely slow on a big dir.
• I've copied the Cursor code from RoSafFileSystemView.getFile() (with some minor improvements).
• Now opening a file is a fraction of a second on a dir with 1000s of files!!!
• Though listing a dir is still slow, it uses listFiles(), and we can't do anything about it.

One issue with the code below:

• When there is an invalid path, like /valid-folder/invalid-folder/valid-folder/file.xxx, what should we do with invalid-folder???
• We should throw an Exception, but this is not allowed here, we can't return null, it will harm SftpSubsystem.
• Original code returned a SafFile referencing /valid-folder/invalid-folder and finally a file was created with the name of invalid-folder, still not a good outcome. And without any error message.

Possible better solutions:

• Extend FileSystemView.getFile() with a throws Exception and modify SftpSubsystem's code? I remember you don't like modifying the original server's code.
• Create some dummy "fails on everything" SafFile+SafFtpFile+SafSshFile, and that will throw the proper FileNotFoundException on the first call? Maybe this is the most analog to what would happen on a real file-system with File. But it smells like an ugly hack.
• Any idea???

[wolpi]

That sounds quite good 🤩
I've to take a deeper look, also together with the other PRs.