sqlite3 cache reading re-reading existing files that are in the cache on Connector Restart. #2901
Labels
bug
needs investigation
It looks as though have all the information needed but investigation is required
Issue
The following YAML below monitors an SFTP and when a new file is added it reads the file contents to stdout. However, when I restart the redpanda connect service, it reads all the files in the SFTP again - even though they are processed already and in the cache (sqlite3).
Expected behavior:
When redpanda connect is restarted, it should not process the file again that have already been processed in the SFTP as they exist inside the cache.
Sample Yaml
The text was updated successfully, but these errors were encountered: