Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use overwrite=True when writing out intermediate files #315

Open
praateekmahajan opened this issue Oct 18, 2024 · 0 comments
Open

Use overwrite=True when writing out intermediate files #315

praateekmahajan opened this issue Oct 18, 2024 · 0 comments
Labels
enhancement New feature or request

Comments

@praateekmahajan
Copy link
Collaborator

Is your feature request related to a problem? Please describe.
When using a cache_dir in modules like FuzzyDedup if the user provides a cache_dir that was previously also used, if we don't use overwrite, the user might accidentally be reading leftover files from the previous write.

Describe the solution you'd like
Specify overwrite=True

Describe alternatives you've considered
Current approach requires user to clean up the cache each time, specify a new cache_dir.

Additional context
Image

@praateekmahajan praateekmahajan added the enhancement New feature or request label Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant