Cache for already downloaded postings #134
Closed
domenicoaimachina
started this conversation in
Ideas
Replies: 1 comment 1 reply
-
Yes feel free to PR and I'll take a look. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi there, I think it could be useful to add a cache parameter (at least for Indeed, which is the website I am focusing on right now) to stop the requests if the current set of results does not contain any new posting. This can be implemented as an early stop mechanism for all the websites for which results are paginated and sorted by date to limit the number of requests. What's your opinion on that? I can help with implementation.
Beta Was this translation helpful? Give feedback.
All reactions