You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now at every manual fetching of articles via get_articles_content, we overwrite the previous content with the latest fetched one, which propagates past edits.
We would need to add safeguards around making sure that the scrapping process does not lose a significant chunk of the content in the event of malfunction.
The text was updated successfully, but these errors were encountered:
Right now at every manual fetching of articles via
get_articles_content
, we overwrite the previous content with the latest fetched one, which propagates past edits.We would need to add safeguards around making sure that the scrapping process does not lose a significant chunk of the content in the event of malfunction.
The text was updated successfully, but these errors were encountered: