You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current articles processing has copy pasted methods while we can simplify down with config json and adapting to a few edge cases. Most of the time it is mostly about changing the CSS selector for each title, author, release date (+ correct formatting into yyyy-mm-dd), and content.
We can make something cleaner there where each CSS selector and date format is a parameter.
Even better: automate the process with a scrapping tool
The text was updated successfully, but these errors were encountered:
vmeylan
changed the title
[refactor] The way articles are processed
[refactor] Articles processing
Mar 17, 2024
The current articles processing has copy pasted methods while we can simplify down with config json and adapting to a few edge cases. Most of the time it is mostly about changing the CSS selector for each title, author, release date (+ correct formatting into yyyy-mm-dd), and content.
We can make something cleaner there where each CSS selector and date format is a parameter.
Even better: automate the process with a scrapping tool
The text was updated successfully, but these errors were encountered: