This repo is a batteries included online scraping and tracking toolkit. Use it to scrape things online, track the changes, and be notified when something changes.
- Scrape ebay for when that thing you've been looking for comes up.
- Keep a simple historical record of the top Reddit posts over time.
The repo uses GitHub actions to do the scraping and commits the results of the scrape in the repo. It uses tatooine as the scraping engine. Tatooine supports scraping a variety of sources and is very flexible.
- Fork this repo
- Edit
src/index.ts
- Push changes to GitHub
- Done!
If you want to be notified on email when something changes (when the GitHub action makes a new commit):
- Go to your forked repo in GitHub
- Click Settings -> Notifications
- Add your email