This project is made using scrapy framework of python which provides framework for scraping websites. The project is run using "scrapy crawl naukribot" becuase the web-crawler er made is named naukribot and is placed in "truelancerscrape/spiders/naukribot.py". The settings in "trulancerscape/setting.py" instruct to create a CSV file to store results of the scrping as categorised as "designation.organisation and description" although more fields can be added if required. The project was created using "scrapy startproject truelancerscape" and later the settings.py was changed to export yeilded results and the spider "naukribot.py" generated.
-
Notifications
You must be signed in to change notification settings - Fork 1
KinjalDas/scrape_NAUKRI.COM
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published