Skip to content

Releases: website-scraper/node-website-scraper

v5.3.1

09 Oct 08:01
Compare
Choose a tag to compare

v5.3.0

30 Aug 10:26
Compare
Choose a tag to compare

What's Changed

Full Changelog: v5.2.0...v5.3.0

v5.2.0

23 Jun 06:59
07e6858
Compare
Choose a tag to compare

What's Changed

New Contributors

Full Changelog: v5.1.0...v5.2.0

v5.1.0 [deprecated]

09 Jun 12:12
087d943
Compare
Choose a tag to compare
v5.1.0 [deprecated] Pre-release
Pre-release

What's Changed

  • Fix encoding issue for non-English websites #482
  • Bump cheerio from 1.0.0-rc.10 to 1.0.0-rc.11 by @dependabot in #491

⚠️ Version 5.1.0 was deprecated because of bugs introduced by encoding changes #493, failed tests in website-scraper-puppeteer

Full Changelog: v5.0.0...v5.1.0

v5.0.0

27 Dec 19:38
8d32bc5
Compare
Choose a tag to compare

💥 Breaking changes

  • module requires nodejs version >= 14.14
  • module is now pure ESM and cannot be required from CommonJS module. Read more about ESM modules
  • options.request may need to be changed, underlying http library was updates from request(deprecated) to got
  • scrape.defaults now can be imported with import defaultOptions from 'website-scraper/defaultOptions';
  • scrape.plugins now can be imported with import * as plugins from 'website-scraper/plugins';
  • callback usage support was removed, now only promises and async/await are supported

🐛 Bug fixes

  • urlFilter is no longer applied for root resources #460
  • issue with wrong quotes in generated html is fixed #355

🌵 Other changes

  • cheerio (underlying dependency for html parsing) was updated from version 0.22 to 1.0.0-rc.10

v4.2.3

23 Sep 18:59
Compare
Choose a tag to compare
  • 529e27c - fix file save error on windows #413
  • update dependencies

v4.2.2

15 Jul 19:15
Compare
Choose a tag to compare
  • db206b7 Scrape resources with query strings when using bySiteStructure

v4.2.1

03 May 15:47
Compare
Choose a tag to compare
  • c565e14 fix attributes with html-entity encoded quotes

v4.2.0

04 Sep 13:20
39f2ccb
Compare
Choose a tag to compare
  • 7cc60db add responseData to generateFilename action params

v4.1.0

28 Aug 15:14
Compare
Choose a tag to compare
  • 6988b86 Fix issue with transforming attribute names to lowercase #369