Download Latest Version siteone-crawler-v1.0.9-linux-arm64.tar.gz (28.9 MB)
Email in envelope

Get an email when there's a new version of SiteOne Crawler

Home / v1.0.7
Name Modified Size InfoDownloads / Week
Parent folder
siteone-crawler-v1.0.7-win-x64.zip 2023-12-22 84.6 MB
siteone-crawler-v1.0.7-macos-x64.tar.gz 2023-12-22 26.2 MB
siteone-crawler-v1.0.7-macos-arm64.tar.gz 2023-12-22 25.5 MB
siteone-crawler-v1.0.7-linux-x64.tar.gz 2023-12-22 26.7 MB
siteone-crawler-v1.0.7-linux-arm64.tar.gz 2023-12-22 26.3 MB
README.md 2023-12-22 3.7 kB
v1.0.7 source code.tar.gz 2023-12-22 24.0 MB
v1.0.7 source code.zip 2023-12-22 24.0 MB
Totals: 8 Items   237.4 MB 0

Primary changes are implemented online HTML report upload option, improved sorting in generated sitemaps, detection and better display of SVG icon-sets, replacement of inline-JS from HTML report except for a few main static ones so that we can enable them through sha256 hashes in strict Content-Security-Policy and various minor fixes and changes.

Changes

  • html report template: updated logo link to crawler.siteone.io 9892cfe
  • http headers analysis: renamed 'Headers' to 'HTTP headers' 436e6ea
  • sitemap generator: added info about crawler to generated sitemap.xml 7cb7005
  • html report: refactor of all inline on* event listeners to data attributes and event listeners added from static JS inside <script>, so that we can disable all inline JS in the online HTML report and allow only our JS signed with hashes by Content-Security-Policy b576eef
  • readme: removed HTTP auth from roadmap (it's already done), improved guide how to implement own upload endpoint and message about SMTP moved under mailer options e1567ae
  • utils: hide passwords/authentication specified in cli parameters as *auth=xyz (e.g. --http-auth=abc:xyz)" in html report c8bb88f
  • readme: fixed formatting of the upload and expert options 2d14bd5
  • readme: added Upload Options d8352c5
  • upload exporter: added possibility via --upload to upload HTML report to offline URL, by default crawler.siteone.io/html/* 2a027c3
  • parsed-url: fixed warning in the case of url without host 284e844
  • seo and opengraph: fixed false positives 'DENY (robots.txt)' in some cases 658b649
  • best practices and inline-svgs: detection and display of the entire icon set in the HTML report in the case of <svg> with more <symbol> or <g> 3b2772c
  • sitemap generator: sort urls primary by number of dashes and secondary alphabetically (thanks to this, urls of the main levels will be at the beginning) bbc47e6
  • sitemap generator: only include URLs from the same domain as the initial URL 9969254
  • changelog: updated by 'composer changelog' 0c67fd4
  • package.json: used by auto-changelog generator 6ad8789
Source: README.md, updated 2023-12-22