Uses Screaming Frog Internal HTML with text extraction along with a shingling algorithm to compare content duplication across the pages of a crawled site.
-
Updated
Oct 2, 2019 - Python
#
duplicate-content
Here is 1 public repository matching this topic...
Improve this page
Add a description, image, and links to the duplicate-content topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the duplicate-content topic, visit your repo's landing page and select "manage topics."