Siteliner

Siteliner scans an entire website for duplicate content, broken links, internal page rank and redirections, and it also creates an XML sitemap. Duplicate content is highlighted on each page, with common content such as menus and navigation excluded. The analysis is free and fast, and Siteliner Premium covers larger needs. A Premium API lets developers write scripts that start, pause, resume and cancel scans, check scan status and pull an account summary report, with sample code and a guide provided. It comes from Indigo Stream Technologies, the providers of Copyscape, a service for plagiarism and duplicate content detection.