Javascript Sitemap Scrape

This client-side scraper sees the federation from a privileged position inside firewalls. This was built as a proof of concept for a federation wide recent changes that would be tied to infinite scrolling by the user.

The prototype runs to exhaustion but limits the depth into history that it is willing to look so as not to fetch every page in the federation.

This existed as a single html file with an embedded script that gets passed around by email, now distributed as Selective Scrape Pages.