Colly is a Go framework that provides a clean interface to write any kind of crawler/scraper/spider

With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving.

With DB you can very easily save, restore, and archive snapshots of your database from the command line. It supports connecting to different database servers (for example a local development server and a staging or production server) and allows you to load a database dump from one environment into another environment.

Scan, index, and archive all of your paper documents. Open Paperless is a re-think of the user interface and user experience for Mayan EDMS. The goal is to reduce the complexity and make it more suitable for home users.

Waybackpack is a command-line tool that lets you download the entire Wayback Machine archive for a given URL.

Browse old web pages the old way with virtual browsers in the browser.

PURLs are persistent URLs, they provide permanent addresses for resources on the web.

Take snapshots of any Web page

See the internet's history