Portia : Portia is a tool that allows you to visually scrape websites without any programming knowledge required. With Portia you can annotate a web page to id...
Cool QL Cool : CoolQLCool (CQC) is an open source GraphQL server that allows you to turn websites into GraphQL APIs.
Envoy Proxy : Envoy is an L7 proxy and communication bus designed for large modern service oriented architectures.
TheHive Project : A scalable, open source and free Security Incident Response Platform, tightly integrated with MISP (Malware Information Sharing Platform), designed to...
Feedbin : Feedbin is an open source web based RSS reader. It provides a user interface for reading and managing feeds as well as a REST-like API for clients to ...
Scrapoxy hides your webscraper behind a cloud.
It starts a pool of proxies to relay your requests.
Now, you can crawl without thinking about blacklisting!