Portia : Portia is a tool that allows you to visually scrape websites without any programming knowledge required. With Portia you can annotate a web page to id...
Envoy Proxy : Envoy is an L7 proxy and communication bus designed for large modern service oriented architectures.
Cool QL Cool : CoolQLCool (CQC) is an open source GraphQL server that allows you to turn websites into GraphQL APIs.
Matrix : Matrix is an open standard for decentralised communication, providing simple HTTP APIs and open source reference implementations for securely distribu...
TheHive Project : A scalable, open source and free Security Incident Response Platform, tightly integrated with MISP (Malware Information Sharing Platform), designed to...
Scrapoxy hides your webscraper behind a cloud.
It starts a pool of proxies to relay your requests.
Now, you can crawl without thinking about blacklisting!