Cool QL Cool : CoolQLCool (CQC) is an open source GraphQL server that allows you to turn websites into GraphQL APIs.
Envoy Proxy : Envoy is an L7 proxy and communication bus designed for large modern service oriented architectures.
Portia : Portia is a tool that allows you to visually scrape websites without any programming knowledge required. With Portia you can annotate a web page to id...
Code Triage : Sign up to receive a different open issue in your inbox every day from your favorite GitHub repos
Ockam : Ockam is a suite of open source tools, programming libraries, and managed cloud services to orchestrate end-to-end encryption, mutual authentication, ...
Scrapoxy hides your webscraper behind a cloud.
It starts a pool of proxies to relay your requests.
Now, you can crawl without thinking about blacklisting!