Cool QL Cool : CoolQLCool (CQC) is an open source GraphQL server that allows you to turn websites into GraphQL APIs.
Envoy Proxy : Envoy is an L7 proxy and communication bus designed for large modern service oriented architectures.
Portia : Portia is a tool that allows you to visually scrape websites without any programming knowledge required. With Portia you can annotate a web page to id...
Astro : Astro is an all-in-one web framework for building fast, content-focused websites.
Colly : Colly is a Go framework that provides a clean interface to write any kind of crawler/scraper/spider
With Colly you can easily extract structured data ...
Scrapoxy hides your webscraper behind a cloud.
It starts a pool of proxies to relay your requests.
Now, you can crawl without thinking about blacklisting!