Envoy Proxy : Envoy is an L7 proxy and communication bus designed for large modern service oriented architectures.
Cool QL Cool : CoolQLCool (CQC) is an open source GraphQL server that allows you to turn websites into GraphQL APIs.
Portia : Portia is a tool that allows you to visually scrape websites without any programming knowledge required. With Portia you can annotate a web page to id...
Budibase : Budibase is an open-source low-code platform for creating internal apps in minutes. Supports PostgreSQL, MySQL, MSSQL, MongoDB, Rest API, Docker, K8s
Astro : Astro is an all-in-one web framework for building fast, content-focused websites.
Scrapoxy hides your webscraper behind a cloud.
It starts a pool of proxies to relay your requests.
Now, you can crawl without thinking about blacklisting!