All links of one day in a single page.
This app uses the API of other websites and gives you an RSS feed in return. Quick and simple.
Scrapoxy hides your webscraper behind a cloud.
It starts a pool of proxies to relay your requests.
Now, you can crawl without thinking about blacklisting!