Day 17 of the 8th month
Rewriting an old PHP scraper around curl_multi
How Scrape’s download loop went from one file at a time to a pool of parallel cURL transfers, and what the rewrite lost from the older code that read directory listings.
Writing about Scrape
More on: Scrape
