---
title: Scraping
canonical: 'https://www.dealmobile.co.uk/writing/tag/scraping'
url: 'https://www.dealmobile.co.uk/writing/tag/scraping'
type: Tags
---

# Scraping

## [Turning saved web pages into clean Markdown](https://www.dealmobile.co.uk/writing/turning-web-pages-into-clean-markdown.md)

Published 2026-10-21

How ScrapePy finds the article inside a saved page, strips the menus, adverts and sign-up boxes around it, and points its links at the other Markdown files.

## [Rewriting an old PHP scraper around curl_multi](https://www.dealmobile.co.uk/writing/rewriting-an-old-scraper-around-curl-multi.md)

Published 2026-10-21

How Scrape’s download loop went from one file at a time to a pool of parallel cURL transfers, and what the rewrite lost from the older code that read directory listings.

## [Saving websites for offline reading with ScrapePy](https://www.dealmobile.co.uk/writing/saving-websites-for-offline-reading.md)

Published 2026-10-19

What it takes to turn a live website into a copy that works with no connection, and how ScrapePy maps URLs to files, rewrites links and only re-downloads what has changed.

---

Index of this site: [llms.txt](https://www.dealmobile.co.uk/llms.txt)