This project scrapes smartphone product data from the Magpie developer challenge page and outputs a JSON file containing all product variants.
Each colour variant is treated as a separate product, and duplicate products are removed using a deduplication key.
- PHP 8.3+
- Composer
Install dependencies:
composer install
php src/Scrape.php
This will generate:
output.json
- All colour variants are captured as separate products
- Capacity is normalised to MB
- Shipping dates are parsed when possible
- Duplicate products are removed using a deterministic key
- Pagination is crawled automatically
Harry Cunningham