Skip to content

Latest commit

 

History

History
40 lines (25 loc) · 748 Bytes

File metadata and controls

40 lines (25 loc) · 748 Bytes

trashout-scraper

A Node.js scraper that will do requests to scrape JSON data of all Kosovo Trash Reports in trashout.ngo.

Technologies used:

  • Server-side scripting: NodeJS
  • Database: MongoDB
  • API Request Library: request-promise
  • Data Format: JSON

Prerequisites

  • Node

Setup

Note: You have to get your API key from trashout and then insert it in both scripts.

  1. Install dependencies
npm install

Note: The app contains two scrapers. You can run both of them using either the scrape.js or scrape-cluster.js as mentioned below.

  1. Run Server
node scrape.js

or

node scrape-cluster.js

Developed by Adonis Murati