Node Web Scraping

This project shows how to scrape data from a website, store these data retrieved in the database then create and endpoint to expose them to the world.

Prerequisites

• Node.js 10+
• Yarn or NPM

Installation

• Install dependencies

yarn install

• Create application configuration

cp .env.example .env
nano .env

• Scrape programming languages from Wikipedia page

yarn scrape

• Start Application

yarn start

Browse http://localhost:4500/languages to view languages retrieved by the scraper.

The application will be launched by Nodemon. It will restart automatically on file change