Skip to content

using Scrapy to scrap promotional products from Spinneys Egypt website.

Notifications You must be signed in to change notification settings

camara90100/spinneys_egypt_scrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spinneys Egypt (promotional products) scraper

I'm just playing around with Scrapy, and Spinneys seemed like a good place to start.

Install

  1. Create virtual environement virtualenv -p python3 env
  2. Activate virual environement source env\bin\activate
  3. Install dependencies pip install -r requirements.txt

Running scrapers

No output: scrapy crawl <spidername>

json output: scrapy crawl <spidername> -o <outfile>.json

#TODO

  1. Add tests

About

using Scrapy to scrap promotional products from Spinneys Egypt website.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages