I'm just playing around with Scrapy, and Spinneys seemed like a good place to start.
- Create virtual environement
virtualenv -p python3 env
- Activate virual environement
source env\bin\activate
- Install dependencies
pip install -r requirements.txt
No output: scrapy crawl <spidername>
json output: scrapy crawl <spidername> -o <outfile>.json
#TODO
- Add tests