Web Scraping in Python
Scrapy is an open source and collaborative framework for extracting the data you need from websites.
It gives you all the tools you need to efficiently extract data from websites, process them as you want, and store them in your preferred structure and format. Unlike BeautifulSoup, which you may have heard of, Scrapy is a tool specifically created for downloading, cleaning and saving data from the web and will help you end-to-end; whereas BeautifulSoup is a smaller package which will only help you get information out of webpages.
Installation
pip install scrapy
Homepage
GitHub
[Tutorial] Making Web Crawlers Using Scrapy for Python
#scrapy #web
