• View
• Edit
• History
• Print

Scraping

Scrapy

• Scrapy
• documentation & tutorials
• handling auth with Scrapy
• suggested learning path

Installation

• use pip
• w3lib library can be missing

Other options

BeautifulSoup - handling auth Beautiful soup is a parsing library, while Scrapy is a full-fledged webspider. Both in Python.