6 lessons
Project Setup and Picking a Target
Set up a real Python environment and pick a practice target you can scrape safely and legally while you build the same scraper four different ways.
Version 1: requests + BeautifulSoup
Build the complete scraper the traditional way first — the version every other framework in this module will be compared against.
Version 2: Selenium
Rebuild the same scraper with Selenium, step by step — setup, driver management, and why each line differs from the requests version.
Version 3: Playwright
Rebuild the same scraper a third time with Playwright, step by step, and time all three versions side by side.
Version 4: A Real Scrapy Project
Rebuild the scraper a fourth time as a proper Scrapy spider, and see the framework's built-in pagination and output tooling handle what you wrote by hand before.
Comparing All Four and Picking a Real Project
A direct side-by-side of everything built in this module, plus practice targets to build your own scraper against next.