3 lessons
Recognizing When a Page Needs a Browser
A quick, repeatable diagnostic for telling client-rendered pages apart from server-rendered ones, before you write a single line of scraping code.
Finding the API Behind the Page
Most "dynamic" sites are just a JavaScript app calling a JSON API. Find that API directly and skip rendering the page entirely.
How Sites Detect and Block Scrapers
The actual signals anti-bot systems check for — TLS fingerprints, browser fingerprints, behavioural patterns and CAPTCHAs — and what's reasonable to do about each.