Dynamic HTML scraping

There is no need to web scrape & and as you have found it doesnt work anyway.

That is because a dynamic page gets its data after loading the "page" by using ajax.

Open your browsers devtools and watch the network tab - you will see the requests for the data are returned in JSON format.

Locate the URL with data of interest & use HTTP Request for that (be sure to set it to parse JSON reply)

1 Like