# Dynamic HTML scraping

**URL:** <https://discourse.nodered.org/t/dynamic-html-scraping/68856>\
**Category:** General\
**Tags:** http-request\
**Created:** [11 October 2022 10:55 UTC](https://discourse.nodered.org/t/dynamic-html-scraping/68856 "2022-10-11T10:55:21Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![Steve-Mcl](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/steve-mcl/32/4826_2.png) [@Steve-Mcl](https://discourse.nodered.org/u/Steve-Mcl)\
**Post date:** [11 October 2022 11:11 UTC](https://discourse.nodered.org/t/dynamic-html-scraping/68856/2 "2022-10-11T11:11:44Z")

</div>

There is no need to web scrape & and as you have found it doesnt work anyway.

That is because a dynamic page gets its data after loading the "page" by using ajax.

Open your browsers devtools and watch the network tab - you will see the requests for the data are returned in JSON format.

 ![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/0/e/0e2ad79705f1bf1d78a181faa478e5aacbb2bbc9.png)

Locate the URL with data of interest & use HTTP Request for that (be sure to set it to parse JSON reply)

---

_[View the full topic](https://discourse.nodered.org/t/dynamic-html-scraping/68856)._
