# How to deconstruct web pages with http-request

**URL:** <https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323>\
**Category:** General\
**Created:** [29 May 2025 11:21 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323 "2025-05-29T11:21:02Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 11:21 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/1 "2025-05-29T11:21:02Z")

</div>

This is the base line of my code:

```auto
[{"id":"dcd80a56f41caa81","type":"http request","z":"65c9b63cb09879a0","name":"","method":"GET","ret":"txt","paytoqs":"ignore","url":"","tls":"","persist":false,"proxy":"","insecureHTTPParser":false,"authType":"","senderr":false,"headers":[{"keyType":"Accept","keyValue":"","valueType":"text/plain","valueValue":""},{"keyType":"User-Agent","keyValue":"","valueType":"other","valueValue":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0"}],"x":5160,"y":370,"wires":[["3af232784383f3b8"]]},{"id":"89f681ae64bd6135","type":"inject","z":"65c9b63cb09879a0","name":"Node-Red","props":[{"p":"url","v":"https://discourse.nodered.org/","vt":"str"},{"p":"topic","vt":"str"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","x":4990,"y":370,"wires":[["dcd80a56f41caa81"]]},{"id":"3af232784383f3b8","type":"debug","z":"65c9b63cb09879a0","name":"debug 10","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"true","targetType":"full","statusVal":"","statusType":"auto","x":5320,"y":370,"wires":[]}]

```

Not rocket science.

It _works_ but it also doesn't - for me.

This is what I'm given:

```auto
{"_msgid":"953d597ecca0db9b","payload":"<!DOCTYPE html>\n<html lang=\"en-GB\">\n<head>\n <meta charset=\"utf-8\">\n <title>Page Not Found - Node-RED Forum</title>\n <meta name=\"description\" content=\"\">\n <meta name=\"generator\" content=\"Discourse 3.5.0.beta6-dev - https://github.com/discourse/discourse version 09a457f2ab3e0f3c0e78eb105dcbe0f98afcf85b\">\n<link rel=\"icon\" type=\"image/png\" href=\"https://us1.discourse-cdn.com/flex026/uploads/nodered/optimized/1X/598c4a26af3e3272e341a28c9f4adb5c75c8f5dc_2_32x32.png\">\n<link rel=\"apple-touch-icon\" type=\"image/png\" href=\"https://us1.discourse-cdn.com/flex026/uploads/nodered/optimized/1X/d073cd938eafa2e558d7c2cd59003b3ef4963033_2_180x180.png\">\n<meta name=\"theme-color\" media=\"all\" content=\"#fff\">\n\n<meta name=\"color-scheme\" content=\"light\">\n\n<meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0, minimum-scale=1.0, viewport-fit=cover\">\n<link rel=\"canonical\" href=\"https://discourse.nodered.org/404\" />\n\n<link rel=\"search\" type=\"application/opensearchdescription+xml\" href=\"https://d...","topic":"","statusCode":404,"headers":{"server":"nginx","date":"Thu, 29 May 2025 11:09:36 GMT","content-type":"text/html; charset=utf-8","transfer-encoding":"chunked","vary":"Accept-Encoding, Accept","content-security-policy":"upgrade-insecure-requests; base-uri 'self'; object-src 'none'; script-src 'nonce-5fJZWcHpglQsgqKwPJETa2GTf' 'strict-dynamic'; frame-ancestors 'self'; manifest-src 'self'","x-xss-protection":"0","x-content-type-options":"nosniff","x-permitted-cross-domain-policies":"none","referrer-policy":"strict-origin-when-cross-origin","cross-origin-opener-policy":"same-origin-allow-popups","x-request-id":"87c71362-4510-464f-ad5e-d6ada482d008","cdck-proxy-id":"app-router-tieadvanced03.sea2, app-balancer-tieinterceptor1b.sea2","strict-transport-security":"max-age=31536000","x-node-red-request-node":"4917474a"},"responseUrl":"https://discourse.nodered.org/","redirectList":[],"retry":0}

```

But that seems to be the _bigger page_.  
Which is alright.

But I want to learn .... how/where I get the stuff needed to then list the posts/thread.

It is really confusing for me as I am really flying blind, but I'm just curious with something and I don't really even know what it is. Just _curiosity_ - I think.

Maybe I should ask here, but I'm at a loss where I could better ask.  
And I am using NR.

(Oh, to help I hope)  
NR v 4.0.9  
node v20.19.2  
Ubuntu 22.04

---

<div class="post-metadata">

**Author:** ![Steve-Mcl](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/steve-mcl/32/4826_2.png) [@Steve-Mcl](https://discourse.nodered.org/u/Steve-Mcl)\
**Post date:** [29 May 2025 11:28 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/2 "2025-05-29T11:28:27Z")

</div>

Firstly, for whatever reason, your response is a 404 (not found)

Forgetting that for 1 moment, even if you did get the full node-red discourse page, it would likely NOT contain any entries.

What many sites (including discourse) do is use JavaScript to call APIs (other URLs) that return the data (in a nice format like JSON) then JS is used to render the values e.g:

 ![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/b/9/b90e70138241a498b286c55e859eacb358fe000d.png)

* * *

On static web pages, where you get ALL of the HTML (with the tables and rows pre-populated) -you would use the HTML nodes (and carefully crafted selectors) to break it down.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 11:33 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/3 "2025-05-29T11:33:47Z")

</div>

Yes, ok. You are right. I am sure it didn't always give me an error 404.

So if I am wanting to parse discourse - say node-red.......

I'm trying to get my head around the _DEBUG_ in the browser.  
(Whole new world)

Could you help me get my head around the mechanics of how it works for NR?  
What URL do I need to get the discourse page then when I get that...... How do I find the _magic stuff_ that will then give me the thread list?

I may need to change the parsing from text to JSON.... 🤷

Sorry and thanks.

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 11:46 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/4 "2025-05-29T11:46:09Z")

</div>

It isn't that easy. Because Discourse uses modern authentication, you need valid tokens in order to be able to access it. The browser generally hides that stuff from you but if you want to go in via a flow, you will have to manage it all.

Have a look at the network tab in dev tools - you will want to reload the page when you do. You will see HUNDREDS of entries. Each one is a connection from your browser tab to the server.

Click on the main entry which I think is shown just as a number. You should then see the headers. In there you will find a session cookie, some specific Discourse headers and a bunch of security headers.

Then check out the Application tab. You will see that Discourse uses local storage:

 ![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/6/c/6c555875e4f6600d549328cf847d89cd2d13dfda.png)

and cookies.

You might have joy using the headers as-is in a Node-RED request and that might work temporarily. But once your session expires, it will then fail.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 11:48 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/5 "2025-05-29T11:48:40Z")

</div>

Yeah, ok. That is a whole other level of stuff I hadn't considered.

But for the sake of trying, I am _logging_ into `discourse.nodered.org` from a private browser and I still get to see the thread list.

I'll stop posting in THIS reply as the rest of it isn't to you and I don't want to pollute this reply.

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 11:49 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/6 "2025-05-29T11:49:43Z")

</div>

If you've not really used http-request before - you might want to choose a simpler site to learn on. 🙂

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 11:50 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/7 "2025-05-29T11:50:44Z")

</div>

Steve,

thanks for the picture, but I seem to be missing something.

I was looking in the wrong place though already.

Network. Thanks.  
but I can't get `preview` and I am not seeing the `latest json` message.

(Just saw a reply. I'll post this and read it now.)

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 11:51 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/8 "2025-05-29T11:51:18Z")

</div>

Yeah, thanks.

I seem to throw myself at difficult things.

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 11:58 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/9 "2025-05-29T11:58:48Z")

</div>

> [@Trying\_to\_learn](#):
>
> thanks for the picture, but I seem to be missing something.

I just checked and I don't get a `latest.json` file at all when looking at the Node-RED forum home page (which defaults to the Latest view).

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 12:03 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/10 "2025-05-29T12:03:17Z")

</div>

It is a bit different when I use OPERA with the .... debug/tools window open.

But again, I am not seeing the latest.json (sorry hard to read the pic while replying)  
I get a LOT of stuff scrolling past me.  
If I click on _just about any entry_ on the left, I do get some ....

Hang on!

Found it, but it is named only `latest`. not `latest.json`. (my mistake)

Ok, I'm getting there.

I'll post this and keep digging to see where I get.

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 12:05 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/11 "2025-05-29T12:05:31Z")

</div>

Worth also trying Firefox. I don't normally use it but it can give a somewhat different perspective in the dev tools. Worth trying anyway.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 12:11 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/12 "2025-05-29T12:11:28Z")

</div>

That's what I use, but when I tried, I didn't see the `latest` one.....  
Ok, but maybe I wasn't looking for it with a close match.  
But all I saw was ......

FF:

 ![Screenshot from 2025-05-29 22-07-56](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/5/7/579977c6f7ff284febc46291190d52c5a6932036.png)

You can see I have `NETWORK` ticked.  
I reloaded the page.

But OPERA....

 ![Screenshot from 2025-05-29 22-10-10](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/f/4/f4353d0637574dbffba453cae1c6d2943eeb3c64.png)

Whole different enchilada.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 12:16 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/13 "2025-05-29T12:16:06Z")

</div>

Maybe I should ask in the FF group to why/HOW there is such a difference between the tools and what they show.

But I'm not sure that will help me or not.

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 12:24 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/14 "2025-05-29T12:24:12Z")

</div>

> [@Trying\_to\_learn](#):
>
> That's what I use, but when I tried, I didn't see the `latest` one.....

That's what I was saying. I now see that you only get latest.json if you were on a different view and you clicked on "Latest" with the network tab open.

> [@Trying\_to\_learn](#):
>
> Whole different enchilada.

You have different filters set. In FF, you are filtered on `html`, in Opera you have no filter.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 12:29 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/15 "2025-05-29T12:29:09Z")

</div>

Thanks.

Mia culpa.

(Dumb question - but I'm sure you know me enough by now...) 😉

How do I change the settings.

Oh, late note: I said OPERA as the other browser..... I meant CHROME.  
But.....

(I think it would be obvious if you looked at the top of the screen shot where it says CHROME and not OPERA)

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 12:31 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/16 "2025-05-29T12:31:11Z")

</div>

![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/e/4/e46c7883c220bf76c336a1cbb7f4b47785cbb869.png)

![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/7/3/731d1a2e87fdf96274c6249a88858b94f4cb6063.png)

Those are the pre-set filters, you click on the one(s) you want.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 12:36 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/17 "2025-05-29T12:36:37Z")

</div>

Ok, when I press the `ALL` button, better.

But I'm not seeing a `preview` option.

 ![Screenshot from 2025-05-29 22-35-24](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/3/6/369fff3b8cde2a90bf907fc4d03830e8bbeb8724.png)

which is stumping me, as in Chrome, I see the page on the right side.

Here, I can't find that option.

## AH!

Is it called `response`?

In Chrome, there is `preview` and `response`.  
To me - indulge me - they look like the same thing, but in different layouts.

One is how I see it on the web page and one is the code _behind_ the web page.

But in FF, there is only the `response` option and that only shows me the web side.  
Ok, fair enough.  
The _code_ isn't too important - _though I have been wrong before_.

It is interesting that in Chrome, I am seeing the code and I would think that I would/should get that information returned to me.

But when I run FF and use NR to do the request I don't seem to be getting it.

I'll keep digging.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 12:54 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/18 "2025-05-29T12:54:03Z")

</div>

# _Progress_ - of sorts

But not really.

So this is where I'm at.  
(Using Chrome.)

 ![Screenshot from 2025-05-29 22-46-50](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/8/a/8ad7c5988247a3086cc34d337b95facfd8a38589.png)

So in this _mode_ I am at `discourse.nodered.org` and I can see my thread/topic.  
_this one._  
Sorry not marked.  
I think it is the second one from the top on the right side.

But it's there.

Now if I look at what NR gives me - even running (to call it) via Chrome

 ![Screenshot from 2025-05-29 22-47-28](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/5/5/55aec0ed097e65a94f413768a634e3e2fa346fe0.png)

So I've sent the request in.... got a reply.  
(I'll post it in a second.)

All things being equal, it should have the data I showed in the previous piccie - yes?

It doesn't.  
Copied the entire message.

```auto
{"_msgid":"91c6bf933f5f09bb","url":"https://discourse.nodered.org/","topic":"","statusCode":404,"headers":{"server":"nginx","date":"Thu, 29 May 2025 12:44:58 GMT","content-type":"text/html; charset=utf-8","transfer-encoding":"chunked","vary":"Accept-Encoding, Accept","content-security-policy":"upgrade-insecure-requests; base-uri 'self'; object-src 'none'; script-src 'nonce-Gq2p73DX2XRNJfINxuN99WPyX' 'strict-dynamic'; frame-ancestors 'self'; manifest-src 'self'","x-xss-protection":"0","x-content-type-options":"nosniff","x-permitted-cross-domain-policies":"none","referrer-policy":"strict-origin-when-cross-origin","cross-origin-opener-policy":"same-origin-allow-popups","x-request-id":"2d89d71a-07d9-4683-9e5b-7b151dd1b453","cdck-proxy-id":"app-router-tieadvanced03.sea2, app-balancer-tieinterceptor1b.sea2","strict-transport-security":"max-age=31536000","x-node-red-request-node":"147a9164"},"responseUrl":"https://discourse.nodered.org/","payload":"<!DOCTYPE html>\n<html lang=\"en-GB\">\n<head>\n <meta charset=\"utf-8\">\n <title>Page Not Found - Node-RED Forum</title>\n <meta name=\"description\" content=\"\">\n <meta name=\"generator\" content=\"Discourse 3.5.0.beta6-dev - https://github.com/discourse/discourse version 09a457f2ab3e0f3c0e78eb105dcbe0f98afcf85b\">\n<link rel=\"icon\" type=\"image/png\" href=\"https://us1.discourse-cdn.com/flex026/uploads/nodered/optimized/1X/598c4a26af3e3272e341a28c9f4adb5c75c8f5dc_2_32x32.png\">\n<link rel=\"apple-touch-icon\" type=\"image/png\" href=\"https://us1.discourse-cdn.com/flex026/uploads/nodered/optimized/1X/d073cd938eafa2e558d7c2cd59003b3ef4963033_2_180x180.png\">\n<meta name=\"theme-color\" media=\"all\" content=\"#fff\">\n\n<meta name=\"color-scheme\" content=\"light\">\n\n<meta name=\"viewport\" content=\"width=device-width, initial-scale=1.0, minimum-scale=1.0, viewport-fit=cover\">\n<link rel=\"canonical\" href=\"https://discourse.nodered.org/404\" />\n\n<link rel=\"search\" type=\"application/opensearchdescription+xml\" href=\"https://d...","redirectList":[],"retry":0}

```

So, there is a disconnect - for me - to what I'm being given.

Chrome shows me (clearly) that the data is there. My thread.  
But when I ask via NR, it just gives the _upper layer_ of stuff.

So is it I am not _asking_ for the full page in the flow, or ...... ?????

This may be a simple thing over which I am tripping.

Thanks in advance.

## Oh.....

It is getting the infamous `404` error.  
_Just noticed that._  
😕  
It's 22:55. I've been up since 06:30.  
I think it is time for bed.

---

<div class="post-metadata">

**Author:** ![Trying\_to\_learn](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/trying_to_learn/32/28400_2.png) [@Trying\_to\_learn](https://discourse.nodered.org/u/Trying_to_learn)\
**Post date:** [29 May 2025 13:04 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/19 "2025-05-29T13:04:00Z")

</div>

Did a slight tweak to the flow.

```auto
[{"id":"dcd80a56f41caa81","type":"http request","z":"65c9b63cb09879a0","name":"","method":"GET","ret":"txt","paytoqs":"ignore","url":"https://discourse.nodered.org/latest","tls":"","persist":false,"proxy":"","insecureHTTPParser":false,"authType":"","senderr":false,"headers":[{"keyType":"Accept","keyValue":"","valueType":"text/plain","valueValue":""},{"keyType":"User-Agent","keyValue":"","valueType":"other","valueValue":"Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:121.0) Gecko/20100101 Firefox/121.0"},{"keyType":"Accept","keyValue":"","valueType":"application/json","valueValue":""}],"x":5160,"y":370,"wires":[["3af232784383f3b8"]]},{"id":"89f681ae64bd6135","type":"inject","z":"65c9b63cb09879a0","name":"Node-Red","props":[{"p":"topic","vt":"str"},{"p":"payload"}],"repeat":"","crontab":"","once":false,"onceDelay":0.1,"topic":"","payload":"foo","payloadType":"str","x":4990,"y":370,"wires":[["dcd80a56f41caa81"]]},{"id":"3af232784383f3b8","type":"debug","z":"65c9b63cb09879a0","name":"debug 10","active":true,"tosidebar":true,"console":false,"tostatus":false,"complete":"true","targetType":"full","statusVal":"","statusType":"auto","x":5320,"y":370,"wires":[]}]

```

Accept JSON too.

Changed reply, but still not there.

```auto
{"_msgid":"30c9cf56b3d9ed59","topic":"","payload":"{\"users\":[{\"id\":2,\"username\":\"knolleary\",\"name\":\"Nick O'Leary\",\"avatar_template\":\"/user_avatar/discourse.nodered.org/knolleary/{size}/3_2.png\",\"admin\":true,\"moderator\":true,\"trust_level\":4},{\"id\":4905,\"username\":\"Christian-Me\",\"name\":\"Chris\",\"avatar_template\":\"/user_avatar/discourse.nodered.org/christian-me/{size}/10774_2.png\",\"trust_level\":2},{\"id\":9113,\"username\":\"euromem\",\"name\":\"Euromem\",\"avatar_template\":\"https://avatars.discourse-cdn.com/v4/letter/e/d9b06d/{size}.png\",\"trust_level\":0},{\"id\":2367,\"username\":\"mbonani\",\"name\":\"Mauricio Bonani\",\"avatar_template\":\"/user_avatar/discourse.nodered.org/mbonani/{size}/10631_2.png\",\"trust_level\":2},{\"id\":4220,\"username\":\"dclear\",\"name\":\"\",\"avatar_template\":\"/user_avatar/discourse.nodered.org/dclear/{size}/9107_2.png\",\"trust_level\":2},{\"id\":58,\"username\":\"Paul-Reed\",\"name\":\"Paul\",\"avatar_template\":\"/user_avatar/discourse.nodered.org/paul-reed/{size}/66906_2.png\",\"moderator\":true,\"trust_level\":3},{\"id\":-1,\"username\":\"system\",\"name\":\"system\",\"...","statusCode":200,"headers":{"server":"nginx","date":"Thu, 29 May 2025 13:02:01 GMT","content-type":"application/json; charset=utf-8","transfer-encoding":"chunked","vary":"Accept-Encoding, Accept","x-frame-options":"SAMEORIGIN","x-xss-protection":"0","x-content-type-options":"nosniff","x-permitted-cross-domain-policies":"none","referrer-policy":"strict-origin-when-cross-origin","x-discourse-route":"list/latest","cache-control":"no-cache, no-store","x-discourse-cached":"skip","x-request-id":"8f76f6fb-5b97-4476-bd09-e72dd3f3ee01","cdck-proxy-id":"app-router-tieadvanced03.sea2, app-balancer-tieinterceptor1b.sea2","strict-transport-security":"max-age=31536000","x-node-red-request-node":"0531d0ea"},"responseUrl":"https://discourse.nodered.org/latest","redirectList":[],"retry":0}

```

Looks like progress.  
But I'm not sure it is in the direction of help for me.  
(I'm off now.)

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [29 May 2025 14:07 UTC](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323/20 "2025-05-29T14:07:43Z")

</div>

> [@Trying\_to\_learn](#):
>
> But I'm not sure it is in the direction of help for me.

In FF, the origin code is found in "Debugger", which is similar to "Sources" in Chromium-based browsers.

> [@Trying\_to\_learn](#):
>
> But when I run FF and use NR to do the request I don't seem to be getting it.

You requested the `latest.json` resource file. So set the http-request output to "Parsed JSON":

 ![image](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/3X/9/3/9344c49ae2e3a4657d2c51e65e52ca53c3e73e1d.png)

[Next page](https://discourse.nodered.org/t/how-to-deconstruct-web-pages-with-http-request/97323.md?page=2)