# Get (external?) data from a website

**URL:** <https://discourse.nodered.org/t/get-external-data-from-a-website/94791>\
**Category:** General\
**Created:** [21 January 2025 16:35 UTC](https://discourse.nodered.org/t/get-external-data-from-a-website/94791 "2025-01-21T16:35:32Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![micha53](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/micha53/32/97662_2.png) [@micha53](https://discourse.nodered.org/u/micha53)\
**Post date:** [21 January 2025 16:35 UTC](https://discourse.nodered.org/t/get-external-data-from-a-website/94791/1 "2025-01-21T16:35:32Z")

</div>

I want to get data once a day from the table shown at this website:  
[https://www.epexspot.com/en/market-results?market\_area=DE&auction=&delivery\_date=2025-01-19&underlying\_year=&modality=Continuous&sub\_modality=&technology=&data\_mode=table&period=&production\_period=&product=60](https://www.epexspot.com/en/market-results?market_area=DE&auction=&delivery_date=2025-01-19&underlying_year=&modality=Continuous&sub_modality=&technology=&data_mode=table&period=&production_period=&product=60)  
but the content of the table isn't part of the html code.  
Is there any possibility to get and store this table content locally?

---

<div class="post-metadata">

**Author:** ![TotallyInformation](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/totallyinformation/32/31_2.png) [@TotallyInformation](https://discourse.nodered.org/u/TotallyInformation)\
**Post date:** [21 January 2025 17:51 UTC](https://discourse.nodered.org/t/get-external-data-from-a-website/94791/2 "2025-01-21T17:51:34Z")

</div>

> [@micha53](#):
>
> Is there any possibility to get and store this table content locally?

There is ALWAYS a possibility. 😄

However, in this particular case, that possibility is more than a little convoluted. Looking at the data on-page, the "table" is not actually a single table and I expect it is dynamically generated anyway.

As such, you would need a full headless browser such as puppet. There are nodes that wrap such tools available in the flows library.

But even so, I suspect that getting the data in a meaningful way will be complex.

---

<div class="post-metadata">

**Author:** ![ziga](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/ziga/32/98138_2.png) [@ziga](https://discourse.nodered.org/u/ziga)\
**Post date:** [21 January 2025 19:34 UTC](https://discourse.nodered.org/t/get-external-data-from-a-website/94791/3 "2025-01-21T19:34:45Z")

</div>

You could use something like [node-html-parser](https://www.npmjs.com/package/node-html-parser) to parse the retuned HTML and then build the proper structure by querying DOM elements.

Edit: I also found this flow, perhaps you'll find it helpful.  
[https://flows.nodered.org/flow/bd2cefe5cf8f36233b3b736deb256788](https://flows.nodered.org/flow/bd2cefe5cf8f36233b3b736deb256788)

---

<div class="post-metadata">

**Author:** ![micha53](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/micha53/32/97662_2.png) [@micha53](https://discourse.nodered.org/u/micha53)\
**Post date:** [24 January 2025 09:43 UTC](https://discourse.nodered.org/t/get-external-data-from-a-website/94791/4 "2025-01-24T09:43:03Z")

</div>

Thanks for the contributions, I found another and better way to get the epex data of the last years  
[Spot Market Prices | Energy-Charts](https://energy-charts.info/charts/price_spot_market/chart.htm?l=en&c=DE&legendItems=1x2c2&interval=month&year=2024&month=03)

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/1X/d073cd938eafa2e558d7c2cd59003b3ef4963033.png) [@system](https://discourse.nodered.org/u/system)\
**Post date:** [24 April 2025 09:43 UTC](https://discourse.nodered.org/t/get-external-data-from-a-website/94791/5 "2025-04-24T09:43:28Z")

</div>

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.