I want to poll a Voltaware monitor that’s measuring power consumption in my house. I can use a browser to view the data direct from the monitor (image below). I thought I could “just” use an “http request” node in Node-RED and parse the html UTF-8 response. However, the payload is gobbledegook - exa…

What headers does it send, it is probably compressed. this post may help [image] Http request node - gzip encrypted response General Adding a node-red-contrib-gzip node to the flow, plus a json node, and the output is correctly formed json!! [image] Thanks @BartButenae…

Brilliant - found the gzip node, added it, changed the http request node to return a binary buffer ... and the gzip node produced recognizable html. I have a debug node connected - but it only shows the first 28 lines of the web page... I've added a write file node and it outputs the full html for…

Had a rummage around in the javascript and there was another URL that returns the data in json format. I can now poll the Voltaware monitor and get “live” power consumption data - just what I wanted!

Node-RED

Node-RED Forum

Scraping Voltaware meter data?

General

E1cid 30 August 2022 19:09 2

What headers does it send, it is probably compressed.
this post may help

Topic		Replies	Views
Reading webserver data General	17	1837	4 February 2022
Http request help from web General	12	310	11 June 2022
Basic question on how to find/get Information on homepage General	9	455	16 December 2020
Grab text value from HTML General	8	2572	13 May 2020
Extract Data from a Webpage General	3	90	17 May 2026

Copyright OpenJS Foundation and Node-RED contributors. All rights reserved. The OpenJS Foundation has registered trademarks and uses trademarks. For a list of trademarks of the OpenJS Foundation, please see our Trademark Policy and Trademark List. Trademarks and logos not indicated on the list of OpenJS Foundation trademarks are trademarks™ or registered® trademarks of their respective holders. Use of them does not imply any affiliation with or endorsement by them.

Scraping Voltaware meter data?

Related topics