# How to transfer data from Node-RED (message.payload) to Azure Blob Storage?

**URL:** <https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764>\
**Category:** General\
**Created:** [4 April 2019 10:10 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764 "2019-04-04T10:10:06Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![xoani](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/xoani/32/7844_2.png) [@xoani](https://discourse.nodered.org/u/xoani)\
**Post date:** [4 April 2019 10:10 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/1 "2019-04-04T10:10:06Z")

</div>

I have a python script that retrieves data from a smart plug (to monitor energy consumption from devices). My end goal is to analyze this data with Stream Analytics and therefore I need to send it to a database in Microsoft Azure.

Right now I am running the python script on Node-RED and the output comes into message.payload. I want to send this data to Blob Storage and for that I am using this node [https://flows.nodered.org/node/node-red-contrib-azure-blob-storage](https://flows.nodered.org/node/node-red-contrib-azure-blob-storage)

The problem is that I am getting this error:

`4 Apr 11:57:51 - [info] [Save Blob:Azure Save Blob Storage] Uploading blob... 4 Apr 11:57:51 - [info] [Save Blob:Azure Save Blob Storage] Container 'container5' ready for blob creation 4 Apr 11:57:52 - [info] [Save Blob:Azure Save Blob Storage] Error: ENOENT: no such file or directory, stat 'Thu Apr 4 11:57:51 2019 21 mA 229867 mV 0 mW 556 Wh`

Those values ( 21 mA, 229867 mV, 0 mW,556 Wh) are what I want to save in Blob Storage. I know that this node can connect to my Blob Storage account because that container5 is being created every time I press inject. But the data is not coming anywhere. Can anyone offer some help?

_ **UPDATE** _\*\*\*\*\*\*\*  
I have been googling a lot and the only possible problem I could find, is that the PUT and POST Requests need authentication in order to work (for GET I could just set the container in "public" mode and it worked). This means I need to use some kind of authentication in order to use PUT-Request, which is what I need. The problem now is that I cannot find any username or password in the Azure Service (Blob storage), only the access keys, shared access signature (SAS) and not much more. I am not experience so I don't know what to write in the HTTP node in order to do this authentication. Any help?

---

<div class="post-metadata">

**Author:** ![ukmoose](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/ukmoose/32/13_2.png) [@ukmoose](https://discourse.nodered.org/u/ukmoose)\
**Post date:** [4 April 2019 10:15 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/2 "2019-04-04T10:15:29Z")

</div>

Please can you explain how this is different from the issue you already have open on transferring data rob azure cloud?

---

<div class="post-metadata">

**Author:** ![xoani](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/xoani/32/7844_2.png) [@xoani](https://discourse.nodered.org/u/xoani)\
**Post date:** [4 April 2019 10:25 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/3 "2019-04-04T10:25:44Z")

</div>

Hello. This question is more specific and relevant to me. I have already flagged my other questions so that they get deleted (I cannot delete them myself). Please ignore the other two. I need help with this one.

---

<div class="post-metadata">

**Author:** ![ukmoose](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/ukmoose/32/13_2.png) [@ukmoose](https://discourse.nodered.org/u/ukmoose)\
**Post date:** [4 April 2019 10:33 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/4 "2019-04-04T10:33:06Z")

</div>

That’s not how the forum works. The posts stay so that others in the future can benefit for the information.

Opening a new thread just makes it harder for other users of Node-RED to help you, and makes it harder for others to benefit in the future.

You can always add extra information into an existing thread.

---

<div class="post-metadata">

**Author:** ![xoani](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/xoani/32/7844_2.png) [@xoani](https://discourse.nodered.org/u/xoani)\
**Post date:** [4 April 2019 10:36 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/5 "2019-04-04T10:36:03Z")

</div>

Well I know now for the next time. I still need help, so please post only if you have any knowledge that might help me.

---

<div class="post-metadata">

**Author:** ![dustinw](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/dustinw/32/3426_2.png) [@dustinw](https://discourse.nodered.org/u/dustinw)\
**Post date:** [4 April 2019 14:43 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/6 "2019-04-04T14:43:55Z")

</div>

Hi @xoani ... it looks like the root issue is in the Azure Blob node. If you look at the source for the node: [azureblobstorage.js](https://github.com/Azure/node-red-contrib-azure/blob/master/blob-storage/azureblobstorage.js#L85) it's calling createContainer followed by createBlocBlobFromLocalFile.

It would be convenient if the node supported both sending the payload directly and creating if from a local file, but according to the [Readme](https://github.com/Azure/node-red-contrib-azure/tree/master/blob-storage) file on the project:

> #### Azure Blob Storage
> 
> Node-Red node to connect to Azure Blob Storage
> 
> Ex: 'msg.payload' -\> filename that you need to upload. Ex: filename.txt
> 
> - Use `msg.payload` to send a file to save on Azure Blob Storage.

---

<div class="post-metadata">

**Author:** ![xoani](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/xoani/32/7844_2.png) [@xoani](https://discourse.nodered.org/u/xoani)\
**Post date:** [5 April 2019 06:58 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/7 "2019-04-05T06:58:49Z")

</div>

Hi @dustinw thanks for your reply 🙂 I am not a programmer so sorry if I ask dumb stuff. Looking at the code, I see that it only uploads local files right? So you mean that I cannot upload the message.payload directly, I would probably have to modify my python script and store the values in a file, so that this file can get uploaded. Right?

If this is the solution, I have a problem with it because my python script outputs new values every seconds (with a timestamp). So how could I do this? Do I rewrite the same file every seconds and inject the blob node every seconds too?

---

<div class="post-metadata">

**Author:** ![dustinw](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/dustinw/32/3426_2.png) [@dustinw](https://discourse.nodered.org/u/dustinw)\
**Post date:** [5 April 2019 15:59 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/8 "2019-04-05T15:59:47Z")

</div>

Since you control both the Pyhon code and the Node-Red process, there are many ways you could handle this ... some options:

1. Update the Azure node so that there's an option to pass in the blob as the payload (and then calling [createAppendBlobFromText](https://azure.github.io/azure-storage-node/BlobService.html#createAppendBlobFromText__anchor) )

2. Change your Node-Red process to write out a temp file then send that temp file

3. Change your Pyhon code to write out a temp file then send that temp file

---

<div class="post-metadata">

**Author:** ![xoani](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/xoani/32/7844_2.png) [@xoani](https://discourse.nodered.org/u/xoani)\
**Post date:** [10 April 2019 07:05 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/9 "2019-04-10T07:05:59Z")

</div>

hi @dustinw and thank you! I think for me option 2 or 3 would be ok because tbh I don't really understand option 1 (it's probably the most advanced, right? ). In the meantime I have found out what my problem is, I can't even access the blob storage cause I need authentication (please see the update I wrote on my question). Thanks. If you have any idea how to do this, please let me know. I am stuck since many days.

---

<div class="post-metadata">

**Author:** ![dustinw](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/dustinw/32/3426_2.png) [@dustinw](https://discourse.nodered.org/u/dustinw)\
**Post date:** [10 April 2019 17:16 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/10 "2019-04-10T17:16:52Z")

</div>

The Azure Node handles Authentication for you.

The error you added earlier looks like you have successfully authenticated via the API. Have you tried creating a temporary file and putting the path to that temporary file in the payload of the Azure Storage node?

Switching from using the `node-red-contrib-azure-blob-storage` node to the builtin HTTP node would add a lot of work for authentication, etc.

---

<div class="post-metadata">

**Author:** ![xoani](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/xoani/32/7844_2.png) [@xoani](https://discourse.nodered.org/u/xoani)\
**Post date:** [11 April 2019 10:46 UTC](https://discourse.nodered.org/t/how-to-transfer-data-from-node-red-message-payload-to-azure-blob-storage/9764/11 "2019-04-11T10:46:44Z")

</div>

Hello, you are right. I tried switching to HTTP but the authentication process is very hard so now I am back to this node. It works now! The problem was that I had to create the file manually in /home/pi so that it can be found and uploaded. Now the problem is that I want this file to be created automatically. But I will create another question for this matter. Thanks!