Watch Node on Deep Directory Tree Slow to Deploy

General
1

When there is just a single level, even with lots (+17,000 files), the watch node works surprisingly well but as soon as I add subdirectories and turn on "Watch sub-directories recursively", deploying then takes minutes for any change in the flows. Any alternative nodes or methodology would be appreciated. The files are on a network drive if that makes any difference.

Windows 10
Node-red v1.2.6

2

Have you tried it with sub folders but just with a few files to see if it is the sub folders or number of files causing the issue?

3

I tried just creating sub folders (21 levels) and was quick. Did a check and one of the locations has 30,000 files and 35,000 folders. Annoyingly I'm only interested in a small subset of files that have a naming convention in the folder. May try getting my hands dirty and creating a version with inclusion rules but not sure if that will make it any better, maybe the sheer numbers is the issue.

4

Sorry I thought this was a run time issue not a deploy issue. What option for deploying are you using? Is it Full? If so, try using Modified Flows instead
Screen Shot 2021-02-12 at 4.34.20 AM

5

I always use the modified nodes deploy, is modified flows better?

6

Hmmm, I'm on a MAC and when I select the 'subdirectories' option I run into an error about a missing file that is a link. I'll dig into this tomorrow.

7

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.