# Any volunteers for lipsync via tensorflow and opencv?

**URL:** <https://discourse.nodered.org/t/any-volunteers-for-lipsync-via-tensorflow-and-opencv/30124>\
**Category:** General\
**Created:** [15 July 2020 11:19 UTC](https://discourse.nodered.org/t/any-volunteers-for-lipsync-via-tensorflow-and-opencv/30124 "2020-07-15T11:19:54Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![BartButenaers](https://sea2.discourse-cdn.com/flex026/user_avatar/discourse.nodered.org/bartbutenaers/32/10476_2.png) [@BartButenaers](https://discourse.nodered.org/u/BartButenaers)\
**Post date:** [15 July 2020 11:19 UTC](https://discourse.nodered.org/t/any-volunteers-for-lipsync-via-tensorflow-and-opencv/30124/1 "2020-07-15T11:19:55Z")

</div>

Hi folks,

Saw yesterday on Twitter a retweet from @dceejay about [LipSync](https://blog.tensorflow.org/2020/07/using-machine-learning-in-browser-to-lip-sync.html). From their [Github](https://github.com/google/lipsync) page, it seems that there is a Tensorflow [FaceMesh](https://github.com/tensorflow/tfjs-models/tree/master/facemesh) model available. I assume that can be used in node-red via the [node-red-contrib-tf-model](https://flows.nodered.org/node/node-red-contrib-tf-model) node? And then they do some processing via OpenCV matchShapes.

I think this might be a fun Node-RED project, to implement e.g. voice recognition based on webcam images. So using images instead of audio...

I'm not experienced with the Tensorflow and OpenCv matchShapes stuff, so I was wondering if there is anybody in the community that has enough time and knowledge to experiment with this ...

And of course if some extra nodes are required for this, I will pop in 😉

Bart

---

<div class="post-metadata">

**Author:** ![system](https://us1.discourse-cdn.com/flex026/uploads/nodered/original/1X/d073cd938eafa2e558d7c2cd59003b3ef4963033.png) [@system](https://discourse.nodered.org/u/system)\
**Post date:** [13 September 2020 11:19 UTC](https://discourse.nodered.org/t/any-volunteers-for-lipsync-via-tensorflow-and-opencv/30124/2 "2020-09-13T11:19:58Z")

</div>

Closed on 13 September 2020 11:19 UTC

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.
