I have a few hundred rows in Mongodb that I need extract on a scheduled basis, run each row through some functions and then update the database. I grabbed Mongodb3 connector because it allowed BulkWrite and UpdateMany since I'd prefer to handle the updates in batches.
I can't figure out the flow though - If I begin with Mongo foreach and pass through my functions I need something on the other side to batch them up for the db update. I tried batch/join but that appears to expect a constant flow like MQTT type messaging. There's no handling of the remainder if you end up with extra rows after the last full batch was sent.
Suggestions very much appreciated!