Ah ok, I thought this will be too much right now 
EDIT: Forget it... you were right! The test switch wasn't configured right.... that was connected the one not connected shelly that is laying around... I didn't take a look at this on my debug trys (because it wasn't in use)....
Now it seems to be fixed 