Bart, I don't think this is something ui-svg should handle. It is actually how it is with SVG click and double click handlers work.
The recommended solution is not to use both (single and double click) events on the same control.
If you do then you should be prepared to work around it.