If you need to do this conversion a lot, probably a good idea to create a db custom function to do it.
MariaDB/MySQL store dates only as UTC so don't forget to deal with that.
BTW, SQLite is worse since it has no date type at all. Though it does, at least, have a function to convert time strings. Just note that a trailing timezone is NOT a valid ISO8601 string, though SQLite does support some variations, just not timezones.
It is best practice to store dates and times as UTC anyway.
OK, I over stated it. You are correct that the actual standard does allow for numeric time offsets in +/-HH:MM format, some date/time handling tools do not support that aspect.
Neither MariaDB/MySQL nor SQLite support numeric offsets.
JavaScript only partially supports them. It treats ISO timestamps as UTC only but it can convert inputs with numeric offsets.