Refactor regex group parsing and explicitly reject unsupported group types

Refactor regex group parsing and explicitly reject unsupported group types #6849