Allow to change swatches for Sketch component

I would like to be able to change the color swatches shown in the Sketch components. But as far as I can see there is not property to achieve this.

Working with brand colors I would like the user to freely select colors but at the same time also having brand colors available as swatches. The sketch component looks excellent for that case, but it seem I am not able to change the swatch color.

Any advise? Would this be a feature request?