To make it with add_color_override, take the right-most part of the property name. E.g. font_color. Then, use it like this:

add_color_override("font_color", Color(1,0,0))

Making it with set is just a bit easier (and a character shorter):

set("custom_colors/font_color", Color(1,0,0))