Colors / symbols is a bit of a mess. For a regular horoscope window there can be 3 different fontsizes in effect and each can be a different symbolfont. The column on the left and the elements table can be 16 or 24, the wheel can be 16, 24 or 32, the aspecttable in the lower left corner only 16.
Say you have large fonts set, but you want to change the 24 font for the column to some other symbolfont, you first have to change the general font size to Normal, only then you can select which symbolfont you want for normal.
Same situation when editing fonts, it's a design oversight. Maybe someday.. but there's a lot of work and code involved.