Palette Change Symbols do not stay as chosen

I am using the default DP Cross Stitch Font for symbols2 and DP Cross Stitch 3 Font for symbols3.
If I set any palette color with symbols with Cross Stitch Font 3(symbols3), continue to work with the pattern, and then choose - for example - remove unused pallette colors (and also other pallette operations) - even tho the color that I changed the symbol for was not removed, the symbols all revert back to just using the default DP Cross Stitch Font. I have even changed the default template to always include DP Cross Stitch 3 Font as symbols3 but this still consistently happens. Is there a way to stop this from happening?
If I set any palette color with symbols with Cross Stitch Font 3(symbols3), continue to work with the pattern, and then choose - for example - remove unused pallette colors (and also other pallette operations) - even tho the color that I changed the symbol for was not removed, the symbols all revert back to just using the default DP Cross Stitch Font. I have even changed the default template to always include DP Cross Stitch 3 Font as symbols3 but this still consistently happens. Is there a way to stop this from happening?