CLICK - Add a color
SHIFT + CLICK - Remove last instance of a color
ALT + CLICK - Remove ALL instances of a color