Physical attacks should be displayed in red, this works fine for melee swings but special attacks that are physical display in purple, this also affects fall damage.
You have to turn on spell colors. With spell colors off, any spell or skill attack, no matter its damage type, appears as the default purple spell color.