So yes, some small sign would be good to warn off those who expect you to be jolly. Wearing all black is an option, although ...

But did Victorian men have something similar ... those of more modest income had to dye their regular clothes black, ...