I have read the unhelpful recommendations to turn off notifications for Mail (but I don't want to turn off all of my Mail notifications, just the Exchange password notification) and to disable the Exchange account )but I do not want to disable the Exchange account, just disable the the password notification).
I recall a recent OS update announcement claiming to address this specific issue but the issue was not in fact addressed. This is a significant annoyance in a telecommuting world.