First of all, from monitors list enter a monitor's edit dock and select "Notifications" Tab.
In this section you will see all users and notification types.
You can enable / disable with switches.
How Do I Stop Notifications During Routine Maintenance?
When your service is down for routine maintenance you can stop monitor (How to stop monitor?) or disable all notifications for users (on notifications tab).