Issues:
A. The current "Save/Cancel" buttons (in the Alerts Setup tab) could create confusion for the user – it is difficult to tell if this is a page-level or inline save action. If page level, the buttons are hidden in the tab.
B. Using an inline tab-set for a section (versus a page), is cumbersome within a multi section page.
C. The Alert setup On/Off toggle buttons (to the right) could get overlooked, when the screen is very wide.

Possible resolution:
Place the Alerts Setup form content within a modal overlay, keeping the explicit save/cancel actions. The modal could get spawned using a text link: "Alert Setup" (or "Alert Settings") from within the Alerts section.