Here is sample output from the Test tool in the Alert Manager for a script. It prints out a success message, but nothing runs. I wish it would give me a return code, or something!
12/19/2013 4:59:54 PM: Initiating test for alert Testing Alert Trigger.
12/19/2013 4:59:54 PM: Retrieved 1 actions for alert Testing Alert Trigger.
12/19/2013 4:59:54 PM: Preparing action type ExecuteProgram to test alert Testing Alert Trigger.
12/19/2013 4:59:54 PM: Alert Testing Alert Trigger: - Success - C:\Windows\System32\WindowsPowerShell\v1.0\powershell.exe -Command "C:\scripts\derp.ps1 'server-host1'"
12/19/2013 4:59:54 PM: Action type ExecuteProgram for alert Testing Alert Trigger completed successfully.
12/19/2013 4:59:54 PM: Completed action type ExecuteProgram for alert Testing Alert Trigger.
12/19/2013 4:59:54 PM: Completed test for alert Testing Alert Trigger.