You originally had a PHP code tag, backslashes worked for me in the [ code = powershell ] tag. Again though--this part isn't really necessary:
[code]EXIT
EXIT[/code]
You don't need even 1 of those, because it's the end of the script, it'll terminate on it's own. Exit just closes the powershell window, so that may not be what you want anyways, especially if you're running this through the command line ".\script.ps1". Otherwise, running by clicking the ps1 file, and it'll close on it's own anyways. So it's really not necessary.