Is there a particular IPS SID that is firing? You can exclude individual sigs as well if needed
https://www-secure.symantec.com/connect/articles/how-exclude-individual-ips-signatures-ips-policy
What I know about this feature "Active Response' is there is no way to create an exception to not block for "x" amount of time.
If you don't want it to block for "x" amount of time, you can just uncheck this option. The attack will still be blocked, it just won't be timed.
It's a way to stop DDos, brute forcing, etc.