Hi,
of course this is possible. The patch management agent is just a plugin and can be uninstalled separately. Just create an uninstallation policy with the XP machines as a target.
Have a look for the default policies in Settings --> All Settings --> Agents/Plug-ins --> Software --> Patch Management --> Windows
Just make a clone of the existing policy and customize it for your needs.
Regards
MD