I install the full package to everything, including PTP on servers.
It won't run, and so far, I can't see any negative impact. I've tried it both ways, and on the servers we have some weird issues with, leaving it off, or installing ONLY the AV made no difference at all. So I can't even blame weirdness on PTP being there but ot active on servers.
It sees it's on a server and won't run.
Easier for me to keep as few distinct builds or packages as possible since I'm it as far as SEP here, along with 100 other hats.
So, I guess - it's a personal choice, IMO.......... no harm either way that I see.