If they have not communicated then yes, it will remove the SEP client entry.
Way to do that
Open SEPM console and click on Admin ---> Servers
Right click on the Site and choose Edit Properties
Check "Delete Clients that have not connected for __ Days"
Enter a value for Days.
Click OK.