If you are using the same port and IP address for inbound and outbound, you need to just make sure the IP addresses of the senders are in the list of Outbound Mail Acceptance IPs. You can only have 3 though, so if you have a lot of clients that need to send outbound mail, they should be sending to your mail server instead of trying to relay through us directly.
From page 93 of the Administration Guide:
You can configure a Scanner to accept outbound connections from up to three
mail servers. By allowing connections from only certain IP addresses and domains,
you exclude all other hosts from sending messages at connection time.
Note: If you use the same IP address and port for inbound and outbound email,
the Scanner uses outbound mail acceptance settings to determine if a message is
inbound or outbound. The Scanner first checks outbound mail acceptance settings.
If the mail is not accepted, the Scanner then checks inbound mail acceptance
settings.
In the case above, the IP address you were connecting from was not in the Outbound Mail Acceptance list.