Add the following rule beforehand to explicitly accept mails from your specific hosts.
For example:
accept hosts = 192.168.0/24 127/8