SmartPOP2Exchange only deletes emails from the POP3 server if it has been successfully sent to the destination SMTP server.
If the SMTP server refuses the email more than 3 times it will be saved to the folder "<backup path>\DeliveryFailure" and a summary email will be generated and tried to be delivered instead.