Gmail archives all emails permanently unless deleted from within the archive - so if you simply delete them from within the mail app they will go from the app but remain in the archive.
I think you can schedule deletion from within Gmail itself.
They can be deleted as long as there aren't any you still need - contracts, receipts, guarantees etc.