exFAT is only for temporary file transfers and memory cards. It is a non-journaled system which makes data loss significantly more likely. That is not a problem with your memory card because obviously you are recording to 2 at a time if you care about it at all. I would not store any critical data on it, unless you have very good backups, and you actually should have that anyway.
There is nothing wrong with AFPS other than the fact you are well and truly stuck with Mac for reading and writing it.
There are many factors affecting speed and most obvious ones include drive spec and interface throughput and load.