This is somewhat of a concern, which is why it is fortunate that my local exchange allows for direct bank transfers to pay invoices. When/if conversions into fiat become a regular thing, I will probably cut the bank out of the loop entirely. :D