Any permit issued pursuant to § 126.19 shall terminate automatically at the conclusion of the transaction for which the permit has been issued and may be terminated, or suspended, prior thereto by the Captain of the Port whenever he deems that the security or safety of the port or vessels or waterfront facilities therein so requires. Confirmation of such termination or suspension by the Captain of the Port shall be given to the permittee in writing.