An application for service may be withdrawn, all or in part, by the applicant at any time; Provided, That the applicant notifies the USDA service office in writing of its desire to withdraw the application for service and pays any expenses USDA has incurred in connection with such application.