Yes.. we all hate that saying I think

I know I do.
Sometimes though, the customer is so blatantly wrong, and rude, that you have no choice but to discontinue working with them.
I have to do that once. I lost money, but in the end I was happier not to deal with that person anymore.