Throw in the towel, To

1. Whether actually done or just said, this cliche means to surrender or declare defeat.