According to the Boston Globe, Navy interrogators threatened to withdraw from the entire set of Guantanamo interrogations due to their disgust at the tactics being used by other interrogators — and actually withdrew in at least once case:
A top Navy psychologist reported to his supervisor in December 2002 that interrogators at Guantanamo were starting to use “abusive techniques.” In a separate incident that same month, the Defense Department's joint investigative service, which includes Navy investigators, formally “disassociated” itself from the interrogation of a detainee, after learning that he had been subjected to particularly abusive and degrading treatment.
The two events prompted Navy law enforcement officials to debate pulling out of the Guantanamo operation entirely unless the interrogation techniques were restricted. The Navy's general counsel, Alberto Mora, told colleagues that the techniques were “unlawful and unworthy of the military services.”
One again, the military lawyers stand out as the (only?) heroes of this sordid affair.