Always do right, you will gratify some and astonish the rest.
The issue that Mr. Clemens is referring to deals with the definition of 'right'.
Any tome discussing the topic of 'ethics' must refer to the axiom:
Always avoid the appearance of impropriety.
Appearances will always trump any concept of 'real' impropriety because of evidentiary concerns.