A member of the watchdog Judicial Services Commission has said he would no longer attend meetings because of concerns over its independence.