665 athletes have signed a vote of non-confidence in their global governing body following the decision to drop riding from Modern Pentathlon.