I think the problem here is how the word ordinance is being used. I don't think we are using it in the same way that you think we are.
An ordinance is simply an established rite or ceremony; or a rule established by authority. (Websters 1828). The rule here is established by the authority of the Holy Bible (AV1611). It is something we observe as a rule - the exception would be for those Christians who choose not to be baptized. it is their choice (a poor one IMO). It doesn't make them any less saved, or me more saved. But it is the established practise based upon the examples listed in Scripture, as John G has listed for us.

This appears to me to be a problem in semantics.