Except that your original quibble made no mention of the comment-made-to-relative aspect of the situation, so if that was the entirety of your moral leg to stand on, you really should have clarified your ground a little better in the first place.