Nope, no clips, no retainer. It's just a slip fit. The tightest part of the connection is the o-ring. What you're up against now is the nose piece is probably cocked in the case. It will need to be worked, gently, back to a straight position so it can be worked out.
At this point, take all caution. Any more heavy hits are putting you at risk of damaging the case.