Why is there a bad smell with the cervical cap?

This can happen if you leave it in for more than 48 hours.
Try this: rinse it thoroughly and let it air dry. If the odor sticks around, you should talk to your provider about a condition called bacterial vaginosis.