If a man can feel the inner ring, you may not have it pushed far enough into your vagina or anus. Try pushing it in a little farther.
Still not working? If you both agree, switch to using external condoms (male). They will protect you from STIs as well.
If you are not worried about STIs with this partner, you might want to move toward a non-barrier method. The Injectable and the implant are both highly effective.
Try a different method: external condom (male), implant, injectable.
References:
- Society of Obstetricians and Gynaecologists of Canada. (2015). Canadian Contraception Consensus Chapter 5: Barrier Methods. JOGC Journal of Obstetrics and Gynaecology Canada , 37. Retrieved from https://www.jogc.com/article/S1701-2163(16)39376-8/pdf