Stopping birth control, advice appreciated

I've been taking Swansons BO now for just over 4 month along side my birth control without issue (no real growth, but no side effects either). I am now looking at stopping my BC pill, but didn't know if I should stop BO for a bit while my body gets used to no synthetic hormones, or, will BO help kick start my ovaries and pituitary again?
Any opinions, advice or suggestions would be welcomed