Saying Kaddish together with others

Is there a problem if I am saying the Kaddish at a minyan and do not say the words “Ve’Imru Amen” that are before the “Yehay Shmay Rabba” loud enough for anyone to hear. Does this invalidate my Kaddish since the main purpose of the Kaddish is to urge those present to bless Hashem by saying “Yehay Shmay Rabba” and I haven’t urged them.

Just make sure ten people hear you