COVID vaccine — the unfounded tale of infertility

It's a rumor that won't go away: COVID-19 vaccines lead to infertility in both men and women. Is there any truth to it? Or could it be possible that getting infected is worse?