I just looked this up and the WHO reported 367 cases of tinnitus and 164 cases of hearing loss globally among people who had received a COVID-19 vaccine. That’s out of more than 11 billion doses of COVID vaccine given worldwide, so the hearing problems seem to be extremely rare.
As other people have stated, it’s ultimately your decision to either have the vaccine and hope you’re in the majority, or attempt to get a waiver and pay the fee (plus the additional 2+ years).