You must disclose it, it's not optional. Whether to get the docs now or not it's your call. If you're OK losing filing fee and reapplying for N-400 in the future, you can just see if it's going to skip through without issue or get denied. It appears like you got immigrant visa. If it was that bad, you would have not been issued visa.
~ Not a legal advice ~