I'm not selling fear, but you have a long way to go. The net is still wide.
I know people in this very situation who won't tell you directly, but they'll never apply for citizenship. In your case, when the net lands, everyone will lose, even your wife and kids. Everything will be reviewed with a keen eye when you apply for citizenship and it may get caught.
Did you inform the embassy you married prior to entering US? If you did and still have your GC & they issued visas for family, then you're lucky for now until someone else captures the error. There's no way the embassy would have issued the visas if they were informed of your sudden marriage.
I really doubt you informed the embassy, probably at the advise of countrymen. Countrymen always seem to have the "best and smart" advise.
Good luck.