You got the answer from @Crazy Cat
In addition:
"Tax evasion is a felony. Any attempt to “evade or defeat” a tax is punishable by up to $250,000 in fines ($500,000 for corporations), five years in prison or a combination of the two, according to the IRS Tax Crimes Handbook. Plus, you’ll also be responsible for covering the costs of prosecution."
Not working doesn't equal no income. Do you have any income? Are kids of working age? Do they make money?
How does your spouse file taxes now? Single (incorrect) or Married Filing Separately? If any of these, you're required to file taxes under Married Filed Separately and repory any income of your own over $5
More info: https://www.greenbacktaxservices.com/knowledge-center/us-citizen-abroad-taxes/