That is irrelevant to whether the petitioner should have filed taxes since all US citizens must report world-wide income and file taxes (if income is over the threshold) regardless of where they reside.
Primary sponsors must report taxes, if required, whether or not a Joint sponsor is used.
I would answer "no". I would enter N/A, and explain why you were not required to file a tax form for the "N/A" years.