Hello, you can both go in the doors but, your husband will stay in the area you enter. Where my husband entered they had seats. He your husband can stay there but you must go on by yourself. Don't worry there is nothing to be nervous about.
My husband said people forgot to take their letters but, immigration officers I think will get who ever forgets them a copy.
Note, they take about 12 people at a time to take the Oath and you just repeat what they say. It's the easiest part of this very long (for us) and tedious process.
Congratulations my dear, enjoy saying goodbye to USCIS.
ππ€π