I wouldn't leave, it can be refused if you do that as it says in the file above ('If you leave the United States before you provide your biometrics, USCIS may deny your application.'). Biometrics can also be super short notice, I think you'll have to plan to stay until you have them.
I know you said you didn't want to pursue citizenship at this time, but it would give you the ability to come and go as freely as you wish - maybe something to look at again?