There is no need or requirement for the spouse to travel with. My husband traveled internationally and domestically many times without me while he only had his green card with absolutely no issues whatsoever, and no mention of it when he removed conditions or when he naturalized.