I called the number for Poland via ustraveldocs and they had me submit a ticket via the ustraveldocs website while I was on the phone. She then escalated the ticket and I got a response within a day. The embassy said to bring it to the embassy or send it via courier.
I sent the passport back via courier and it was sent back to us a few days later. Overall it was about a week door to door. They put a stamp on the erroneous K2 visa saying "cancelled without prejudice" and put the correct K2 on a different page of the passport.