Reporting back.
I went to appointment and was done within 20 minutes, majority of which was waiting.
Used a terminal to get the ticket.
Person at the initial window checked whether I really had an appointnent (took 2 mins). Person at the other window took 3 mins to actually update the record.
I completed SS-5 but they never asked for it.
US passport is the only ID I had to show.
For a second, I though about trying giving passport card VS passport, but just kept it simple for SSA officer.
I was given a confirmation letter saying I'll receive replacement card in the mail within 2 weeks.