I know the Doctor had his memories wiped of Clara but won't he get them back if he sees the people they've met before like Vastra and Jenny, etc? I mean they'll just tell him of toon him photos, right?

My guess is that he'd be completely blank if anyone ever mentioned Clara, keep insisting that he's never met anyone with that name, and that they'd then get the hint and drop the subject. Unless, of course, there's a future story where she returns and he would have to remember her.