What does (that didn't faze you in the least mean)?

It means didn't afffect you or didn't bother you, didn't make the impression you intended on the recipient. I think it comes from SciFi back in the 1950's when there was a fictional weapon called a Fazer that zapped a person and stopped them cold or knocked them out. You hear it on Star Trek as well, "Fazers on stun".