Thanks for replies, maybe I should've included this in the initial post, when guy was asked about it after he said he wasn't trying to make a joke but was just making conversation and that was what popped into his head.
You've got people running around in circles in here, so the onus is really on you to seek more information from the guy (who may or may not be your friend)
In the OP you stated he was being "sarcastic," but then later he's just "making conversation" and then later still he's "not being racist."
So maybe just ask him flat out what he meant?
Otherwise people are just going to make their own inferences (the most obvious one being a stereotype about Africans), and it's just a waste of a thread.